-- Logs begin at Tue 2022-09-06 19:25:53 UTC, end at Tue 2022-09-06 20:45:33 UTC. -- Sep 06 20:04:47.639713 dv-cinder-847732-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 06 20:04:47.649068 dv-cinder-847732-4-smb devstack@keystone.service[81834]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 06 20:04:47.651087 dv-cinder-847732-4-smb devstack@keystone.service[81834]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 6 20:04:47 2022] *** Sep 06 20:04:47.651087 dv-cinder-847732-4-smb devstack@keystone.service[81834]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 06 20:04:47.651087 dv-cinder-847732-4-smb devstack@keystone.service[81834]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 06 20:04:47.651087 dv-cinder-847732-4-smb devstack@keystone.service[81834]: nodename: dv-cinder-847732-4-smb Sep 06 20:04:47.651087 dv-cinder-847732-4-smb devstack@keystone.service[81834]: machine: x86_64 Sep 06 20:04:47.651087 dv-cinder-847732-4-smb devstack@keystone.service[81834]: clock source: unix Sep 06 20:04:47.651087 dv-cinder-847732-4-smb devstack@keystone.service[81834]: pcre jit disabled Sep 06 20:04:47.651087 dv-cinder-847732-4-smb devstack@keystone.service[81834]: detected number of CPU cores: 4 Sep 06 20:04:47.651087 dv-cinder-847732-4-smb devstack@keystone.service[81834]: current working directory: / Sep 06 20:04:47.651087 dv-cinder-847732-4-smb devstack@keystone.service[81834]: detected binary path: /usr/bin/uwsgi-core Sep 06 20:04:47.651087 dv-cinder-847732-4-smb devstack@keystone.service[81834]: your processes number limit is 47680 Sep 06 20:04:47.651709 dv-cinder-847732-4-smb devstack@keystone.service[81834]: your memory page size is 4096 bytes Sep 06 20:04:47.651709 dv-cinder-847732-4-smb devstack@keystone.service[81834]: detected max file descriptor number: 2048 Sep 06 20:04:47.651709 dv-cinder-847732-4-smb devstack@keystone.service[81834]: lock engine: pthread robust mutexes Sep 06 20:04:47.651709 dv-cinder-847732-4-smb devstack@keystone.service[81834]: thunder lock: enabled Sep 06 20:04:47.651709 dv-cinder-847732-4-smb devstack@keystone.service[81834]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 06 20:04:47.651709 dv-cinder-847732-4-smb devstack@keystone.service[81834]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 06 20:04:47.690970 dv-cinder-847732-4-smb devstack@keystone.service[81834]: Python main interpreter initialized at 0x555eeab019c0 Sep 06 20:04:47.690970 dv-cinder-847732-4-smb devstack@keystone.service[81834]: python threads support enabled Sep 06 20:04:47.690970 dv-cinder-847732-4-smb devstack@keystone.service[81834]: your server socket listen backlog is limited to 100 connections Sep 06 20:04:47.690970 dv-cinder-847732-4-smb devstack@keystone.service[81834]: your mercy for graceful operations on workers is 90 seconds Sep 06 20:04:47.691354 dv-cinder-847732-4-smb devstack@keystone.service[81834]: mapped 403077 bytes (393 KB) for 2 cores Sep 06 20:04:47.691430 dv-cinder-847732-4-smb devstack@keystone.service[81834]: *** Operational MODE: preforking *** Sep 06 20:04:47.691712 dv-cinder-847732-4-smb devstack@keystone.service[81834]: *** uWSGI is running in multiple interpreter mode *** Sep 06 20:04:47.691712 dv-cinder-847732-4-smb devstack@keystone.service[81834]: spawned uWSGI master process (pid: 81834) Sep 06 20:04:47.691933 dv-cinder-847732-4-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 06 20:04:47.692545 dv-cinder-847732-4-smb devstack@keystone.service[81834]: spawned uWSGI worker 1 (pid: 81846, cores: 1) Sep 06 20:04:47.692850 dv-cinder-847732-4-smb devstack@keystone.service[81834]: spawned uWSGI worker 2 (pid: 81847, cores: 1) Sep 06 20:04:47.693005 dv-cinder-847732-4-smb devstack@keystone.service[81834]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 06 20:04:52.112326 dv-cinder-847732-4-smb devstack@keystone.service[81846]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 20:04:52.112326 dv-cinder-847732-4-smb devstack@keystone.service[81846]: from cryptography.utils import int_from_bytes Sep 06 20:04:52.113082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 20:04:52.113082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: from cryptography.utils import int_from_bytes Sep 06 20:04:52.113192 dv-cinder-847732-4-smb devstack@keystone.service[81847]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 20:04:52.113192 dv-cinder-847732-4-smb devstack@keystone.service[81847]: from cryptography.utils import int_from_bytes Sep 06 20:04:52.113596 dv-cinder-847732-4-smb devstack@keystone.service[81847]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 20:04:52.113596 dv-cinder-847732-4-smb devstack@keystone.service[81847]: from cryptography.utils import int_from_bytes Sep 06 20:04:52.165144 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 20:04:52.165359 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 20:04:52.165359 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 20:04:52.165514 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 20:04:52.165588 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] command line args: [] {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 20:04:52.165671 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] command line args: [] {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 20:04:52.165822 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 20:04:52.165942 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 20:04:52.166019 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ================================================================================ {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 20:04:52.166084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ================================================================================ {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 20:04:52.166244 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] admin_token = **** {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.166368 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] admin_token = **** {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.166492 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] config_dir = [] {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.166581 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] config_dir = [] {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.166683 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.166770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.166853 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] config_source = [] {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.166924 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] config_source = [] {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.167029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] debug = True {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.167114 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] debug = True {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.167229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.167522 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.167615 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.167680 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.167819 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.167903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.168045 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.168133 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.168297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.168387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.168528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] list_limit = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.168614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] list_limit = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.168719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] log_config_append = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.168792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] log_config_append = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.168897 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.168968 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.169059 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] log_dir = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.169129 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] log_dir = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.169237 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] log_file = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.169309 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] log_file = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.169471 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.169664 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.169782 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.169882 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.169958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.170023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.170178 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.170299 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.170476 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.170568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.170568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.170716 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.170841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.170922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.171037 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.171121 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.171197 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.171311 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.171420 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.171585 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.171710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.171818 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.171903 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.172050 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.172167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.172253 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.172377 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.172464 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.172679 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.172764 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.173191 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.173281 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.173359 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] publish_errors = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.173455 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] publish_errors = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.173673 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.173773 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.173852 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.173928 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.173999 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.174073 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.174212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.174310 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.174448 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.174527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.174688 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] standard_threads = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.174790 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] standard_threads = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.174916 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.175001 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.175161 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.175238 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.175335 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.175424 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.175521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] use_journal = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.175592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] use_journal = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.175697 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] use_json = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.175771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] use_json = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.177385 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] use_stderr = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.177478 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] use_stderr = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.177558 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] use_syslog = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.177629 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] use_syslog = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.177688 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.177756 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 20:04:52.177824 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.177969 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.178043 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.178112 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.178187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.178334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.178420 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.178501 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.178573 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.178642 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.178712 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.178781 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.178899 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.178985 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.179063 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.179134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.179208 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.179278 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.179347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.179347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.179556 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.179631 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.179700 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.179769 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.179838 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.179974 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.180057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.180128 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.180197 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.180272 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.180351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.180432 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.180503 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.180578 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.180649 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.180724 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.180894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.180975 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.181152 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.181231 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.181400 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.181479 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.181639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.181725 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.181896 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.181980 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.182145 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.182224 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.182417 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.182495 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.182598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.182672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.182829 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.182921 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.183098 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.183231 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.183338 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.183416 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.183598 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.183679 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.183834 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.183913 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.184067 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.184154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.184302 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.184379 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.184538 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.184617 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.184779 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.184877 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.185023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.185101 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.185254 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.185333 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.185493 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.185570 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.185724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.185807 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.185955 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.186032 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.186187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.186301 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.186416 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.186496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.186647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.186754 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.186879 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.186984 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.187113 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.187232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.187337 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.187432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.187650 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.187746 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.187842 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.187951 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.188032 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.188668 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.188861 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.188941 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.189103 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.189185 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.189342 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.189473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.189594 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.189715 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.189827 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.189906 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.190066 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.190157 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.190306 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.190392 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.190545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.190665 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.190778 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.190857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.191013 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.191090 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.191248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.191329 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.191522 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.191606 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.191761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.191852 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.192001 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.192122 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.192238 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.192327 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.192477 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.192563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.192719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.192840 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.192950 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.193036 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.193190 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.193269 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.193428 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.193507 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.193685 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.193774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.193927 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.194005 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.194165 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.194248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.194444 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.194694 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.194821 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.194920 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.195000 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.195077 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.195148 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.195228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.195376 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.195476 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.195646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.195725 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.195887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.195980 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.196138 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.196219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.196376 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.196458 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.196614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.196710 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.196853 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.196934 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.197087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.197166 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.197323 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.197401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.197558 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.197638 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.197798 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.197878 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.198060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.198140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.198300 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.198386 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.198538 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.198616 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.198782 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.198874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.199017 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.199097 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.199255 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.199373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.199500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.199576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.204561 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.204721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.204888 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.205002 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.205085 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.205159 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.205245 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.205321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.205393 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.205465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.205536 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.205608 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.205741 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.205820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.205884 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.206002 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.206123 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.206249 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.206392 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.206519 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.206647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.206775 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.206933 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.207072 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.207272 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] auth.external = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.207431 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.207612 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.207710 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.207785 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.207912 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] auth.external = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.207998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.208149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.208294 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] auth.password = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.208424 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.208556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] auth.token = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.208686 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.208817 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.208949 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] auth.password = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.209073 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.209154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] auth.token = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.209229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.209354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.209432 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.209505 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.209587 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.209662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.209734 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.209806 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.209885 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.209959 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.210042 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] credential.caching = True {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.210116 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.210189 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.210271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.210344 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.210417 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] credential.caching = True {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.210497 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.210570 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.210649 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.210773 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.210858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.210941 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.211016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.211095 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.211168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.211287 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.211365 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.211637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.211722 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.211797 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.211870 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.211941 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.212013 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.212167 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.212244 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.212318 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.212389 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.212461 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.212533 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.212613 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.212687 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.212760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.212833 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] federation.caching = True {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.212899 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.213019 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.213105 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.213180 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.213315 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] federation.caching = True {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.213396 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.213469 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.213541 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.213621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.213695 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.213768 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.213839 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.213910 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.213982 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.214062 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.214183 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.214261 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.214340 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.214414 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.214486 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.214566 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.214640 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.214712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.214784 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] identity.caching = True {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.214902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.214979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.215060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.215134 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.215202 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] identity.caching = True {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.215262 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.215322 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.215387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.215473 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.215539 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.215599 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.215657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.215716 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.215774 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.215845 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.215908 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.215967 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.216027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.216099 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.216172 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.216252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.216326 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.216398 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.216470 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.216542 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.216614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.216694 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.216767 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.216847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.216847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.217016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.217182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.217281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.217359 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.217438 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.217438 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.217570 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.217650 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.217730 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.217805 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.217877 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.217948 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.218020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.218145 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.218230 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.218377 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.218459 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.218617 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.218699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.218861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.218944 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.219104 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.219186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.219349 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.219429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.219647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.219730 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.219898 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.219969 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.220134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.220202 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.220370 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.220457 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.220641 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.220736 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.220866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.220947 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.221134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.221220 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.221388 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.221470 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.221622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.221703 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.221859 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.221942 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.222090 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.222170 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.222330 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.222459 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.222568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.222651 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.222809 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.222890 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.223046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.223129 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.223288 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.223491 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.223578 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.223700 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.223935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.224015 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.224171 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.224254 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.224408 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.224490 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.224659 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.224747 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.224899 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.224982 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.225137 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.225218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.225369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.user = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.225451 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.225643 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.225735 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.225879 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.user = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.225960 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.226125 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.226207 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.226389 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.226473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.226626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.226707 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.226873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.226954 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.227111 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.227194 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.227344 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.227424 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.227606 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.227688 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.227839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.227922 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.228075 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.228155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.228307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.228388 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.228544 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.228632 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.228781 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.228872 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.229024 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.229105 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.229274 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.229357 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.229523 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.229604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.229756 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.229837 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.230004 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.230087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.230234 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.230314 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.230470 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.230558 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.230708 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.230790 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.230984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.231066 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.231227 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.231317 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.231494 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.231581 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.231736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.231817 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.231984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.238546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.238546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.238737 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.238806 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.238890 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.238966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.239047 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.239122 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.239194 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.239266 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.239337 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.239415 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.239573 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.239654 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.239716 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.239775 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.239835 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.239895 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.239978 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.240053 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] resource.caching = True {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.240125 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.240197 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.240268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.240338 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.240418 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] resource.caching = True {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.240491 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.240562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.240633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.240699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.240770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.240849 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.240911 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.240970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.241035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.241106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.241177 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.241256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.241330 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.241402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.241473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] role.caching = True {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.241543 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.241609 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] role.driver = sql {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.241687 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.241761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.241832 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] role.caching = True {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.241832 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] role.driver = sql {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.241960 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.242032 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.242112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.242186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.242257 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.242328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.242400 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.242471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.242550 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.242624 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.242695 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.242755 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.242825 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.242897 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.242977 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.243050 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.243122 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.243193 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.243264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.243335 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.243414 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.243565 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.243628 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.243688 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.243758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.243829 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.243890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.243950 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.244009 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.244069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.244128 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.244195 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.244256 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.244315 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.244374 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.244432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.244491 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.244557 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.244618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.244677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.244736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.244795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.244855 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.244921 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.244983 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.245042 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.245100 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.245159 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.245217 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.245283 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.245350 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.245411 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.245470 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.245528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.245587 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.245658 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.245720 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.245779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.245837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.245896 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.245955 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.246021 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.246082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.246141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.246199 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] token.caching = True {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.246257 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.246315 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.246382 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] token.caching = True {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.246443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.246501 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.246560 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.246619 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.246678 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.246744 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.246805 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.246864 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.246923 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.246982 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.247041 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.247108 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.247169 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.247228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.247288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.247346 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.247459 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.247630 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.247715 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.247889 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.247982 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.248116 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.248199 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.248392 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.248474 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.248641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.248722 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.248904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.248994 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.249137 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.249230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.249383 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.249465 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] database.connection = **** {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.249648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.249729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.249897 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.249977 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] database.connection = **** {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.250136 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.250219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.250379 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.250460 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.250614 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.251206 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.251455 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.251542 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.251694 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.251776 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.251933 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.252015 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.252173 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.252258 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.252410 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.252753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.252922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.253003 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.253161 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.253244 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.253408 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.253489 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.253644 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.253724 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.253889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.253970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.254122 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.254203 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.254365 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.254447 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.254594 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.254675 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.254748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 20:04:52.254840 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.255077 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 20:04:52.255248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81847) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 20:04:52.287871 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.288187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.288305 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.288681 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.288919 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.289151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.296952 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.298436 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.326436 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.326695 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.327287 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.327546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.384342 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.384815 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.444156 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.444450 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.444612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.444612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.607327 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.607696 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.607839 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.608004 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.608195 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.608392 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.608532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.608818 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.609590 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.609590 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.609590 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.609590 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.638681 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.638912 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.639073 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.639216 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.639351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.639509 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.639638 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.639812 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.639942 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.640099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.640099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.640366 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.640366 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.640366 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.651067 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.651344 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.664481 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.664705 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.664843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.665000 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.665131 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.665259 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.665394 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.665537 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.665682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.665682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.665943 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.665943 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.666196 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81846) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.666329 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81847) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 20:04:52.682594 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.682802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 20:04:52.683148 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.683297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.683431 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 20:04:52.683627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 20:04:52.683755 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.683889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.684153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.684297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.684432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 20:04:52.684564 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.684695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.684882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.685148 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.685409 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.694623 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.694903 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.695180 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.695480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.698646 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.698646 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.698646 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.698646 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.702544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.703874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.705555 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.705844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.706130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.706416 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.706926 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.707027 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.707106 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.707180 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.707359 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.707516 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.707613 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.707692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.707767 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.707920 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.708046 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.708262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.708349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.708453 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.708785 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.709048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.709322 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.709593 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.731706 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.733198 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.733490 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.733609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.735088 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.735884 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.738784 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.739030 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.739411 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.740705 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.740989 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.741275 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.745754 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.746042 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.747765 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.748051 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.751929 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.752226 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.752780 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.753070 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.757435 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.757435 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.757435 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.757435 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.757918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.757918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.757918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.757918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.757918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.757918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.758508 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.758508 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.770091 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.770387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.772139 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.772433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.774311 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.776414 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.777586 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.777888 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.779725 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.785997 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.786100 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.786182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.786253 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.788669 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.789382 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.789685 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.789975 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.790263 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.790554 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.790838 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.791946 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.792249 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.792552 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.792828 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.793109 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.793439 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.807510 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.807807 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.808075 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.808343 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.810571 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.810874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.811148 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.811421 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.817947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.817947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.818616 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.818699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.818777 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.820208 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.821405 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.821691 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.821790 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.821982 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.822078 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.822270 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.822661 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.824755 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.825073 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.825396 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.825725 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.826151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.833995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.834287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.834568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.834853 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.835236 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.835542 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.835827 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.837689 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.837977 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.838259 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.838542 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.838930 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.839229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.839538 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.852002 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.854872 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.856098 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.857816 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.862240 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.862355 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.862355 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.862355 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.862355 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.862730 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.864192 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.865727 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.866006 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.866400 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.868544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.870021 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.872946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.873034 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.873344 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.873635 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.873917 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.874545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.877783 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.878184 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.878477 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.878762 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.882120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.882419 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.882704 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.887080 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.891151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.891151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.891313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81846) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.891313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.891313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.891313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.891313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.891313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.891313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.891858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.891858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.892111 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.892394 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.892665 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.892936 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.893257 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81846) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.894802 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81847) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 20:04:52.895093 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.895380 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.895693 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.895976 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.896263 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.896539 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.896843 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.897175 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.897454 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.897740 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.898013 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.898284 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.898558 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81847) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 20:04:52.930029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555eeab019c0 pid: 81846 (default app) Sep 06 20:04:52.932529 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be62f5-1e30-4ebc-bd21-1490d5dda9e2 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:04:52.935145 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be62f5-1e30-4ebc-bd21-1490d5dda9e2 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:04:52.935145 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be62f5-1e30-4ebc-bd21-1490d5dda9e2 None None] PATH_INFO: `/v3` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:04:52.935524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555eeab019c0 pid: 81847 (default app) Sep 06 20:04:52.937265 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1/1] 10.222.0.77 () {50 vars in 791 bytes} [Tue Sep 6 20:04:52 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:00.960895 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dddc7-40e7-4d63-be4e-8f4117c82709 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:00.961441 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dddc7-40e7-4d63-be4e-8f4117c82709 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:00.961441 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dddc7-40e7-4d63-be4e-8f4117c82709 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:00.966010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1/2] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:00.974644 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effa54a-7b83-4a2b-ba4e-0c2d40818801 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:00.975245 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effa54a-7b83-4a2b-ba4e-0c2d40818801 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:00.975245 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effa54a-7b83-4a2b-ba4e-0c2d40818801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:01.048048 dv-cinder-847732-4-smb devstack@keystone.service[81846]: INFO dbcounter [None req-1effa54a-7b83-4a2b-ba4e-0c2d40818801 None None] Registered counter for database keystone Sep 06 20:05:01.070252 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG oslo_db.sqlalchemy.engines [None req-1effa54a-7b83-4a2b-ba4e-0c2d40818801 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81846) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 20:05:01.076732 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writer thread running {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 20:05:01.264283 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG passlib.handlers.bcrypt [None req-1effa54a-7b83-4a2b-ba4e-0c2d40818801 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81846) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 06 20:05:01.264669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG passlib.handlers.bcrypt [None req-1effa54a-7b83-4a2b-ba4e-0c2d40818801 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81846) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 06 20:05:01.328178 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-1effa54a-7b83-4a2b-ba4e-0c2d40818801 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:01.329807 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-1effa54a-7b83-4a2b-ba4e-0c2d40818801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:01.465483 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 2/3] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 06 20:05:01.938919 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7dddc7-40e7-4d63-be4e-8f4117c82709 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:02.018000 dv-cinder-847732-4-smb devstack@keystone.service[81847]: INFO dbcounter [None req-1b7dddc7-40e7-4d63-be4e-8f4117c82709 None None] Registered counter for database keystone Sep 06 20:05:02.037994 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG oslo_db.sqlalchemy.engines [None req-1b7dddc7-40e7-4d63-be4e-8f4117c82709 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81847) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 20:05:02.044433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writer thread running {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 20:05:02.166447 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7dddc7-40e7-4d63-be4e-8f4117c82709 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:02.171046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08752354-0c10-4f52-84aa-3556d693e2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:02.171717 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08752354-0c10-4f52-84aa-3556d693e2df admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:02.172004 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08752354-0c10-4f52-84aa-3556d693e2df admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:02.172281 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08752354-0c10-4f52-84aa-3556d693e2df admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:02.181246 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08752354-0c10-4f52-84aa-3556d693e2df admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:02.234299 dv-cinder-847732-4-smb devstack@keystone.service[81847]: WARNING keystone.common.rbac_enforcer.enforcer [None req-08752354-0c10-4f52-84aa-3556d693e2df admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 06 20:05:02.234642 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08752354-0c10-4f52-84aa-3556d693e2df admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:02.245056 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 2/4] 10.222.0.77 () {58 vars in 1324 bytes} [Tue Sep 6 20:05:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 20:05:02.251239 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effa54a-7b83-4a2b-ba4e-0c2d40818801 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:02.266134 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effa54a-7b83-4a2b-ba4e-0c2d40818801 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:02.271076 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f4d3b-21a0-49de-a585-3f7cbc838ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:02.272240 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f4d3b-21a0-49de-a585-3f7cbc838ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:02.272523 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f4d3b-21a0-49de-a585-3f7cbc838ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:02.272789 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f4d3b-21a0-49de-a585-3f7cbc838ac0 admin admin] PATH_INFO: `/v3/projects/003d1519e9c64c4283d31426f50dd5d3` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:02.274387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f4d3b-21a0-49de-a585-3f7cbc838ac0 admin admin] RBAC: Authorizing `identity:get_project(project_id=003d1519e9c64c4283d31426f50dd5d3)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:02.327358 dv-cinder-847732-4-smb devstack@keystone.service[81846]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a57f4d3b-21a0-49de-a585-3f7cbc838ac0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 06 20:05:02.327727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f4d3b-21a0-49de-a585-3f7cbc838ac0 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:02.333132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 3/5] 10.222.0.77 () {56 vars in 1207 bytes} [Tue Sep 6 20:05:02 2022] GET /identity/v3/projects/003d1519e9c64c4283d31426f50dd5d3 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:04.480670 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d0df5-35aa-47ab-8179-1a55101ba1dc None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:04.481245 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d0df5-35aa-47ab-8179-1a55101ba1dc None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:04.481245 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d0df5-35aa-47ab-8179-1a55101ba1dc None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:04.485831 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 3/6] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:04.491530 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693704b-dbef-4e58-b25c-d9a913ff485b None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:04.491940 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693704b-dbef-4e58-b25c-d9a913ff485b None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:04.492082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693704b-dbef-4e58-b25c-d9a913ff485b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:04.512782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-c693704b-dbef-4e58-b25c-d9a913ff485b None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:04.514310 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-c693704b-dbef-4e58-b25c-d9a913ff485b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:04.522186 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 4/7] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 06 20:05:04.791991 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d0df5-35aa-47ab-8179-1a55101ba1dc None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:04.804896 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d0df5-35aa-47ab-8179-1a55101ba1dc None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:04.809173 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e576423-4c37-40d7-9eef-e34538ec60ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:04.810070 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e576423-4c37-40d7-9eef-e34538ec60ec admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:04.810358 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e576423-4c37-40d7-9eef-e34538ec60ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:04.810664 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e576423-4c37-40d7-9eef-e34538ec60ec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:04.820072 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e576423-4c37-40d7-9eef-e34538ec60ec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:04.821829 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e576423-4c37-40d7-9eef-e34538ec60ec admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:04.831191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 4/8] 10.222.0.77 () {58 vars in 1324 bytes} [Tue Sep 6 20:05:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 20:05:04.837115 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693704b-dbef-4e58-b25c-d9a913ff485b None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:04.847037 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693704b-dbef-4e58-b25c-d9a913ff485b None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:04.851366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bd019-3680-4faa-ac45-0f079b096f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:04.852019 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bd019-3680-4faa-ac45-0f079b096f58 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:04.852296 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bd019-3680-4faa-ac45-0f079b096f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:04.852566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bd019-3680-4faa-ac45-0f079b096f58 admin admin] PATH_INFO: `/v3/users/fb0b86a646b84622872ed6d032fae507` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:04.853870 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bd019-3680-4faa-ac45-0f079b096f58 admin admin] RBAC: Authorizing `identity:get_user(user_id=fb0b86a646b84622872ed6d032fae507)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:04.855748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bd019-3680-4faa-ac45-0f079b096f58 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:04.857324 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 5/9] 10.222.0.77 () {56 vars in 1198 bytes} [Tue Sep 6 20:05:04 2022] GET /identity/v3/users/fb0b86a646b84622872ed6d032fae507 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:07.140791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eed582-e798-4b54-b3e6-1e14c887673b None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:07.141926 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eed582-e798-4b54-b3e6-1e14c887673b None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:07.142061 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eed582-e798-4b54-b3e6-1e14c887673b None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:07.143474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 5/10] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:07.145747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107608ba-c091-4c25-8fd9-2c47f286c587 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:07.146164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107608ba-c091-4c25-8fd9-2c47f286c587 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:07.146382 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107608ba-c091-4c25-8fd9-2c47f286c587 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:07.147770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 6/11] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:05:07.149290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a50b72-2731-4420-8c10-ce5ba74f7db4 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:07.149584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a50b72-2731-4420-8c10-ce5ba74f7db4 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:07.149859 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a50b72-2731-4420-8c10-ce5ba74f7db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:07.152934 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df50e8a-5883-4c01-b7c9-9cf1bc56192f None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:07.153214 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df50e8a-5883-4c01-b7c9-9cf1bc56192f None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:07.153487 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df50e8a-5883-4c01-b7c9-9cf1bc56192f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:07.171531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-1df50e8a-5883-4c01-b7c9-9cf1bc56192f None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:07.172744 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-1df50e8a-5883-4c01-b7c9-9cf1bc56192f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:07.192546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG passlib.handlers.bcrypt [None req-85a50b72-2731-4420-8c10-ce5ba74f7db4 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81847) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 06 20:05:07.192939 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG passlib.handlers.bcrypt [None req-85a50b72-2731-4420-8c10-ce5ba74f7db4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81847) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 06 20:05:07.241893 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-85a50b72-2731-4420-8c10-ce5ba74f7db4 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:07.243578 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-85a50b72-2731-4420-8c10-ce5ba74f7db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:07.255307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 7/12] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 20:05:07.353854 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 6/13] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 20:05:07.525993 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df50e8a-5883-4c01-b7c9-9cf1bc56192f None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:07.553503 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:07.621393 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a50b72-2731-4420-8c10-ce5ba74f7db4 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:07.638812 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df50e8a-5883-4c01-b7c9-9cf1bc56192f None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:07.674936 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e7f6e-65be-49ee-92a5-1302c1a17799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:07.675591 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e7f6e-65be-49ee-92a5-1302c1a17799 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:07.675872 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e7f6e-65be-49ee-92a5-1302c1a17799 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:07.676143 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e7f6e-65be-49ee-92a5-1302c1a17799 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:07.734110 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a50b72-2731-4420-8c10-ce5ba74f7db4 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:07.737290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:07.749284 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e7f6e-65be-49ee-92a5-1302c1a17799 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:07.750459 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e7f6e-65be-49ee-92a5-1302c1a17799 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:07.774893 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c779e5-dc38-455d-94f2-0c498ffcff50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:07.775861 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c779e5-dc38-455d-94f2-0c498ffcff50 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:07.776198 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c779e5-dc38-455d-94f2-0c498ffcff50 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:07.776419 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c779e5-dc38-455d-94f2-0c498ffcff50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:07.778326 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:07.790275 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c779e5-dc38-455d-94f2-0c498ffcff50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:07.800786 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-d9c779e5-dc38-455d-94f2-0c498ffcff50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:05:07.800786 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:07.800786 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:07.800786 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:07.800786 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:07.800786 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:07.800786 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:07.800786 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:07.800786 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:07.800786 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:07.800786 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:07.800786 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:07.800786 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:07.800786 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:07.800786 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:07.800786 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:07.806064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:07.806064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:07.806064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:07.806064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:07.806064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:07.806064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:07.806064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:07.806064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:07.806064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:07.806064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:07.806064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:07.806064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:07.806064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:07.806064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:07.806064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:07.806064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:07.807104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:07.807104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:07.807104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:07.807104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:07.807104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:07.807104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:07.807104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:07.807104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:07.807104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:07.807104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:07.807104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:05:07.807104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:05:07.807104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 7/14] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:05:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:05:07.807975 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c779e5-dc38-455d-94f2-0c498ffcff50 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:07.866091 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 8/15] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:05:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:05:07.871757 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e7f6e-65be-49ee-92a5-1302c1a17799 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:07.917037 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c779e5-dc38-455d-94f2-0c498ffcff50 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:07.955345 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07186a91-c814-4ec3-a68e-d6efa733fa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:07.955988 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07186a91-c814-4ec3-a68e-d6efa733fa60 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:07.956274 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07186a91-c814-4ec3-a68e-d6efa733fa60 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:07.956552 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07186a91-c814-4ec3-a68e-d6efa733fa60 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:07.957257 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07186a91-c814-4ec3-a68e-d6efa733fa60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:07.957564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07186a91-c814-4ec3-a68e-d6efa733fa60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:07.959026 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07186a91-c814-4ec3-a68e-d6efa733fa60 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:07.972316 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 8/16] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:05:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:07.974912 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e7f6e-65be-49ee-92a5-1302c1a17799 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:07.978378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07186a91-c814-4ec3-a68e-d6efa733fa60 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:08.001097 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:08.007998 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:08.013146 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e2d2f-9a67-4305-8404-d32998c1beea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:08.013793 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e2d2f-9a67-4305-8404-d32998c1beea None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:08.014076 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e2d2f-9a67-4305-8404-d32998c1beea None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:08.014378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e2d2f-9a67-4305-8404-d32998c1beea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:08.026351 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e2d2f-9a67-4305-8404-d32998c1beea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:08.027761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e2d2f-9a67-4305-8404-d32998c1beea None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:08.048423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-191e2d2f-9a67-4305-8404-d32998c1beea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:05:08.048423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:08.048423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:08.048423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:08.048423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:08.048423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:08.048423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:08.048423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:08.048423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:08.048423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:08.048423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:08.048423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:08.048423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:05:08.048423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:05:08.048423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:05:08.048423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:05:08.052099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:08.052099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:08.052099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:08.052099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:08.052099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:08.052099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:08.052099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:08.052099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:08.052099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:08.052099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:08.052099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:08.052099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:08.052099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:08.052099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:08.052099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:08.052099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:08.052099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:05:08.052926 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:05:08.052926 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:05:08.052926 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:05:08.052926 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 9/17] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:05:08.055528 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e2d2f-9a67-4305-8404-d32998c1beea None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:08.087465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07186a91-c814-4ec3-a68e-d6efa733fa60 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:08.124739 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b0688-5fac-4029-b5c9-664485d82736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:08.125363 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b0688-5fac-4029-b5c9-664485d82736 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:08.125695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b0688-5fac-4029-b5c9-664485d82736 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:08.125970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b0688-5fac-4029-b5c9-664485d82736 None admin] PATH_INFO: `/v3/users/fb0b86a646b84622872ed6d032fae507` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:08.127871 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b0688-5fac-4029-b5c9-664485d82736 None admin] RBAC: Authorizing `identity:get_user(user_id=fb0b86a646b84622872ed6d032fae507)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:08.129354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b0688-5fac-4029-b5c9-664485d82736 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:08.130984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 9/18] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:07 2022] GET /identity/v3/users/fb0b86a646b84622872ed6d032fae507 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:08.136464 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b0688-5fac-4029-b5c9-664485d82736 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:08.162745 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e2d2f-9a67-4305-8404-d32998c1beea None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:08.196737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e274ed-7bdd-486d-8859-f9be216c4ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:08.197362 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e274ed-7bdd-486d-8859-f9be216c4ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:08.197637 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e274ed-7bdd-486d-8859-f9be216c4ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:08.197912 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e274ed-7bdd-486d-8859-f9be216c4ce3 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:08.198555 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e274ed-7bdd-486d-8859-f9be216c4ce3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:08.198859 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e274ed-7bdd-486d-8859-f9be216c4ce3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:08.200287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e274ed-7bdd-486d-8859-f9be216c4ce3 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:08.218556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 10/19] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:08.236806 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:08.244342 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b0688-5fac-4029-b5c9-664485d82736 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:08.303159 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72f3eb-6fa1-460f-8d6d-751b915a3350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:08.303159 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72f3eb-6fa1-460f-8d6d-751b915a3350 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:08.303159 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72f3eb-6fa1-460f-8d6d-751b915a3350 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:08.303159 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72f3eb-6fa1-460f-8d6d-751b915a3350 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:08.303870 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72f3eb-6fa1-460f-8d6d-751b915a3350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:08.303870 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72f3eb-6fa1-460f-8d6d-751b915a3350 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:08.303870 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 10/20] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:05:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:08.304208 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e274ed-7bdd-486d-8859-f9be216c4ce3 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:08.338591 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:08.414777 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e274ed-7bdd-486d-8859-f9be216c4ce3 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:08.451340 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64b02b-d275-4c94-85a6-24006e272e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:08.452026 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64b02b-d275-4c94-85a6-24006e272e98 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:08.452309 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64b02b-d275-4c94-85a6-24006e272e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:08.452581 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64b02b-d275-4c94-85a6-24006e272e98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:08.453305 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64b02b-d275-4c94-85a6-24006e272e98 None admin] RBAC: Adding query filter params (role.id=1e2ac44410664e6b8f42ab3c37e2643f, scope.domain.id=default, user.id=fb0b86a646b84622872ed6d032fae507) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:08.453638 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64b02b-d275-4c94-85a6-24006e272e98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:08.455689 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64b02b-d275-4c94-85a6-24006e272e98 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:08.462803 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 11/21] 10.222.0.77 () {56 vars in 1322 bytes} [Tue Sep 6 20:05:08 2022] GET /identity/v3/role_assignments?user.id=fb0b86a646b84622872ed6d032fae507&scope.domain.id=default&role.id=1e2ac44410664e6b8f42ab3c37e2643f => generated 233 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:10.779358 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a2709-0627-4136-bd4a-1b676e198fe7 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:10.780388 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a2709-0627-4136-bd4a-1b676e198fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:10.780897 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a2709-0627-4136-bd4a-1b676e198fe7 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:10.782797 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 11/22] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:10.788214 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35bc06-9e85-435f-b12e-09c6fb8772f7 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:10.789093 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35bc06-9e85-435f-b12e-09c6fb8772f7 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:10.789585 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35bc06-9e85-435f-b12e-09c6fb8772f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:10.816206 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-ca35bc06-9e85-435f-b12e-09c6fb8772f7 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:10.822526 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ca35bc06-9e85-435f-b12e-09c6fb8772f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:10.910973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 12/23] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:11.089816 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dfdac-57cb-4544-b7ef-fa776c5fe94b None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:11.090174 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dfdac-57cb-4544-b7ef-fa776c5fe94b None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:11.090372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dfdac-57cb-4544-b7ef-fa776c5fe94b None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:11.092078 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 12/24] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:11.097661 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c6b48-35e8-437c-bcda-ec132cf21ee6 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:11.097956 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c6b48-35e8-437c-bcda-ec132cf21ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:11.098241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c6b48-35e8-437c-bcda-ec132cf21ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:11.123337 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-e55c6b48-35e8-437c-bcda-ec132cf21ee6 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:11.124598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-e55c6b48-35e8-437c-bcda-ec132cf21ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:11.157993 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:11.221356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 13/25] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:11.372830 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886dfdac-57cb-4544-b7ef-fa776c5fe94b None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:11.513973 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886dfdac-57cb-4544-b7ef-fa776c5fe94b None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:11.551388 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4feca0-858c-4d74-b9f2-c557ff621a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:11.552068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4feca0-858c-4d74-b9f2-c557ff621a71 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:11.552351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4feca0-858c-4d74-b9f2-c557ff621a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:11.552627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4feca0-858c-4d74-b9f2-c557ff621a71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:11.572455 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4feca0-858c-4d74-b9f2-c557ff621a71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:11.574000 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4feca0-858c-4d74-b9f2-c557ff621a71 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:11.592387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bb1ec-238a-445b-bcd7-a0e69c785b86 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:11.592697 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bb1ec-238a-445b-bcd7-a0e69c785b86 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:11.592949 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bb1ec-238a-445b-bcd7-a0e69c785b86 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:11.594834 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 14/26] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:05:11.600270 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece56e9-5c44-4ce2-8054-5b39dc49487f None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:11.600547 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece56e9-5c44-4ce2-8054-5b39dc49487f None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:11.600825 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece56e9-5c44-4ce2-8054-5b39dc49487f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:11.605820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-3d4feca0-858c-4d74-b9f2-c557ff621a71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:05:11.605820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:11.605820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:11.605820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:11.605820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:11.605820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:11.605820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:11.605820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:11.605820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:11.605820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:11.605820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:11.605820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:11.605820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:05:11.605820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:05:11.605820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:05:11.605820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:05:11.606667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:11.606667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:11.606667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:11.606667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:11.606667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:11.606667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:11.606667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:11.606667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:11.606667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:11.606667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:11.606667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:11.606667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:11.606667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:11.606667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:11.606667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:11.606667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:11.606667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:05:11.607471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:05:11.607471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:05:11.607471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:05:11.607471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 13/27] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:05:11.616348 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4feca0-858c-4d74-b9f2-c557ff621a71 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:11.630854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-1ece56e9-5c44-4ce2-8054-5b39dc49487f None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:11.635070 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-1ece56e9-5c44-4ce2-8054-5b39dc49487f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:11.651826 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:11.773112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 15/28] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 20:05:11.773966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece56e9-5c44-4ce2-8054-5b39dc49487f None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:11.824080 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4feca0-858c-4d74-b9f2-c557ff621a71 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:11.900848 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46084e7f-b1ec-477e-b2ae-edf3e8a51e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:11.901389 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46084e7f-b1ec-477e-b2ae-edf3e8a51e9b None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:11.901661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46084e7f-b1ec-477e-b2ae-edf3e8a51e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:11.901932 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46084e7f-b1ec-477e-b2ae-edf3e8a51e9b None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:11.902594 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46084e7f-b1ec-477e-b2ae-edf3e8a51e9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:11.902898 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46084e7f-b1ec-477e-b2ae-edf3e8a51e9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:11.904346 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46084e7f-b1ec-477e-b2ae-edf3e8a51e9b None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:11.933121 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 14/29] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:11.934416 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27ac3c-c0ae-47e8-9d4b-e788456bbb8d None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:11.934698 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27ac3c-c0ae-47e8-9d4b-e788456bbb8d None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:11.934965 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27ac3c-c0ae-47e8-9d4b-e788456bbb8d None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:11.944396 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 15/30] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:11 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:11.945279 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27ac3c-c0ae-47e8-9d4b-e788456bbb8d None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:11.946098 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:11.968508 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece56e9-5c44-4ce2-8054-5b39dc49487f None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:12.043367 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf13b0e-702c-4e22-aeee-6b9e67048bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:12.044068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf13b0e-702c-4e22-aeee-6b9e67048bd6 None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:12.044401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf13b0e-702c-4e22-aeee-6b9e67048bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:12.044731 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf13b0e-702c-4e22-aeee-6b9e67048bd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:12.045539 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf13b0e-702c-4e22-aeee-6b9e67048bd6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:12.046945 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf13b0e-702c-4e22-aeee-6b9e67048bd6 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:12.087801 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:12.137103 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27ac3c-c0ae-47e8-9d4b-e788456bbb8d None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:12.204831 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dee762-67fb-4cf7-840e-1341177c11bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:12.206400 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dee762-67fb-4cf7-840e-1341177c11bf None admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:12.207258 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dee762-67fb-4cf7-840e-1341177c11bf None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:12.208228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dee762-67fb-4cf7-840e-1341177c11bf None admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:12.209788 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dee762-67fb-4cf7-840e-1341177c11bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:12.213345 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dee762-67fb-4cf7-840e-1341177c11bf None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:12.346521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 16/31] 10.222.0.77 () {60 vars in 1131 bytes} [Tue Sep 6 20:05:11 2022] POST /identity/v3/roles => generated 219 bytes in 573 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:05:12.349480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d354e7-82f4-4fb4-af06-4c5b8880e3ec None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:12.350262 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d354e7-82f4-4fb4-af06-4c5b8880e3ec None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:12.351018 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d354e7-82f4-4fb4-af06-4c5b8880e3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:12.397831 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-e0d354e7-82f4-4fb4-af06-4c5b8880e3ec None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:12.400127 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-e0d354e7-82f4-4fb4-af06-4c5b8880e3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:12.519463 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 17/32] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:12.523680 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d354e7-82f4-4fb4-af06-4c5b8880e3ec None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:12.563970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 16/33] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Sep 6 20:05:11 2022] POST /identity/v3/projects => generated 301 bytes in 619 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:05:12.565946 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b03a7-2ebf-4cd2-9a0e-0ed134b5224d None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:12.566531 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b03a7-2ebf-4cd2-9a0e-0ed134b5224d None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:12.567003 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b03a7-2ebf-4cd2-9a0e-0ed134b5224d None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:12.568561 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 17/34] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:12.582822 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4ad64-9e63-4522-8de9-0018e5fc32d0 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:12.583496 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4ad64-9e63-4522-8de9-0018e5fc32d0 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:12.583999 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4ad64-9e63-4522-8de9-0018e5fc32d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:12.616477 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-62f4ad64-9e63-4522-8de9-0018e5fc32d0 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:12.618870 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-62f4ad64-9e63-4522-8de9-0018e5fc32d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:12.720479 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:12.753914 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d354e7-82f4-4fb4-af06-4c5b8880e3ec None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:12.778168 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 18/35] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 06 20:05:12.779418 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1e797-8d03-4888-b26e-b1e04f765230 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:12.780967 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1e797-8d03-4888-b26e-b1e04f765230 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:12.781253 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1e797-8d03-4888-b26e-b1e04f765230 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:12.783241 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 19/36] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:12.789244 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb931ea9-793b-4afb-9b92-f0f354cd7a40 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:12.791030 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb931ea9-793b-4afb-9b92-f0f354cd7a40 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:12.791030 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb931ea9-793b-4afb-9b92-f0f354cd7a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:12.808931 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed327e-b3a0-4870-bf3c-d53ab5e748ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:12.809600 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed327e-b3a0-4870-bf3c-d53ab5e748ac None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:12.809943 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed327e-b3a0-4870-bf3c-d53ab5e748ac None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:12.810279 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed327e-b3a0-4870-bf3c-d53ab5e748ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:12.810872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-fb931ea9-793b-4afb-9b92-f0f354cd7a40 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:12.812148 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-fb931ea9-793b-4afb-9b92-f0f354cd7a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:12.828108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed327e-b3a0-4870-bf3c-d53ab5e748ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:12.839142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-f5ed327e-b3a0-4870-bf3c-d53ab5e748ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:05:12.839142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:12.839142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:12.839142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:12.839142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:12.839142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:12.839142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:12.839142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:12.839142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:12.839142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:12.839142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:12.839142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:12.839142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:12.839142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:12.839142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:12.839142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:12.840241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:12.840241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:12.840241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:12.840241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:12.840241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:12.840241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:12.840241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:12.840241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:12.840241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:12.840241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:12.840241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:12.840241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:12.840241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:12.840241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:12.840241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:12.840241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:12.841071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:12.841071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:12.841071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:12.841071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:12.841071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:12.841071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:12.841071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:12.841071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:12.841071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:12.841071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:12.841071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:05:12.841071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:05:12.844079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 18/37] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:05:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:05:12.852056 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed327e-b3a0-4870-bf3c-d53ab5e748ac None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:12.892921 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:12.911670 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 20/38] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:12.942220 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb931ea9-793b-4afb-9b92-f0f354cd7a40 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:13.086399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb931ea9-793b-4afb-9b92-f0f354cd7a40 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:13.104003 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed327e-b3a0-4870-bf3c-d53ab5e748ac None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:13.132271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65dc81-474b-4a60-bbc4-18758ddfd9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:13.132899 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65dc81-474b-4a60-bbc4-18758ddfd9b2 None admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:13.133200 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65dc81-474b-4a60-bbc4-18758ddfd9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:13.133474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65dc81-474b-4a60-bbc4-18758ddfd9b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:13.134990 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65dc81-474b-4a60-bbc4-18758ddfd9b2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:13.136731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65dc81-474b-4a60-bbc4-18758ddfd9b2 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:13.149767 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82835591-eb00-4366-87ce-ef80c1e08766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:13.150375 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82835591-eb00-4366-87ce-ef80c1e08766 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:13.150651 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82835591-eb00-4366-87ce-ef80c1e08766 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:13.157368 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82835591-eb00-4366-87ce-ef80c1e08766 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:13.157368 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82835591-eb00-4366-87ce-ef80c1e08766 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:13.157368 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82835591-eb00-4366-87ce-ef80c1e08766 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:13.157368 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82835591-eb00-4366-87ce-ef80c1e08766 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:13.162245 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:13.166328 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 19/39] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:05:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:13.167119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82835591-eb00-4366-87ce-ef80c1e08766 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:13.235973 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 21/40] 10.222.0.77 () {60 vars in 1131 bytes} [Tue Sep 6 20:05:12 2022] POST /identity/v3/roles => generated 225 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:05:13.236901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65dc81-474b-4a60-bbc4-18758ddfd9b2 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:13.276195 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82835591-eb00-4366-87ce-ef80c1e08766 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:13.303408 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:13.326702 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80280d68-3a10-459f-a817-1fade548b302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:13.327750 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80280d68-3a10-459f-a817-1fade548b302 None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:13.328189 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80280d68-3a10-459f-a817-1fade548b302 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:13.328752 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80280d68-3a10-459f-a817-1fade548b302 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:13.329687 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80280d68-3a10-459f-a817-1fade548b302 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:13.331325 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80280d68-3a10-459f-a817-1fade548b302 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:13.379545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65dc81-474b-4a60-bbc4-18758ddfd9b2 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:13.419710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 20/41] 10.222.0.77 () {60 vars in 1131 bytes} [Tue Sep 6 20:05:13 2022] POST /identity/v3/roles => generated 223 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:05:13.419710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80280d68-3a10-459f-a817-1fade548b302 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:13.431168 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b075ec-e15a-4a52-a9ba-dd4c23e991c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:13.431888 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b075ec-e15a-4a52-a9ba-dd4c23e991c0 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:13.432179 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b075ec-e15a-4a52-a9ba-dd4c23e991c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:13.432460 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b075ec-e15a-4a52-a9ba-dd4c23e991c0 None admin] PATH_INFO: `/v3/users/fb0b86a646b84622872ed6d032fae507` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:13.434173 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b075ec-e15a-4a52-a9ba-dd4c23e991c0 None admin] RBAC: Authorizing `identity:get_user(user_id=fb0b86a646b84622872ed6d032fae507)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:13.435424 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b075ec-e15a-4a52-a9ba-dd4c23e991c0 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:13.438086 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 22/42] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:13 2022] GET /identity/v3/users/fb0b86a646b84622872ed6d032fae507 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:13.447417 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b075ec-e15a-4a52-a9ba-dd4c23e991c0 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:13.536631 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:13.596555 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80280d68-3a10-459f-a817-1fade548b302 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:13.614126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b075ec-e15a-4a52-a9ba-dd4c23e991c0 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:13.636992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:13.641840 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b78d5f-119d-43eb-ba45-9dbac5fa5dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:13.642592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b78d5f-119d-43eb-ba45-9dbac5fa5dfd None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:13.642884 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b78d5f-119d-43eb-ba45-9dbac5fa5dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:13.643166 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b78d5f-119d-43eb-ba45-9dbac5fa5dfd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:13.644439 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b78d5f-119d-43eb-ba45-9dbac5fa5dfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:13.650638 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b78d5f-119d-43eb-ba45-9dbac5fa5dfd None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:13.650638 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 21/43] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:05:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:13.653683 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b78d5f-119d-43eb-ba45-9dbac5fa5dfd None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:13.666510 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921ba5d-90fe-45ab-aec4-650d2d9cdff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:13.666510 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921ba5d-90fe-45ab-aec4-650d2d9cdff6 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:13.666510 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921ba5d-90fe-45ab-aec4-650d2d9cdff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:13.666870 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921ba5d-90fe-45ab-aec4-650d2d9cdff6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:13.668196 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921ba5d-90fe-45ab-aec4-650d2d9cdff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:13.670715 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921ba5d-90fe-45ab-aec4-650d2d9cdff6 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:13.671431 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 23/44] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:05:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:13.677630 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921ba5d-90fe-45ab-aec4-650d2d9cdff6 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:13.763516 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b78d5f-119d-43eb-ba45-9dbac5fa5dfd None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:13.783490 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921ba5d-90fe-45ab-aec4-650d2d9cdff6 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:13.802218 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:13.814297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac83de9-cdbf-4746-b907-0c5f47a16c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:13.822377 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac83de9-cdbf-4746-b907-0c5f47a16c58 None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:13.822377 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac83de9-cdbf-4746-b907-0c5f47a16c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:13.822377 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac83de9-cdbf-4746-b907-0c5f47a16c58 None admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:13.822377 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac83de9-cdbf-4746-b907-0c5f47a16c58 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:13.822377 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac83de9-cdbf-4746-b907-0c5f47a16c58 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:13.835214 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c427625-0662-47a7-97c4-d484ebf3a2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:13.835980 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c427625-0662-47a7-97c4-d484ebf3a2cb None admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:13.836264 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c427625-0662-47a7-97c4-d484ebf3a2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:13.836544 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c427625-0662-47a7-97c4-d484ebf3a2cb None admin] PATH_INFO: `/v3/domains/default/users/fb0b86a646b84622872ed6d032fae507/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:13.838596 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c427625-0662-47a7-97c4-d484ebf3a2cb None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=fb0b86a646b84622872ed6d032fae507, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:13.840165 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c427625-0662-47a7-97c4-d484ebf3a2cb None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:13.956142 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 24/45] 10.222.0.77 () {58 vars in 1361 bytes} [Tue Sep 6 20:05:13 2022] PUT /identity/v3/domains/default/users/fb0b86a646b84622872ed6d032fae507/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:05:13.987477 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 22/46] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Sep 6 20:05:13 2022] POST /identity/v3/projects => generated 312 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:05:16.167229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ebbfd-971c-4cbd-975e-8bacaf2fca95 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:16.167753 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ebbfd-971c-4cbd-975e-8bacaf2fca95 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:16.167753 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ebbfd-971c-4cbd-975e-8bacaf2fca95 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:16.169058 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 25/47] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:16.174401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e7a09-f51a-4921-a5e7-d1f830a438ae None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:16.174849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e7a09-f51a-4921-a5e7-d1f830a438ae None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:16.175101 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e7a09-f51a-4921-a5e7-d1f830a438ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:16.189838 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1846be-3c31-46a8-ab31-8fe3c1917929 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:16.190128 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1846be-3c31-46a8-ab31-8fe3c1917929 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:16.190491 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1846be-3c31-46a8-ab31-8fe3c1917929 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:16.191870 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 26/48] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:05:16.194906 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-0c1e7a09-f51a-4921-a5e7-d1f830a438ae None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:16.196487 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-0c1e7a09-f51a-4921-a5e7-d1f830a438ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:16.197226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef5a34-7943-464f-98d4-f929ed77350a None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:16.197520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef5a34-7943-464f-98d4-f929ed77350a None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:16.197805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef5a34-7943-464f-98d4-f929ed77350a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:16.216312 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-08ef5a34-7943-464f-98d4-f929ed77350a None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:16.217537 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-08ef5a34-7943-464f-98d4-f929ed77350a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:16.255220 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:16.266936 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 23/49] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:16.288423 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 27/50] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 20:05:16.532090 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e7a09-f51a-4921-a5e7-d1f830a438ae None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:16.556256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef5a34-7943-464f-98d4-f929ed77350a None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:16.640179 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e7a09-f51a-4921-a5e7-d1f830a438ae None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:16.651322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:16.670435 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef5a34-7943-464f-98d4-f929ed77350a None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:16.676389 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec702616-958e-4591-a877-6e38dc0be15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:16.677037 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec702616-958e-4591-a877-6e38dc0be15a None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:16.677316 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec702616-958e-4591-a877-6e38dc0be15a None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:16.677588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec702616-958e-4591-a877-6e38dc0be15a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:16.689769 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec702616-958e-4591-a877-6e38dc0be15a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:16.694889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-ec702616-958e-4591-a877-6e38dc0be15a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:05:16.694889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:16.694889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:16.694889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:16.694889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:16.694889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:16.694889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:16.694889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:16.694889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:16.694889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:16.694889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:16.694889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:16.694889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:16.694889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:16.694889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:16.694889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:16.695770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:16.695770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:16.695770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:16.695770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:16.695770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:16.695770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:16.695770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:16.695770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:16.695770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:16.695770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:16.695770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:16.695770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:16.695770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:16.695770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:16.695770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:16.695770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:16.696515 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:16.696515 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:16.696515 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:16.696515 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:16.696515 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:16.696515 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:16.696515 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:16.696515 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:16.696515 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:16.696515 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:16.696515 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:05:16.696515 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:05:16.696515 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 24/51] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:05:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:05:16.702623 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec702616-958e-4591-a877-6e38dc0be15a None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:16.708328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6bd2e-1360-47ad-80d2-e3a23d528989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:16.709043 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6bd2e-1360-47ad-80d2-e3a23d528989 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:16.709331 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6bd2e-1360-47ad-80d2-e3a23d528989 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:16.709611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6bd2e-1360-47ad-80d2-e3a23d528989 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:16.710748 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6bd2e-1360-47ad-80d2-e3a23d528989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:16.712340 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6bd2e-1360-47ad-80d2-e3a23d528989 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:16.713937 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 28/52] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:05:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:16.720088 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6bd2e-1360-47ad-80d2-e3a23d528989 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:16.762701 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:16.808389 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec702616-958e-4591-a877-6e38dc0be15a None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:16.820836 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6bd2e-1360-47ad-80d2-e3a23d528989 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:16.843203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363bad7d-9b5d-48bc-b637-dc48681f4a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:16.843998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bad7d-9b5d-48bc-b637-dc48681f4a66 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:16.844896 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bad7d-9b5d-48bc-b637-dc48681f4a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:16.845310 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bad7d-9b5d-48bc-b637-dc48681f4a66 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:16.846204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363bad7d-9b5d-48bc-b637-dc48681f4a66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:16.846630 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363bad7d-9b5d-48bc-b637-dc48681f4a66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:16.848442 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363bad7d-9b5d-48bc-b637-dc48681f4a66 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:16.857125 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 25/53] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:05:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:16.859788 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872a790-5b71-4d5f-965d-1e7ee57053a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:16.861112 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872a790-5b71-4d5f-965d-1e7ee57053a4 None admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:16.861399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872a790-5b71-4d5f-965d-1e7ee57053a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:16.861694 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872a790-5b71-4d5f-965d-1e7ee57053a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:16.862362 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872a790-5b71-4d5f-965d-1e7ee57053a4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:16.863519 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363bad7d-9b5d-48bc-b637-dc48681f4a66 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:16.863926 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872a790-5b71-4d5f-965d-1e7ee57053a4 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:16.899174 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:16.967224 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363bad7d-9b5d-48bc-b637-dc48681f4a66 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:16.979897 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 29/54] 10.222.0.77 () {60 vars in 1140 bytes} [Tue Sep 6 20:05:16 2022] POST /identity/v3/projects => generated 298 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:05:17.005347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84011f-3b05-44d6-8eaa-2f2f316d6792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:17.006020 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84011f-3b05-44d6-8eaa-2f2f316d6792 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:17.006291 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84011f-3b05-44d6-8eaa-2f2f316d6792 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:17.006563 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84011f-3b05-44d6-8eaa-2f2f316d6792 None admin] PATH_INFO: `/v3/users/fb0b86a646b84622872ed6d032fae507` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:17.007883 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84011f-3b05-44d6-8eaa-2f2f316d6792 None admin] RBAC: Authorizing `identity:get_user(user_id=fb0b86a646b84622872ed6d032fae507)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:17.009409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84011f-3b05-44d6-8eaa-2f2f316d6792 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:17.011137 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 26/55] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:16 2022] GET /identity/v3/users/fb0b86a646b84622872ed6d032fae507 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:17.017655 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872a790-5b71-4d5f-965d-1e7ee57053a4 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:17.229175 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:17.240522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872a790-5b71-4d5f-965d-1e7ee57053a4 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:17.277787 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a21db7-f08b-45f2-80d2-456468e11eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:17.278432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a21db7-f08b-45f2-80d2-456468e11eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:17.278712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a21db7-f08b-45f2-80d2-456468e11eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:17.278987 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a21db7-f08b-45f2-80d2-456468e11eb3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:17.280136 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a21db7-f08b-45f2-80d2-456468e11eb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:17.281595 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a21db7-f08b-45f2-80d2-456468e11eb3 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:17.283954 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 30/56] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:05:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:17.289746 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84011f-3b05-44d6-8eaa-2f2f316d6792 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:17.400823 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:17.404108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84011f-3b05-44d6-8eaa-2f2f316d6792 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:17.443025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cf2a3-be64-46f2-9c39-bcadb86bc1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:17.443676 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cf2a3-be64-46f2-9c39-bcadb86bc1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:17.443956 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cf2a3-be64-46f2-9c39-bcadb86bc1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:17.444233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cf2a3-be64-46f2-9c39-bcadb86bc1d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:17.444959 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cf2a3-be64-46f2-9c39-bcadb86bc1d3 None admin] RBAC: Adding query filter params (role.id=1e2ac44410664e6b8f42ab3c37e2643f, scope.domain.id=default, user.id=fb0b86a646b84622872ed6d032fae507) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:17.445276 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cf2a3-be64-46f2-9c39-bcadb86bc1d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:17.446836 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cf2a3-be64-46f2-9c39-bcadb86bc1d3 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:17.455713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 27/57] 10.222.0.77 () {56 vars in 1322 bytes} [Tue Sep 6 20:05:17 2022] GET /identity/v3/role_assignments?user.id=fb0b86a646b84622872ed6d032fae507&scope.domain.id=default&role.id=1e2ac44410664e6b8f42ab3c37e2643f => generated 530 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:19.222257 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da92b40-bb3f-4470-9a5b-0fa2cce32c83 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:19.222970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da92b40-bb3f-4470-9a5b-0fa2cce32c83 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:19.222970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da92b40-bb3f-4470-9a5b-0fa2cce32c83 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:19.224128 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 31/58] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:19.229921 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3055b-c908-4f5a-9c33-30d5441cd969 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:19.230377 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3055b-c908-4f5a-9c33-30d5441cd969 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:19.230485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3055b-c908-4f5a-9c33-30d5441cd969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:19.249534 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-afe3055b-c908-4f5a-9c33-30d5441cd969 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:19.250784 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-afe3055b-c908-4f5a-9c33-30d5441cd969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:19.321590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 28/59] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:19.591138 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da92b40-bb3f-4470-9a5b-0fa2cce32c83 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:19.693464 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da92b40-bb3f-4470-9a5b-0fa2cce32c83 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:19.727882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf183e5-6881-41a4-8a7d-ffbc13c128de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:19.728517 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf183e5-6881-41a4-8a7d-ffbc13c128de None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:19.728799 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf183e5-6881-41a4-8a7d-ffbc13c128de None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:19.729078 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf183e5-6881-41a4-8a7d-ffbc13c128de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:19.730216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf183e5-6881-41a4-8a7d-ffbc13c128de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:19.731700 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf183e5-6881-41a4-8a7d-ffbc13c128de None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:19.733283 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 32/60] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:05:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:19.739669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3055b-c908-4f5a-9c33-30d5441cd969 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:19.832677 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:19.839305 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3055b-c908-4f5a-9c33-30d5441cd969 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:19.878380 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f38dd2-cd26-45f0-bb4d-6d829f019a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:19.879362 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f38dd2-cd26-45f0-bb4d-6d829f019a1e None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:19.879900 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f38dd2-cd26-45f0-bb4d-6d829f019a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:19.880393 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f38dd2-cd26-45f0-bb4d-6d829f019a1e None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:19.881607 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f38dd2-cd26-45f0-bb4d-6d829f019a1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:19.884089 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f38dd2-cd26-45f0-bb4d-6d829f019a1e None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:19.981671 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 29/61] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Sep 6 20:05:19 2022] POST /identity/v3/users => generated 275 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:05:23.320076 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ba633-9f9a-4349-acb1-6dd57ea245ed None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:23.321099 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ba633-9f9a-4349-acb1-6dd57ea245ed None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:23.321605 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ba633-9f9a-4349-acb1-6dd57ea245ed None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:23.323603 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 33/62] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:23.341765 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a7185-1e14-44a0-a473-77141694693d None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:23.342672 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a7185-1e14-44a0-a473-77141694693d None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:23.343133 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a7185-1e14-44a0-a473-77141694693d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:23.368670 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-484a7185-1e14-44a0-a473-77141694693d None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:23.369918 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-484a7185-1e14-44a0-a473-77141694693d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:23.468296 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 30/63] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:23.469621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602f4f8-1dbf-4179-8553-55aaeab0e2e0 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:23.470156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602f4f8-1dbf-4179-8553-55aaeab0e2e0 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:23.470652 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602f4f8-1dbf-4179-8553-55aaeab0e2e0 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:23.472205 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 34/64] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:23.477855 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99155a-481a-48d8-bde1-c98208c387ee None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:23.478151 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99155a-481a-48d8-bde1-c98208c387ee None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:23.478434 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99155a-481a-48d8-bde1-c98208c387ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:23.501657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-5e99155a-481a-48d8-bde1-c98208c387ee None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:23.503180 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-5e99155a-481a-48d8-bde1-c98208c387ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:23.614858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 31/65] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:23.652388 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064167d-5ad8-4101-9484-44c8dcd2e73e None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:23.653021 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064167d-5ad8-4101-9484-44c8dcd2e73e None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:23.653509 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064167d-5ad8-4101-9484-44c8dcd2e73e None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:23.655595 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 35/66] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:23.661671 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad28bc3-397b-46df-89ec-f68dca49a200 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:23.661969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad28bc3-397b-46df-89ec-f68dca49a200 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:23.662253 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad28bc3-397b-46df-89ec-f68dca49a200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:23.689977 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-7ad28bc3-397b-46df-89ec-f68dca49a200 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:23.691193 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-7ad28bc3-397b-46df-89ec-f68dca49a200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:23.696795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:23.790876 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 32/67] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:23.792180 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064167d-5ad8-4101-9484-44c8dcd2e73e None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:23.854661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:23.926696 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad28bc3-397b-46df-89ec-f68dca49a200 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:23.965620 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064167d-5ad8-4101-9484-44c8dcd2e73e None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:24.034010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205d57e-0ab8-4e4f-8327-9a911462cf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:24.034667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205d57e-0ab8-4e4f-8327-9a911462cf71 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:24.034954 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205d57e-0ab8-4e4f-8327-9a911462cf71 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:24.035231 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205d57e-0ab8-4e4f-8327-9a911462cf71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:24.057438 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205d57e-0ab8-4e4f-8327-9a911462cf71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:24.062554 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-5205d57e-0ab8-4e4f-8327-9a911462cf71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:05:24.062554 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:24.062554 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:24.062554 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:24.062554 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:24.062554 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:24.062554 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:24.062554 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:24.062554 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:24.062554 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:24.062554 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:24.062554 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:24.062554 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:24.062554 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:24.062554 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:24.062554 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:24.064087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:24.064087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:24.064087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:24.064087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:24.064087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:24.064087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:24.064087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:24.064087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:24.064087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:24.064087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:24.064087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:24.064087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:24.064087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:24.064087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:24.064087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:24.064087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:24.065300 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:24.065300 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:24.065300 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:24.065300 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:24.065300 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:24.065300 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:24.065300 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:24.065300 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:24.065300 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:24.065300 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:24.065300 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:05:24.065300 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:05:24.065300 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 36/68] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:05:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:05:24.071988 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205d57e-0ab8-4e4f-8327-9a911462cf71 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:24.126281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad28bc3-397b-46df-89ec-f68dca49a200 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:24.167219 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367768f-b688-4e8e-8050-fa2f0a62c776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:24.168025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367768f-b688-4e8e-8050-fa2f0a62c776 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:24.168312 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367768f-b688-4e8e-8050-fa2f0a62c776 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:24.168582 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367768f-b688-4e8e-8050-fa2f0a62c776 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:24.182283 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5367768f-b688-4e8e-8050-fa2f0a62c776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:24.187264 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:24.188566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-5367768f-b688-4e8e-8050-fa2f0a62c776 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 20:05:24.188566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:24.188566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:24.188566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:24.188566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:24.188566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:24.188566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:24.188566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:24.188566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:24.188566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:24.188566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:24.188566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:24.188566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:24.188566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:24.188566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:24.188566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:24.189669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:24.189669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:24.189669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:24.189669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:24.189669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:24.189669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:24.189669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:24.189669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:24.189669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:24.189669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:24.189669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:24.189669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:24.189669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:24.189669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:24.189669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:24.189669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:24.190426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:24.190426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:24.190426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:24.190426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:24.190426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:24.190426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:24.190426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:24.190426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:24.190426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:24.190426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:24.190426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 20:05:24.190426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:05:24.192946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 33/69] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Sep 6 20:05:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:05:24.193117 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:24.194894 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367768f-b688-4e8e-8050-fa2f0a62c776 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:24.206802 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205d57e-0ab8-4e4f-8327-9a911462cf71 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:24.245963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f890136-3b41-4889-b836-4df51d8a9c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:24.246588 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f890136-3b41-4889-b836-4df51d8a9c40 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:24.246877 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f890136-3b41-4889-b836-4df51d8a9c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:24.247154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f890136-3b41-4889-b836-4df51d8a9c40 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:24.247868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f890136-3b41-4889-b836-4df51d8a9c40 None admin] RBAC: Adding query filter params (name=member) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:24.248177 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f890136-3b41-4889-b836-4df51d8a9c40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:24.249597 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f890136-3b41-4889-b836-4df51d8a9c40 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:24.259462 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 37/70] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:05:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:24.260060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f890136-3b41-4889-b836-4df51d8a9c40 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:24.324764 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367768f-b688-4e8e-8050-fa2f0a62c776 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:24.361819 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1fcb34-d900-4603-a968-88c11d3f6f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:24.362468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fcb34-d900-4603-a968-88c11d3f6f55 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:24.362784 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fcb34-d900-4603-a968-88c11d3f6f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:24.363027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fcb34-d900-4603-a968-88c11d3f6f55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:24.369502 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f890136-3b41-4889-b836-4df51d8a9c40 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:24.375169 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1fcb34-d900-4603-a968-88c11d3f6f55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:24.380521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-fa1fcb34-d900-4603-a968-88c11d3f6f55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:05:24.380521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:24.380521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:24.380521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:24.380521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:24.380521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:24.380521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:24.380521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:24.380521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:24.380521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:24.380521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:24.380521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:24.380521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:24.380521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:24.380521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:24.380521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:24.381495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:24.381495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:24.381495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:24.381495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:24.381495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:24.381495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:24.381495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:24.381495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:24.381495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:24.381495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:24.381495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:24.381495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:24.381495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:24.381495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:24.381495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:24.381495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:24.383045 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:24.383045 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:24.383045 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:24.383045 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:24.383045 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:24.383045 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:24.383045 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:24.383045 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:24.383045 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:24.383045 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:24.383045 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:05:24.383045 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:05:24.383045 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 34/71] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:05:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:05:24.383045 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a2e94-8318-45d3-905f-bb960648c9c2 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:24.383749 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a2e94-8318-45d3-905f-bb960648c9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:24.383749 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a2e94-8318-45d3-905f-bb960648c9c2 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:24.385352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 35/72] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:24.386858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a2e94-8318-45d3-905f-bb960648c9c2 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:24.409422 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22ecb3-5658-417a-8fa0-d81030f5cee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:24.410042 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22ecb3-5658-417a-8fa0-d81030f5cee0 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:24.410326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22ecb3-5658-417a-8fa0-d81030f5cee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:24.410592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22ecb3-5658-417a-8fa0-d81030f5cee0 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:24.411287 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22ecb3-5658-417a-8fa0-d81030f5cee0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:24.411612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22ecb3-5658-417a-8fa0-d81030f5cee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:24.413004 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22ecb3-5658-417a-8fa0-d81030f5cee0 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:24.421548 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 38/73] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:05:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:24.423793 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab043b3e-f953-4316-b9ad-266620227b5b None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:24.424080 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab043b3e-f953-4316-b9ad-266620227b5b None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:24.424355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab043b3e-f953-4316-b9ad-266620227b5b None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:24.425620 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 39/74] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:24.428012 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab043b3e-f953-4316-b9ad-266620227b5b None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:24.443731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:24.460730 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:24.504475 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a2e94-8318-45d3-905f-bb960648c9c2 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:24.534177 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab043b3e-f953-4316-b9ad-266620227b5b None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:24.541620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e6c7a-a4ce-4fff-b6b4-b6f112356822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:24.542253 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e6c7a-a4ce-4fff-b6b4-b6f112356822 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:24.542527 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e6c7a-a4ce-4fff-b6b4-b6f112356822 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:24.542798 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e6c7a-a4ce-4fff-b6b4-b6f112356822 None admin] PATH_INFO: `/v3/users/e3a2729e92ec4f42844ed3a9746d1b14` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:24.556495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e6c7a-a4ce-4fff-b6b4-b6f112356822 None admin] RBAC: Authorizing `identity:get_user(user_id=e3a2729e92ec4f42844ed3a9746d1b14)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:24.558164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e6c7a-a4ce-4fff-b6b4-b6f112356822 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:24.559962 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 36/75] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:24 2022] GET /identity/v3/users/e3a2729e92ec4f42844ed3a9746d1b14 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:24.561140 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81712e-d49b-4b90-9323-df038342b92a None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:24.561429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81712e-d49b-4b90-9323-df038342b92a None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:24.561709 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81712e-d49b-4b90-9323-df038342b92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:24.574418 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147149e2-69d3-45aa-8325-d7f3cd1c72ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:24.575337 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147149e2-69d3-45aa-8325-d7f3cd1c72ba None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:24.575337 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147149e2-69d3-45aa-8325-d7f3cd1c72ba None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:24.575623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147149e2-69d3-45aa-8325-d7f3cd1c72ba None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:24.576300 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147149e2-69d3-45aa-8325-d7f3cd1c72ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:24.576609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147149e2-69d3-45aa-8325-d7f3cd1c72ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:24.578003 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147149e2-69d3-45aa-8325-d7f3cd1c72ba None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:24.580299 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-8c81712e-d49b-4b90-9323-df038342b92a None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:24.581517 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-8c81712e-d49b-4b90-9323-df038342b92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:24.587641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 40/76] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:05:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:24.588483 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147149e2-69d3-45aa-8325-d7f3cd1c72ba None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:24.655720 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 37/77] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:24.657607 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953d2eb-dde0-4fff-a168-cbffc8ac7386 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:24.657897 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953d2eb-dde0-4fff-a168-cbffc8ac7386 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:24.658171 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953d2eb-dde0-4fff-a168-cbffc8ac7386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:24.670179 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:24.677660 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-a953d2eb-dde0-4fff-a168-cbffc8ac7386 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:24.681366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-a953d2eb-dde0-4fff-a168-cbffc8ac7386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:24.701102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147149e2-69d3-45aa-8325-d7f3cd1c72ba None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:24.735962 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:24.740718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfffe72-3ccc-46a3-bbd6-5f43729c6a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:24.741374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfffe72-3ccc-46a3-bbd6-5f43729c6a9c None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:24.741655 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfffe72-3ccc-46a3-bbd6-5f43729c6a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:24.741960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfffe72-3ccc-46a3-bbd6-5f43729c6a9c None admin] PATH_INFO: `/v3/users/e3a2729e92ec4f42844ed3a9746d1b14` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:24.743123 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfffe72-3ccc-46a3-bbd6-5f43729c6a9c None admin] RBAC: Authorizing `identity:get_user(user_id=e3a2729e92ec4f42844ed3a9746d1b14)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:24.744695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfffe72-3ccc-46a3-bbd6-5f43729c6a9c None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:24.746313 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 41/78] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:24 2022] GET /identity/v3/users/e3a2729e92ec4f42844ed3a9746d1b14 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:24.754198 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfffe72-3ccc-46a3-bbd6-5f43729c6a9c None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:24.767776 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 38/79] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:24.769003 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953d2eb-dde0-4fff-a168-cbffc8ac7386 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:24.889442 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953d2eb-dde0-4fff-a168-cbffc8ac7386 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:24.913252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfffe72-3ccc-46a3-bbd6-5f43729c6a9c None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:24.934668 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a31e7e-49a6-4de6-8119-d463d37f4ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:24.935218 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a31e7e-49a6-4de6-8119-d463d37f4ded None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:24.935548 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a31e7e-49a6-4de6-8119-d463d37f4ded None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:24.935830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a31e7e-49a6-4de6-8119-d463d37f4ded None admin] PATH_INFO: `/v3/users/fb0b86a646b84622872ed6d032fae507` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:24.937010 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a31e7e-49a6-4de6-8119-d463d37f4ded None admin] RBAC: Authorizing `identity:get_user(user_id=fb0b86a646b84622872ed6d032fae507)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:24.939047 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a31e7e-49a6-4de6-8119-d463d37f4ded None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:24.940987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 39/80] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:24 2022] GET /identity/v3/users/fb0b86a646b84622872ed6d032fae507 => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:24.944153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a31e7e-49a6-4de6-8119-d463d37f4ded None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:24.961945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2f7ee-5a78-40b7-8f7a-55675eaff217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:24.962505 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2f7ee-5a78-40b7-8f7a-55675eaff217 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:24.962853 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2f7ee-5a78-40b7-8f7a-55675eaff217 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:24.963285 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2f7ee-5a78-40b7-8f7a-55675eaff217 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:24.977520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:24.996306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:25.043235 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2f7ee-5a78-40b7-8f7a-55675eaff217 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:25.044795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2f7ee-5a78-40b7-8f7a-55675eaff217 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:25.055364 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a31e7e-49a6-4de6-8119-d463d37f4ded None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:25.093192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5cceb-cbd7-4296-8e2e-f56ee14e7a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:25.093577 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5cceb-cbd7-4296-8e2e-f56ee14e7a6a None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:25.093863 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5cceb-cbd7-4296-8e2e-f56ee14e7a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:25.094177 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5cceb-cbd7-4296-8e2e-f56ee14e7a6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:25.149336 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 42/81] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:05:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:05:25.150469 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2f7ee-5a78-40b7-8f7a-55675eaff217 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:25.164901 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5cceb-cbd7-4296-8e2e-f56ee14e7a6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:25.166642 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5cceb-cbd7-4296-8e2e-f56ee14e7a6a None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:25.195197 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:25.213392 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:25.255937 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2f7ee-5a78-40b7-8f7a-55675eaff217 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:25.268594 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 40/82] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:05:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:05:25.273427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5cceb-cbd7-4296-8e2e-f56ee14e7a6a None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:25.293845 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bff27f-03f5-4fc2-905a-fee33aaf84fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:25.294487 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bff27f-03f5-4fc2-905a-fee33aaf84fe None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:25.294764 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bff27f-03f5-4fc2-905a-fee33aaf84fe None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:25.295039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bff27f-03f5-4fc2-905a-fee33aaf84fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:25.306424 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bff27f-03f5-4fc2-905a-fee33aaf84fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:25.311314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-83bff27f-03f5-4fc2-905a-fee33aaf84fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:05:25.311314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:25.311314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:25.311314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:25.311314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:25.311314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:25.311314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:25.311314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:25.311314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:25.311314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:25.311314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:25.311314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:25.311314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:25.311314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:25.311314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:25.311314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:25.312374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:25.312374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:25.312374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:25.312374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:25.312374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:25.312374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:25.312374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:25.312374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:25.312374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:25.312374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:25.312374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:25.312374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:25.312374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:25.312374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:25.312374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:25.312374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:25.313775 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:25.313775 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:25.313775 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:25.313775 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:25.313775 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:25.313775 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:25.313775 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:25.313775 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:25.313775 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:25.313775 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:25.313775 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:05:25.313775 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:05:25.313775 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 43/83] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:05:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:05:25.314398 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bff27f-03f5-4fc2-905a-fee33aaf84fe None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:25.381343 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5cceb-cbd7-4296-8e2e-f56ee14e7a6a None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:25.422994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b91a3-4409-45df-be0e-4359845581ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:25.423644 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b91a3-4409-45df-be0e-4359845581ff None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:25.423927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b91a3-4409-45df-be0e-4359845581ff None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:25.424199 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b91a3-4409-45df-be0e-4359845581ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:25.426229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bff27f-03f5-4fc2-905a-fee33aaf84fe None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:25.428016 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:25.441948 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:25.461950 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef868be-46f5-4bcf-b4c3-29ede43f46ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:25.462583 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef868be-46f5-4bcf-b4c3-29ede43f46ea None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:25.462874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef868be-46f5-4bcf-b4c3-29ede43f46ea None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:25.463130 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef868be-46f5-4bcf-b4c3-29ede43f46ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:25.464336 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef868be-46f5-4bcf-b4c3-29ede43f46ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:25.465775 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef868be-46f5-4bcf-b4c3-29ede43f46ea None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:25.467332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 44/84] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:05:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:25.468228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef868be-46f5-4bcf-b4c3-29ede43f46ea None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:25.498342 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b91a3-4409-45df-be0e-4359845581ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:25.499850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b91a3-4409-45df-be0e-4359845581ff None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:25.571577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef868be-46f5-4bcf-b4c3-29ede43f46ea None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:25.602677 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 41/85] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:05:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:05:25.602677 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b91a3-4409-45df-be0e-4359845581ff None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:25.607604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99d686-2cdd-4030-a51a-c72ddf96af5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:25.607807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99d686-2cdd-4030-a51a-c72ddf96af5b None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:25.608077 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99d686-2cdd-4030-a51a-c72ddf96af5b None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:25.608349 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99d686-2cdd-4030-a51a-c72ddf96af5b None admin] PATH_INFO: `/v3/projects/0372b5f500b44066a9e11389f07e647e` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:25.609503 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99d686-2cdd-4030-a51a-c72ddf96af5b None admin] RBAC: Authorizing `identity:get_project(project_id=0372b5f500b44066a9e11389f07e647e)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:25.611536 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99d686-2cdd-4030-a51a-c72ddf96af5b None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:25.613334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 45/86] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:05:25 2022] GET /identity/v3/projects/0372b5f500b44066a9e11389f07e647e => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:25.614035 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99d686-2cdd-4030-a51a-c72ddf96af5b None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:25.655157 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:25.659073 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:25.712903 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b91a3-4409-45df-be0e-4359845581ff None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:25.715874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99d686-2cdd-4030-a51a-c72ddf96af5b None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:25.749619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec575d9-97bc-499b-a21c-3d047f66159b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:25.750257 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec575d9-97bc-499b-a21c-3d047f66159b None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:25.750559 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec575d9-97bc-499b-a21c-3d047f66159b None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:25.750841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec575d9-97bc-499b-a21c-3d047f66159b None admin] PATH_INFO: `/v3/projects/0372b5f500b44066a9e11389f07e647e` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:25.752004 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afcaf5-9cf6-43f8-aaca-90a0428b17f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:25.752117 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec575d9-97bc-499b-a21c-3d047f66159b None admin] RBAC: Authorizing `identity:get_project(project_id=0372b5f500b44066a9e11389f07e647e)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:25.752816 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afcaf5-9cf6-43f8-aaca-90a0428b17f6 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:25.753097 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afcaf5-9cf6-43f8-aaca-90a0428b17f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:25.753375 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afcaf5-9cf6-43f8-aaca-90a0428b17f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:25.753727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec575d9-97bc-499b-a21c-3d047f66159b None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:25.754034 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3afcaf5-9cf6-43f8-aaca-90a0428b17f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:25.754336 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3afcaf5-9cf6-43f8-aaca-90a0428b17f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:25.755373 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 42/87] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:05:25 2022] GET /identity/v3/projects/0372b5f500b44066a9e11389f07e647e => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:25.755805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3afcaf5-9cf6-43f8-aaca-90a0428b17f6 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:25.756180 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec575d9-97bc-499b-a21c-3d047f66159b None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:25.767842 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 46/88] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:05:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:25.768688 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afcaf5-9cf6-43f8-aaca-90a0428b17f6 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:25.864090 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec575d9-97bc-499b-a21c-3d047f66159b None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:25.876415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:25.879477 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:25.879621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afcaf5-9cf6-43f8-aaca-90a0428b17f6 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:25.899565 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50387c6b-597a-4a6a-bf58-74fbf519249d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:25.900293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50387c6b-597a-4a6a-bf58-74fbf519249d None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:25.900575 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50387c6b-597a-4a6a-bf58-74fbf519249d None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:25.900878 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50387c6b-597a-4a6a-bf58-74fbf519249d None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:25.901506 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50387c6b-597a-4a6a-bf58-74fbf519249d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:25.902948 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50387c6b-597a-4a6a-bf58-74fbf519249d None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:25.915291 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296258ae-fdce-404a-a899-6a3d108bc4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:25.918156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296258ae-fdce-404a-a899-6a3d108bc4bb None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:25.918156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296258ae-fdce-404a-a899-6a3d108bc4bb None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:25.918156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296258ae-fdce-404a-a899-6a3d108bc4bb None admin] PATH_INFO: `/v3/projects/0372b5f500b44066a9e11389f07e647e` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:25.918156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296258ae-fdce-404a-a899-6a3d108bc4bb None admin] RBAC: Authorizing `identity:get_project(project_id=0372b5f500b44066a9e11389f07e647e)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:25.919119 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296258ae-fdce-404a-a899-6a3d108bc4bb None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:25.921072 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 47/89] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:05:25 2022] GET /identity/v3/projects/0372b5f500b44066a9e11389f07e647e => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:25.921899 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296258ae-fdce-404a-a899-6a3d108bc4bb None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:26.022155 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 43/90] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Sep 6 20:05:25 2022] POST /identity/v3/users => generated 289 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:05:26.022759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296258ae-fdce-404a-a899-6a3d108bc4bb None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:26.022931 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50387c6b-597a-4a6a-bf58-74fbf519249d None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:26.074107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fbbf0-8b5c-428b-ae14-9e78f97e3064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:26.075280 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fbbf0-8b5c-428b-ae14-9e78f97e3064 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:26.075798 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fbbf0-8b5c-428b-ae14-9e78f97e3064 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:26.076215 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fbbf0-8b5c-428b-ae14-9e78f97e3064 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:26.077183 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108fbbf0-8b5c-428b-ae14-9e78f97e3064 None admin] RBAC: Adding query filter params (role.id=d970607307684690803e8e97e2d39e8f, scope.project.id=0372b5f500b44066a9e11389f07e647e, user.id=e3a2729e92ec4f42844ed3a9746d1b14) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:26.077767 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108fbbf0-8b5c-428b-ae14-9e78f97e3064 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:26.080071 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108fbbf0-8b5c-428b-ae14-9e78f97e3064 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:26.099478 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 48/91] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:05:25 2022] GET /identity/v3/role_assignments?user.id=e3a2729e92ec4f42844ed3a9746d1b14&scope.project.id=0372b5f500b44066a9e11389f07e647e&role.id=d970607307684690803e8e97e2d39e8f => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:26.099478 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fbbf0-8b5c-428b-ae14-9e78f97e3064 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:26.147157 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:26.165945 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50387c6b-597a-4a6a-bf58-74fbf519249d None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:26.221743 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9ff36-ab4f-4db2-be49-4ba24f45b555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:26.222273 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9ff36-ab4f-4db2-be49-4ba24f45b555 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:26.222679 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9ff36-ab4f-4db2-be49-4ba24f45b555 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:26.223014 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9ff36-ab4f-4db2-be49-4ba24f45b555 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:26.224439 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9ff36-ab4f-4db2-be49-4ba24f45b555 None admin] RBAC: Adding query filter params (role.id=8ad4b0e0a5384306acd6d162f21dcd3d, scope.project.id=0372b5f500b44066a9e11389f07e647e, user.id=e3a2729e92ec4f42844ed3a9746d1b14) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:26.224439 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9ff36-ab4f-4db2-be49-4ba24f45b555 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:26.226034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9ff36-ab4f-4db2-be49-4ba24f45b555 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:26.235189 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 44/92] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:05:26 2022] GET /identity/v3/role_assignments?user.id=e3a2729e92ec4f42844ed3a9746d1b14&scope.project.id=0372b5f500b44066a9e11389f07e647e&role.id=8ad4b0e0a5384306acd6d162f21dcd3d => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:26.236762 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9ff36-ab4f-4db2-be49-4ba24f45b555 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:26.243379 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fbbf0-8b5c-428b-ae14-9e78f97e3064 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:26.298218 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:26.304052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59216b26-4b5f-4e08-9bec-73de43791033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:26.304817 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59216b26-4b5f-4e08-9bec-73de43791033 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:26.305106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59216b26-4b5f-4e08-9bec-73de43791033 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:26.305383 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59216b26-4b5f-4e08-9bec-73de43791033 None admin] PATH_INFO: `/v3/users/e3a2729e92ec4f42844ed3a9746d1b14` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:26.307377 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59216b26-4b5f-4e08-9bec-73de43791033 None admin] RBAC: Authorizing `identity:get_user(user_id=e3a2729e92ec4f42844ed3a9746d1b14)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:26.309083 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59216b26-4b5f-4e08-9bec-73de43791033 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:26.311164 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 49/93] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:26 2022] GET /identity/v3/users/e3a2729e92ec4f42844ed3a9746d1b14 => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:26.319674 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59216b26-4b5f-4e08-9bec-73de43791033 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:26.401350 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9ff36-ab4f-4db2-be49-4ba24f45b555 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:26.459868 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298674f-2bea-4788-b4be-948699eedf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:26.460490 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298674f-2bea-4788-b4be-948699eedf7d None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:26.460776 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298674f-2bea-4788-b4be-948699eedf7d None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:26.461054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298674f-2bea-4788-b4be-948699eedf7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:26.461794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298674f-2bea-4788-b4be-948699eedf7d None admin] RBAC: Adding query filter params (role.id=1e2ac44410664e6b8f42ab3c37e2643f, scope.project.id=0372b5f500b44066a9e11389f07e647e, user.id=fb0b86a646b84622872ed6d032fae507) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:26.462105 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298674f-2bea-4788-b4be-948699eedf7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:26.463669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298674f-2bea-4788-b4be-948699eedf7d None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:26.474470 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 45/94] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:05:26 2022] GET /identity/v3/role_assignments?user.id=fb0b86a646b84622872ed6d032fae507&scope.project.id=0372b5f500b44066a9e11389f07e647e&role.id=1e2ac44410664e6b8f42ab3c37e2643f => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:26.512547 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:26.517455 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59216b26-4b5f-4e08-9bec-73de43791033 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:26.565783 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ce7b1-c77f-429c-9e11-534f3a194a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:26.566720 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ce7b1-c77f-429c-9e11-534f3a194a47 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:26.567179 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ce7b1-c77f-429c-9e11-534f3a194a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:26.567664 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ce7b1-c77f-429c-9e11-534f3a194a47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:26.660449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ce7b1-c77f-429c-9e11-534f3a194a47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:26.662339 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ce7b1-c77f-429c-9e11-534f3a194a47 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:26.786761 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:26.791560 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 50/95] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:05:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:05:26.797627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298674f-2bea-4788-b4be-948699eedf7d None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:26.956618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:26.961508 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298674f-2bea-4788-b4be-948699eedf7d None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:27.019164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4bbd6-c997-4360-81a0-5d5fe576b846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:27.019880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4bbd6-c997-4360-81a0-5d5fe576b846 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:27.020171 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4bbd6-c997-4360-81a0-5d5fe576b846 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:27.020447 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4bbd6-c997-4360-81a0-5d5fe576b846 None admin] PATH_INFO: `/v3/projects/1645b65690e848ccb77eb9ef2f091d98` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:27.021677 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4bbd6-c997-4360-81a0-5d5fe576b846 None admin] RBAC: Authorizing `identity:get_project(project_id=1645b65690e848ccb77eb9ef2f091d98)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:27.023243 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4bbd6-c997-4360-81a0-5d5fe576b846 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:27.025425 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 46/96] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:05:26 2022] GET /identity/v3/projects/1645b65690e848ccb77eb9ef2f091d98 => generated 312 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:27.032602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ce7b1-c77f-429c-9e11-534f3a194a47 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:27.185734 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ce7b1-c77f-429c-9e11-534f3a194a47 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:27.257304 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccb825-5265-411d-b6fd-09a8b84e3c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:27.258386 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccb825-5265-411d-b6fd-09a8b84e3c4d None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:27.258908 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccb825-5265-411d-b6fd-09a8b84e3c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:27.259425 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccb825-5265-411d-b6fd-09a8b84e3c4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:27.260877 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccb825-5265-411d-b6fd-09a8b84e3c4d None admin] RBAC: Adding query filter params (role.id=d970607307684690803e8e97e2d39e8f, scope.project.id=1645b65690e848ccb77eb9ef2f091d98, user.id=e3a2729e92ec4f42844ed3a9746d1b14) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:27.261449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccb825-5265-411d-b6fd-09a8b84e3c4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:27.264301 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccb825-5265-411d-b6fd-09a8b84e3c4d None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:27.275255 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 51/97] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:05:27 2022] GET /identity/v3/role_assignments?user.id=e3a2729e92ec4f42844ed3a9746d1b14&scope.project.id=1645b65690e848ccb77eb9ef2f091d98&role.id=d970607307684690803e8e97e2d39e8f => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:29.135382 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cf1b3-92c1-418d-a2c9-97e0476faba7 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:29.135908 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cf1b3-92c1-418d-a2c9-97e0476faba7 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:29.135908 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cf1b3-92c1-418d-a2c9-97e0476faba7 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:29.137423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 47/98] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:29.143552 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31140c4-4245-4ff8-9e28-4cef7c58d7ce None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:29.144037 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31140c4-4245-4ff8-9e28-4cef7c58d7ce None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:29.144111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31140c4-4245-4ff8-9e28-4cef7c58d7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:29.164505 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-e31140c4-4245-4ff8-9e28-4cef7c58d7ce None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:29.166023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-e31140c4-4245-4ff8-9e28-4cef7c58d7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:29.257760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:29.271452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 52/99] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:29.604639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c7f84-c4e7-4d48-a6d2-ee34280fa451 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:29.605013 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c7f84-c4e7-4d48-a6d2-ee34280fa451 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:29.605208 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c7f84-c4e7-4d48-a6d2-ee34280fa451 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:29.606598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 48/100] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:29.614341 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23806514-46b0-4aa8-9007-0ae691d20e5a None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:29.614720 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23806514-46b0-4aa8-9007-0ae691d20e5a None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:29.614898 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23806514-46b0-4aa8-9007-0ae691d20e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:29.644562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-23806514-46b0-4aa8-9007-0ae691d20e5a None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:29.645817 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-23806514-46b0-4aa8-9007-0ae691d20e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:29.742737 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 53/101] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:29.806494 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c7f84-c4e7-4d48-a6d2-ee34280fa451 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:29.925502 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c7f84-c4e7-4d48-a6d2-ee34280fa451 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:29.966650 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ad001-0d08-40af-8ed2-643c912eaadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:29.967306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ad001-0d08-40af-8ed2-643c912eaadc None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:29.967625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ad001-0d08-40af-8ed2-643c912eaadc None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:29.967905 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ad001-0d08-40af-8ed2-643c912eaadc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:29.982277 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ad001-0d08-40af-8ed2-643c912eaadc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:29.989795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-933ad001-0d08-40af-8ed2-643c912eaadc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:05:29.989795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:29.989795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:29.989795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:29.989795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:29.989795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:29.989795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:29.989795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:29.989795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:29.989795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:29.989795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:29.989795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:29.989795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:29.989795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:29.989795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:29.989795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:29.990682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:29.990682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:29.990682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:29.990682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:29.990682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:29.990682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:29.990682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:29.990682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:29.990682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:29.990682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:29.990682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:29.990682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:29.990682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:29.990682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:29.990682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:29.990682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:29.991480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:29.991480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:29.991480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:29.991480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:29.991480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:29.991480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:29.991480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:29.991480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:29.991480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:29.991480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:29.991480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:05:29.991480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:05:29.991480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 49/102] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:05:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:05:29.998319 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23806514-46b0-4aa8-9007-0ae691d20e5a None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:30.156067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23806514-46b0-4aa8-9007-0ae691d20e5a None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:30.201103 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:30.215029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cb237-09b5-483a-83dc-70f227569af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:30.215791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cb237-09b5-483a-83dc-70f227569af9 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:30.216105 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cb237-09b5-483a-83dc-70f227569af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:30.216388 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cb237-09b5-483a-83dc-70f227569af9 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:30.217241 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667cb237-09b5-483a-83dc-70f227569af9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:30.217563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667cb237-09b5-483a-83dc-70f227569af9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:30.219736 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667cb237-09b5-483a-83dc-70f227569af9 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:30.230974 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 54/103] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:05:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:30.238656 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ad001-0d08-40af-8ed2-643c912eaadc None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:30.253326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cb237-09b5-483a-83dc-70f227569af9 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:30.292889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:30.435057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cb237-09b5-483a-83dc-70f227569af9 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:30.442749 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ad001-0d08-40af-8ed2-643c912eaadc None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:30.482480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19b1f3-8e24-4fdd-bd6d-673025e287f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:30.483175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19b1f3-8e24-4fdd-bd6d-673025e287f0 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:30.483489 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19b1f3-8e24-4fdd-bd6d-673025e287f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:30.483778 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19b1f3-8e24-4fdd-bd6d-673025e287f0 None admin] PATH_INFO: `/v3/users/e3a2729e92ec4f42844ed3a9746d1b14` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:30.485279 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e72d2-a753-4328-8d5b-f63e4636b611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:30.485480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19b1f3-8e24-4fdd-bd6d-673025e287f0 None admin] RBAC: Authorizing `identity:get_user(user_id=e3a2729e92ec4f42844ed3a9746d1b14)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:30.485934 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e72d2-a753-4328-8d5b-f63e4636b611 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:30.486218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e72d2-a753-4328-8d5b-f63e4636b611 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:30.486480 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e72d2-a753-4328-8d5b-f63e4636b611 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:30.486995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19b1f3-8e24-4fdd-bd6d-673025e287f0 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:30.489090 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 50/104] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:30 2022] GET /identity/v3/users/e3a2729e92ec4f42844ed3a9746d1b14 => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:30.492796 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c400b49-4a4b-4434-b709-c0677f01dc37 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:30.493489 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c400b49-4a4b-4434-b709-c0677f01dc37 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:30.493489 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c400b49-4a4b-4434-b709-c0677f01dc37 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:30.495404 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 51/105] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:30.496883 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147800e-1dbf-4b55-b010-275ce9736960 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:30.497142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147800e-1dbf-4b55-b010-275ce9736960 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:30.497418 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147800e-1dbf-4b55-b010-275ce9736960 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:30.498733 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 52/106] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:30.499889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17768964-b8f8-4782-ae3e-693ef97b003f None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:30.500175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17768964-b8f8-4782-ae3e-693ef97b003f None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:30.501062 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17768964-b8f8-4782-ae3e-693ef97b003f None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:30.502933 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 53/107] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:30.503751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17768964-b8f8-4782-ae3e-693ef97b003f None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:30.512653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e72d2-a753-4328-8d5b-f63e4636b611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:30.520542 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-182e72d2-a753-4328-8d5b-f63e4636b611 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:05:30.520542 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:30.520542 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:30.520542 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:30.520542 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:30.520542 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:30.520542 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:30.520542 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:30.520542 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:30.520542 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:30.520542 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:30.520542 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:30.520542 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:30.520542 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:30.520542 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:30.520542 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:30.521796 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:30.521796 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:30.521796 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:30.521796 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:30.521796 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:30.521796 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:30.521796 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:30.521796 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:30.521796 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:30.521796 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:30.521796 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:30.521796 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:30.521796 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:30.521796 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:30.521796 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:30.521796 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:30.522638 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:30.522638 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:30.522638 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:30.522638 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:30.522638 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:30.522638 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:30.522638 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:30.522638 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:30.522638 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:30.522638 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:30.522638 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:05:30.522638 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:05:30.523387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 55/108] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:05:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:05:30.524980 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69352c13-f6be-486d-90ed-7efb18983ac1 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:30.524980 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69352c13-f6be-486d-90ed-7efb18983ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:30.524980 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69352c13-f6be-486d-90ed-7efb18983ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:30.552547 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-69352c13-f6be-486d-90ed-7efb18983ac1 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:30.554498 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-69352c13-f6be-486d-90ed-7efb18983ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:30.617238 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:30.633790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:30.642292 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17768964-b8f8-4782-ae3e-693ef97b003f None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:30.657335 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 56/109] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:30.660639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db390db-d86b-4b3b-88b6-1aeed1b5c89f None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:30.661707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db390db-d86b-4b3b-88b6-1aeed1b5c89f None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:30.662173 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db390db-d86b-4b3b-88b6-1aeed1b5c89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:30.686037 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-9db390db-d86b-4b3b-88b6-1aeed1b5c89f None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:30.687258 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-9db390db-d86b-4b3b-88b6-1aeed1b5c89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:30.695354 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b0f45-7cf4-418c-a05c-657c64f0d06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:30.697458 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b0f45-7cf4-418c-a05c-657c64f0d06b None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:30.697991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b0f45-7cf4-418c-a05c-657c64f0d06b None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:30.698548 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b0f45-7cf4-418c-a05c-657c64f0d06b None admin] PATH_INFO: `/v3/projects/0372b5f500b44066a9e11389f07e647e` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:30.700222 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b0f45-7cf4-418c-a05c-657c64f0d06b None admin] RBAC: Authorizing `identity:get_project(project_id=0372b5f500b44066a9e11389f07e647e)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:30.703576 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b0f45-7cf4-418c-a05c-657c64f0d06b None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:30.706628 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 54/110] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:05:30 2022] GET /identity/v3/projects/0372b5f500b44066a9e11389f07e647e => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:30.709469 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea7684-8b5c-4c6d-8e6d-e84216d3a86b None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:30.710594 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea7684-8b5c-4c6d-8e6d-e84216d3a86b None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:30.711118 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea7684-8b5c-4c6d-8e6d-e84216d3a86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:30.740646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-68ea7684-8b5c-4c6d-8e6d-e84216d3a86b None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:30.742254 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-68ea7684-8b5c-4c6d-8e6d-e84216d3a86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:30.800613 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 57/111] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:30.801868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db390db-d86b-4b3b-88b6-1aeed1b5c89f None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:30.855722 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 55/112] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:30.861300 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea7684-8b5c-4c6d-8e6d-e84216d3a86b None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:31.023315 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db390db-d86b-4b3b-88b6-1aeed1b5c89f None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:31.041905 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:31.051045 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea7684-8b5c-4c6d-8e6d-e84216d3a86b None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:31.055842 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:31.069537 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37ee46-d210-4af5-a6f4-8f863b9d14d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:31.071088 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37ee46-d210-4af5-a6f4-8f863b9d14d0 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:31.071825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37ee46-d210-4af5-a6f4-8f863b9d14d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:31.072279 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37ee46-d210-4af5-a6f4-8f863b9d14d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:31.073111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37ee46-d210-4af5-a6f4-8f863b9d14d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:31.073714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37ee46-d210-4af5-a6f4-8f863b9d14d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:31.075939 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37ee46-d210-4af5-a6f4-8f863b9d14d0 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:31.088096 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 58/113] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:05:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:31.089230 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62075205-a1b6-482a-b8ad-87ebfaba16b6 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:31.089878 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62075205-a1b6-482a-b8ad-87ebfaba16b6 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:31.089878 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62075205-a1b6-482a-b8ad-87ebfaba16b6 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:31.091192 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 59/114] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:31.097128 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62075205-a1b6-482a-b8ad-87ebfaba16b6 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:31.110913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2edbc-86ba-4ff7-8ab8-5f905e33f334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:31.112283 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2edbc-86ba-4ff7-8ab8-5f905e33f334 None admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:31.112727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2edbc-86ba-4ff7-8ab8-5f905e33f334 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:31.113442 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2edbc-86ba-4ff7-8ab8-5f905e33f334 None admin] PATH_INFO: `/v3/projects/0372b5f500b44066a9e11389f07e647e/users/e3a2729e92ec4f42844ed3a9746d1b14/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:31.116545 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe2edbc-86ba-4ff7-8ab8-5f905e33f334 None admin] RBAC: Authorizing `identity:create_grant(project_id=0372b5f500b44066a9e11389f07e647e, user_id=e3a2729e92ec4f42844ed3a9746d1b14, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:31.118667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe2edbc-86ba-4ff7-8ab8-5f905e33f334 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:31.188050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 56/115] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Sep 6 20:05:30 2022] PUT /identity/v3/projects/0372b5f500b44066a9e11389f07e647e/users/e3a2729e92ec4f42844ed3a9746d1b14/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:05:31.189837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4546948-9cd7-4967-a2b9-0f3e98922cc0 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:31.190505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4546948-9cd7-4967-a2b9-0f3e98922cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:31.191109 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4546948-9cd7-4967-a2b9-0f3e98922cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:31.217323 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-b4546948-9cd7-4967-a2b9-0f3e98922cc0 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:31.220660 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-b4546948-9cd7-4967-a2b9-0f3e98922cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:31.233678 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62075205-a1b6-482a-b8ad-87ebfaba16b6 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:31.275207 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5705cc-9a57-410c-9e4f-7acf0f425832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:31.275788 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5705cc-9a57-410c-9e4f-7acf0f425832 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:31.276074 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5705cc-9a57-410c-9e4f-7acf0f425832 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:31.276349 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5705cc-9a57-410c-9e4f-7acf0f425832 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:31.289323 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5705cc-9a57-410c-9e4f-7acf0f425832 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:31.295039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-ba5705cc-9a57-410c-9e4f-7acf0f425832 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 20:05:31.295039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:31.295039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:31.295039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:31.295039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:31.295039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:31.295039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:31.295039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:31.295039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:31.295039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:31.295039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:31.295039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:31.295039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:31.295039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:31.295039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:31.295039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:31.296628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:31.296628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:31.296628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:31.296628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:31.296628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:31.296628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:31.296628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:31.296628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:31.296628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:31.296628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:31.296628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:31.296628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:31.296628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:31.296628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:31.296628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:31.296628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:31.297945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:31.297945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:31.297945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:31.297945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:31.297945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:31.297945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:31.297945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:31.297945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:31.297945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:31.297945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:31.297945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 20:05:31.297945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:05:31.297945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 60/116] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:05:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:05:31.297945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5705cc-9a57-410c-9e4f-7acf0f425832 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:31.335350 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 57/117] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:31.336103 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4546948-9cd7-4967-a2b9-0f3e98922cc0 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:31.345512 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:31.458347 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5705cc-9a57-410c-9e4f-7acf0f425832 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:31.466982 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:31.492751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4546948-9cd7-4967-a2b9-0f3e98922cc0 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:31.518104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c8b67-1a1f-47a6-bac0-ac5460dcc509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:31.518806 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c8b67-1a1f-47a6-bac0-ac5460dcc509 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:31.519096 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c8b67-1a1f-47a6-bac0-ac5460dcc509 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:31.519380 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c8b67-1a1f-47a6-bac0-ac5460dcc509 None admin] PATH_INFO: `/v3/users/fb0b86a646b84622872ed6d032fae507` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:31.521130 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c8b67-1a1f-47a6-bac0-ac5460dcc509 None admin] RBAC: Authorizing `identity:get_user(user_id=fb0b86a646b84622872ed6d032fae507)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:31.522937 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c8b67-1a1f-47a6-bac0-ac5460dcc509 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:31.527563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 61/118] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:31 2022] GET /identity/v3/users/fb0b86a646b84622872ed6d032fae507 => generated 247 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:31.527563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c8b67-1a1f-47a6-bac0-ac5460dcc509 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:31.541038 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7f7c3-846a-4c6a-b232-c82b695066b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:31.541824 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7f7c3-846a-4c6a-b232-c82b695066b8 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:31.542209 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7f7c3-846a-4c6a-b232-c82b695066b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:31.542588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7f7c3-846a-4c6a-b232-c82b695066b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:31.554324 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7f7c3-846a-4c6a-b232-c82b695066b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:31.560727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-66f7f7c3-846a-4c6a-b232-c82b695066b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 20:05:31.560727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:31.560727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:31.560727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:31.560727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:31.560727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:31.560727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:31.560727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:31.560727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:31.560727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:31.560727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:31.560727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:31.560727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:31.560727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:31.560727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:31.560727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:31.561589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:31.561589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:31.561589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:31.561589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:31.561589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:31.561589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:31.561589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:31.561589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:31.561589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:31.561589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:31.561589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:31.561589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:31.561589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:31.561589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:31.561589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:31.561589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:31.562347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:31.562347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:31.562347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:31.562347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:31.562347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:31.562347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:31.562347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:31.562347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:31.562347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:31.562347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:31.562347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 20:05:31.562347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:05:31.563193 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 58/119] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Sep 6 20:05:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:05:31.564399 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7f7c3-846a-4c6a-b232-c82b695066b8 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:31.638245 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:31.644380 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c8b67-1a1f-47a6-bac0-ac5460dcc509 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:31.670014 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7f7c3-846a-4c6a-b232-c82b695066b8 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:31.683980 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d7005-9188-4caa-ab4f-15fcdfcc7ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:31.684748 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d7005-9188-4caa-ab4f-15fcdfcc7ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:31.685034 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d7005-9188-4caa-ab4f-15fcdfcc7ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:31.685310 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d7005-9188-4caa-ab4f-15fcdfcc7ba4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:31.686480 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d7005-9188-4caa-ab4f-15fcdfcc7ba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:31.688480 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d7005-9188-4caa-ab4f-15fcdfcc7ba4 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:31.691484 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 62/120] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:05:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:31.691484 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d7005-9188-4caa-ab4f-15fcdfcc7ba4 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:31.706820 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff326557-e525-44f0-b1a6-cfd1fdbf8a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:31.707484 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff326557-e525-44f0-b1a6-cfd1fdbf8a0c None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:31.707747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff326557-e525-44f0-b1a6-cfd1fdbf8a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:31.708063 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff326557-e525-44f0-b1a6-cfd1fdbf8a0c None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:31.708735 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff326557-e525-44f0-b1a6-cfd1fdbf8a0c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:31.709045 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff326557-e525-44f0-b1a6-cfd1fdbf8a0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:31.710467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff326557-e525-44f0-b1a6-cfd1fdbf8a0c None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:31.719855 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 59/121] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:05:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:31.720792 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff326557-e525-44f0-b1a6-cfd1fdbf8a0c None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:31.728284 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:31.818760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d7005-9188-4caa-ab4f-15fcdfcc7ba4 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:31.849561 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff326557-e525-44f0-b1a6-cfd1fdbf8a0c None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:31.859672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad22b5b-4b0a-46a3-af58-9ce0c4c266fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:31.860426 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad22b5b-4b0a-46a3-af58-9ce0c4c266fa None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:31.860781 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad22b5b-4b0a-46a3-af58-9ce0c4c266fa None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:31.861131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad22b5b-4b0a-46a3-af58-9ce0c4c266fa None admin] PATH_INFO: `/v3/projects/0372b5f500b44066a9e11389f07e647e` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:31.862296 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad22b5b-4b0a-46a3-af58-9ce0c4c266fa None admin] RBAC: Authorizing `identity:get_project(project_id=0372b5f500b44066a9e11389f07e647e)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:31.863822 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad22b5b-4b0a-46a3-af58-9ce0c4c266fa None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:31.870451 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 63/122] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:05:31 2022] GET /identity/v3/projects/0372b5f500b44066a9e11389f07e647e => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:31.870451 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad22b5b-4b0a-46a3-af58-9ce0c4c266fa None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:31.897131 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f91025-e09c-46ca-8f02-f5c2bbedf710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:31.897737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f91025-e09c-46ca-8f02-f5c2bbedf710 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:31.898023 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f91025-e09c-46ca-8f02-f5c2bbedf710 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:31.898297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f91025-e09c-46ca-8f02-f5c2bbedf710 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:31.898964 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f91025-e09c-46ca-8f02-f5c2bbedf710 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:31.899266 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f91025-e09c-46ca-8f02-f5c2bbedf710 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:31.900732 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f91025-e09c-46ca-8f02-f5c2bbedf710 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:31.903470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:31.914582 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 60/123] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:05:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:31.914582 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f91025-e09c-46ca-8f02-f5c2bbedf710 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:31.987735 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:31.988053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad22b5b-4b0a-46a3-af58-9ce0c4c266fa None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:32.029764 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d8d7a-e0ce-4cfd-89d7-c652a134e616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:32.030695 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f91025-e09c-46ca-8f02-f5c2bbedf710 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:32.030948 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d8d7a-e0ce-4cfd-89d7-c652a134e616 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:32.031358 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d8d7a-e0ce-4cfd-89d7-c652a134e616 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:32.031890 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d8d7a-e0ce-4cfd-89d7-c652a134e616 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:32.051815 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d8d7a-e0ce-4cfd-89d7-c652a134e616 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:32.061422 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-a54d8d7a-e0ce-4cfd-89d7-c652a134e616 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:05:32.061422 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:32.061422 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:32.061422 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:32.061422 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:32.061422 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:32.061422 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:32.061422 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:32.061422 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:32.061422 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:32.061422 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:32.061422 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:32.061422 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:32.061422 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:32.061422 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:32.061422 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:32.062351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:32.062351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:32.062351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:32.062351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:32.062351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:32.062351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:32.062351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:32.062351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:32.062351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:32.062351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:32.062351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:32.062351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:32.062351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:32.062351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:32.062351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:32.062351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:32.064127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:32.064127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:32.064127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:32.064127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:32.064127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:32.064127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:32.064127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:32.064127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:32.064127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:32.064127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:32.064127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:05:32.064127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:05:32.064835 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 64/124] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:05:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:05:32.065904 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d8d7a-e0ce-4cfd-89d7-c652a134e616 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:32.095020 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041678d-a633-4b0a-8edf-8cd4d34d3652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:32.095637 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041678d-a633-4b0a-8edf-8cd4d34d3652 None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:32.095740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041678d-a633-4b0a-8edf-8cd4d34d3652 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:32.096169 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041678d-a633-4b0a-8edf-8cd4d34d3652 None admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:32.096687 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041678d-a633-4b0a-8edf-8cd4d34d3652 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:32.098156 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041678d-a633-4b0a-8edf-8cd4d34d3652 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:32.185969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 61/125] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Sep 6 20:05:31 2022] POST /identity/v3/projects => generated 302 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:05:32.187171 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041678d-a633-4b0a-8edf-8cd4d34d3652 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:32.200930 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:32.208957 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d8d7a-e0ce-4cfd-89d7-c652a134e616 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:32.259626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399146b-3ae1-4a10-8eb4-f2c87176fcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:32.260483 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399146b-3ae1-4a10-8eb4-f2c87176fcaf None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:32.260920 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399146b-3ae1-4a10-8eb4-f2c87176fcaf None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:32.261296 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399146b-3ae1-4a10-8eb4-f2c87176fcaf None admin] PATH_INFO: `/v3/users/111441b2446544bfadabbd543f1f6fb3` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:32.281262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399146b-3ae1-4a10-8eb4-f2c87176fcaf None admin] RBAC: Authorizing `identity:get_user(user_id=111441b2446544bfadabbd543f1f6fb3)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:32.283831 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399146b-3ae1-4a10-8eb4-f2c87176fcaf None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:32.285749 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 65/126] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:32 2022] GET /identity/v3/users/111441b2446544bfadabbd543f1f6fb3 => generated 289 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:32.286806 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399146b-3ae1-4a10-8eb4-f2c87176fcaf None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:32.354512 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041678d-a633-4b0a-8edf-8cd4d34d3652 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:32.375677 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:32.396691 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50318c1b-5162-42f2-9439-b7f8742f6623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:32.398195 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50318c1b-5162-42f2-9439-b7f8742f6623 None admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:32.398889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50318c1b-5162-42f2-9439-b7f8742f6623 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:32.399596 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50318c1b-5162-42f2-9439-b7f8742f6623 None admin] PATH_INFO: `/v3/projects/0372b5f500b44066a9e11389f07e647e/users/fb0b86a646b84622872ed6d032fae507/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:32.403159 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50318c1b-5162-42f2-9439-b7f8742f6623 None admin] RBAC: Authorizing `identity:create_grant(project_id=0372b5f500b44066a9e11389f07e647e, user_id=fb0b86a646b84622872ed6d032fae507, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:32.406430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50318c1b-5162-42f2-9439-b7f8742f6623 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:32.426614 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399146b-3ae1-4a10-8eb4-f2c87176fcaf None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:32.467723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16ffbd-113a-4a1b-b494-9c8aef688bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:32.468783 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16ffbd-113a-4a1b-b494-9c8aef688bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:32.469805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16ffbd-113a-4a1b-b494-9c8aef688bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:32.470310 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16ffbd-113a-4a1b-b494-9c8aef688bd4 None admin] PATH_INFO: `/v3/users/e3a2729e92ec4f42844ed3a9746d1b14` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:32.471895 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16ffbd-113a-4a1b-b494-9c8aef688bd4 None admin] RBAC: Authorizing `identity:get_user(user_id=e3a2729e92ec4f42844ed3a9746d1b14)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:32.473576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16ffbd-113a-4a1b-b494-9c8aef688bd4 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:32.475507 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 66/127] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:32 2022] GET /identity/v3/users/e3a2729e92ec4f42844ed3a9746d1b14 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:32.476520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16ffbd-113a-4a1b-b494-9c8aef688bd4 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:32.499176 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:32.518566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 62/128] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Sep 6 20:05:32 2022] PUT /identity/v3/projects/0372b5f500b44066a9e11389f07e647e/users/fb0b86a646b84622872ed6d032fae507/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:05:32.520761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50318c1b-5162-42f2-9439-b7f8742f6623 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:32.678124 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50318c1b-5162-42f2-9439-b7f8742f6623 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:32.710402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16ffbd-113a-4a1b-b494-9c8aef688bd4 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:32.723501 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8087e9-49ee-489d-b3a2-113cb758cb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:32.724504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8087e9-49ee-489d-b3a2-113cb758cb68 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:32.725761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8087e9-49ee-489d-b3a2-113cb758cb68 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:32.726406 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8087e9-49ee-489d-b3a2-113cb758cb68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:32.799292 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51912c-57db-4e38-b5e0-3a728bff0b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:32.800080 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51912c-57db-4e38-b5e0-3a728bff0b37 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:32.800360 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51912c-57db-4e38-b5e0-3a728bff0b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:32.800634 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51912c-57db-4e38-b5e0-3a728bff0b37 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:32.802753 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51912c-57db-4e38-b5e0-3a728bff0b37 None admin] RBAC: Adding query filter params (name=member) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:32.802753 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51912c-57db-4e38-b5e0-3a728bff0b37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:32.803740 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51912c-57db-4e38-b5e0-3a728bff0b37 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:32.813361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:32.814564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 67/129] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:05:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:32.817750 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51912c-57db-4e38-b5e0-3a728bff0b37 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:32.856437 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8087e9-49ee-489d-b3a2-113cb758cb68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:32.858367 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8087e9-49ee-489d-b3a2-113cb758cb68 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:32.936855 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:32.957855 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51912c-57db-4e38-b5e0-3a728bff0b37 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:33.022392 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443dc77-0fc5-42a0-88f4-1d48e6727609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:33.024504 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443dc77-0fc5-42a0-88f4-1d48e6727609 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:33.025032 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443dc77-0fc5-42a0-88f4-1d48e6727609 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:33.025503 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443dc77-0fc5-42a0-88f4-1d48e6727609 None admin] PATH_INFO: `/v3/projects/0372b5f500b44066a9e11389f07e647e` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:33.026981 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443dc77-0fc5-42a0-88f4-1d48e6727609 None admin] RBAC: Authorizing `identity:get_project(project_id=0372b5f500b44066a9e11389f07e647e)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:33.030084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 63/130] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:05:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:05:33.031184 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8087e9-49ee-489d-b3a2-113cb758cb68 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:33.037182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443dc77-0fc5-42a0-88f4-1d48e6727609 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:33.039329 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 68/131] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:05:32 2022] GET /identity/v3/projects/0372b5f500b44066a9e11389f07e647e => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:33.040329 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443dc77-0fc5-42a0-88f4-1d48e6727609 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:33.189881 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:33.243934 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443dc77-0fc5-42a0-88f4-1d48e6727609 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:33.278506 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8087e9-49ee-489d-b3a2-113cb758cb68 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:33.288792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f1dea-3d0e-4560-a858-a891d8df3a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:33.289448 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f1dea-3d0e-4560-a858-a891d8df3a35 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:33.289724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f1dea-3d0e-4560-a858-a891d8df3a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:33.289997 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f1dea-3d0e-4560-a858-a891d8df3a35 None admin] PATH_INFO: `/v3/projects/0372b5f500b44066a9e11389f07e647e` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:33.291143 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f1dea-3d0e-4560-a858-a891d8df3a35 None admin] RBAC: Authorizing `identity:get_project(project_id=0372b5f500b44066a9e11389f07e647e)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:33.293399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f1dea-3d0e-4560-a858-a891d8df3a35 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:33.295268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 69/132] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:05:33 2022] GET /identity/v3/projects/0372b5f500b44066a9e11389f07e647e => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:33.295904 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f1dea-3d0e-4560-a858-a891d8df3a35 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:33.331865 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:33.382427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6c6ab-93fb-49a7-af1a-d9d916a159a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:33.383784 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6c6ab-93fb-49a7-af1a-d9d916a159a4 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:33.383784 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6c6ab-93fb-49a7-af1a-d9d916a159a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:33.383784 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6c6ab-93fb-49a7-af1a-d9d916a159a4 None admin] PATH_INFO: `/v3/users/e3a2729e92ec4f42844ed3a9746d1b14` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:33.388180 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6c6ab-93fb-49a7-af1a-d9d916a159a4 None admin] RBAC: Authorizing `identity:get_user(user_id=e3a2729e92ec4f42844ed3a9746d1b14)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:33.389700 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6c6ab-93fb-49a7-af1a-d9d916a159a4 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:33.391379 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 64/133] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:33 2022] GET /identity/v3/users/e3a2729e92ec4f42844ed3a9746d1b14 => generated 275 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:33.392191 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6c6ab-93fb-49a7-af1a-d9d916a159a4 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:33.445689 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f1dea-3d0e-4560-a858-a891d8df3a35 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:33.530943 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c504bb-ba84-4cfb-a136-a8ad8d0c9890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:33.531697 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c504bb-ba84-4cfb-a136-a8ad8d0c9890 None admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:33.531982 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c504bb-ba84-4cfb-a136-a8ad8d0c9890 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:33.532263 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c504bb-ba84-4cfb-a136-a8ad8d0c9890 None admin] PATH_INFO: `/v3/projects/0372b5f500b44066a9e11389f07e647e/users/e3a2729e92ec4f42844ed3a9746d1b14/roles/8ad4b0e0a5384306acd6d162f21dcd3d` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:33.534733 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c504bb-ba84-4cfb-a136-a8ad8d0c9890 None admin] RBAC: Authorizing `identity:create_grant(project_id=0372b5f500b44066a9e11389f07e647e, user_id=e3a2729e92ec4f42844ed3a9746d1b14, role_id=8ad4b0e0a5384306acd6d162f21dcd3d)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:33.536483 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c504bb-ba84-4cfb-a136-a8ad8d0c9890 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:33.551634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6c6ab-93fb-49a7-af1a-d9d916a159a4 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:33.590171 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef509955-028f-494c-97bb-19a2b1a75ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:33.590793 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef509955-028f-494c-97bb-19a2b1a75ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:33.591082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef509955-028f-494c-97bb-19a2b1a75ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:33.591367 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef509955-028f-494c-97bb-19a2b1a75ef7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:33.592140 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef509955-028f-494c-97bb-19a2b1a75ef7 None admin] RBAC: Adding query filter params (role.id=118b6fc03d22492f83f70dd2da6b374d, scope.project.id=0372b5f500b44066a9e11389f07e647e, user.id=111441b2446544bfadabbd543f1f6fb3) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:33.592516 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef509955-028f-494c-97bb-19a2b1a75ef7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:33.594176 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef509955-028f-494c-97bb-19a2b1a75ef7 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:33.600479 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 65/134] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:05:33 2022] GET /identity/v3/role_assignments?user.id=111441b2446544bfadabbd543f1f6fb3&scope.project.id=0372b5f500b44066a9e11389f07e647e&role.id=118b6fc03d22492f83f70dd2da6b374d => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:33.601445 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef509955-028f-494c-97bb-19a2b1a75ef7 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:33.612179 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 70/135] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Sep 6 20:05:33 2022] PUT /identity/v3/projects/0372b5f500b44066a9e11389f07e647e/users/e3a2729e92ec4f42844ed3a9746d1b14/roles/8ad4b0e0a5384306acd6d162f21dcd3d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:05:33.625308 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:33.631505 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52b63c-28ee-454d-8de4-cf76ea416674 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:33.631813 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52b63c-28ee-454d-8de4-cf76ea416674 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:33.632067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52b63c-28ee-454d-8de4-cf76ea416674 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:33.633735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 71/136] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:05:33.642730 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a99a7e-88a0-4a22-ba43-496e53e58392 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:33.642730 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a99a7e-88a0-4a22-ba43-496e53e58392 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:33.642730 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a99a7e-88a0-4a22-ba43-496e53e58392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:33.664709 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-15a99a7e-88a0-4a22-ba43-496e53e58392 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:33.666255 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-15a99a7e-88a0-4a22-ba43-496e53e58392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:33.746797 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 72/137] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 20:05:33.763026 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef509955-028f-494c-97bb-19a2b1a75ef7 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:33.806160 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449a736-4865-4400-b03c-6e8c23b125af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:33.807364 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449a736-4865-4400-b03c-6e8c23b125af None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:33.807904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449a736-4865-4400-b03c-6e8c23b125af None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:33.808459 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449a736-4865-4400-b03c-6e8c23b125af None admin] PATH_INFO: `/v3/projects/1645b65690e848ccb77eb9ef2f091d98` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:33.810377 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449a736-4865-4400-b03c-6e8c23b125af None admin] RBAC: Authorizing `identity:get_project(project_id=1645b65690e848ccb77eb9ef2f091d98)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:33.812169 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449a736-4865-4400-b03c-6e8c23b125af None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:33.814659 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 66/138] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:05:33 2022] GET /identity/v3/projects/1645b65690e848ccb77eb9ef2f091d98 => generated 312 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:33.822079 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a99a7e-88a0-4a22-ba43-496e53e58392 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:33.835879 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:33.991156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a99a7e-88a0-4a22-ba43-496e53e58392 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:34.033728 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f50dc-a37c-485d-a136-b96b8a662a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:34.034484 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f50dc-a37c-485d-a136-b96b8a662a72 None admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:34.034775 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f50dc-a37c-485d-a136-b96b8a662a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:34.035048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f50dc-a37c-485d-a136-b96b8a662a72 None admin] PATH_INFO: `/v3/projects/1645b65690e848ccb77eb9ef2f091d98/users/e3a2729e92ec4f42844ed3a9746d1b14/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:34.037326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f50dc-a37c-485d-a136-b96b8a662a72 None admin] RBAC: Authorizing `identity:create_grant(project_id=1645b65690e848ccb77eb9ef2f091d98, user_id=e3a2729e92ec4f42844ed3a9746d1b14, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:34.038838 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f50dc-a37c-485d-a136-b96b8a662a72 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:34.101597 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449a736-4865-4400-b03c-6e8c23b125af None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:34.141446 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 73/139] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Sep 6 20:05:33 2022] PUT /identity/v3/projects/1645b65690e848ccb77eb9ef2f091d98/users/e3a2729e92ec4f42844ed3a9746d1b14/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:05:34.207792 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:34.233421 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449a736-4865-4400-b03c-6e8c23b125af None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:34.272111 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54431605-5e49-4c70-8667-f4d6ce08e8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:34.273117 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54431605-5e49-4c70-8667-f4d6ce08e8f5 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:34.273613 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54431605-5e49-4c70-8667-f4d6ce08e8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:34.274104 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54431605-5e49-4c70-8667-f4d6ce08e8f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:34.285836 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54431605-5e49-4c70-8667-f4d6ce08e8f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:34.291736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-54431605-5e49-4c70-8667-f4d6ce08e8f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:05:34.291736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:34.291736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:34.291736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:34.291736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:34.291736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:34.291736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:34.291736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:34.291736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:34.291736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:34.291736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:34.291736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:34.291736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:34.291736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:34.291736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:34.291736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:34.292699 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:34.292699 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:34.292699 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:34.292699 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:34.292699 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:34.292699 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:34.292699 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:34.292699 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:34.292699 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:34.292699 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:34.292699 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:34.292699 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:34.292699 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:34.292699 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:34.292699 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:34.292699 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:34.293555 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:34.293555 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:34.293555 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:34.293555 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:34.293555 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:34.293555 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:34.293555 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:34.293555 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:34.293555 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:34.293555 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:34.293555 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:05:34.293555 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:05:34.296158 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 67/140] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:05:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:05:34.304540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f50dc-a37c-485d-a136-b96b8a662a72 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:34.415824 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:34.458105 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f50dc-a37c-485d-a136-b96b8a662a72 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:34.509303 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cc284-6c17-4670-affd-6720b36da810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:34.509968 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cc284-6c17-4670-affd-6720b36da810 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:34.510317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cc284-6c17-4670-affd-6720b36da810 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:34.510593 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cc284-6c17-4670-affd-6720b36da810 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:34.511329 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4cc284-6c17-4670-affd-6720b36da810 None admin] RBAC: Adding query filter params (name=member) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:34.511664 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4cc284-6c17-4670-affd-6720b36da810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:34.513094 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4cc284-6c17-4670-affd-6720b36da810 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:34.523310 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 74/141] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:05:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:34.533057 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54431605-5e49-4c70-8667-f4d6ce08e8f5 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:34.658416 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54431605-5e49-4c70-8667-f4d6ce08e8f5 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:34.694552 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957abbdc-a2c9-477a-9ec7-c3757a2acb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:34.695671 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957abbdc-a2c9-477a-9ec7-c3757a2acb2d None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:34.696197 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957abbdc-a2c9-477a-9ec7-c3757a2acb2d None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:34.696671 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957abbdc-a2c9-477a-9ec7-c3757a2acb2d None admin] PATH_INFO: `/v3/users/e3a2729e92ec4f42844ed3a9746d1b14` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:34.698042 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957abbdc-a2c9-477a-9ec7-c3757a2acb2d None admin] RBAC: Authorizing `identity:get_user(user_id=e3a2729e92ec4f42844ed3a9746d1b14)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:34.699724 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957abbdc-a2c9-477a-9ec7-c3757a2acb2d None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:34.701988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 68/142] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:34 2022] GET /identity/v3/users/e3a2729e92ec4f42844ed3a9746d1b14 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:34.707501 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cc284-6c17-4670-affd-6720b36da810 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:34.857774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cc284-6c17-4670-affd-6720b36da810 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:34.903850 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:34.910174 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1d96e-050a-4bfe-9abf-0e48c4892eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:34.910739 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1d96e-050a-4bfe-9abf-0e48c4892eab None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:34.911023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1d96e-050a-4bfe-9abf-0e48c4892eab None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:34.911299 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1d96e-050a-4bfe-9abf-0e48c4892eab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:35.084554 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1d96e-050a-4bfe-9abf-0e48c4892eab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:35.086064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1d96e-050a-4bfe-9abf-0e48c4892eab None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:35.404542 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 75/143] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:05:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 698 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:05:35.410993 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957abbdc-a2c9-477a-9ec7-c3757a2acb2d None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:35.440052 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:35.504247 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a862b-c9ea-456e-aa84-a04adb982f69 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:35.504520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a862b-c9ea-456e-aa84-a04adb982f69 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:35.504846 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a862b-c9ea-456e-aa84-a04adb982f69 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:35.506965 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 76/144] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:35.523617 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45685d2f-8caa-4d31-86a0-c615453e0e7b None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:35.524065 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45685d2f-8caa-4d31-86a0-c615453e0e7b None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:35.524347 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45685d2f-8caa-4d31-86a0-c615453e0e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:35.575534 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-45685d2f-8caa-4d31-86a0-c615453e0e7b None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:35.577474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-45685d2f-8caa-4d31-86a0-c615453e0e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:35.628035 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:35.700255 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957abbdc-a2c9-477a-9ec7-c3757a2acb2d None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:35.740311 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 77/145] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 20:05:35.758884 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ae3ea-9dca-45d4-8e38-fa504f72c8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:35.759542 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ae3ea-9dca-45d4-8e38-fa504f72c8ab None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:35.759827 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ae3ea-9dca-45d4-8e38-fa504f72c8ab None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:35.760100 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ae3ea-9dca-45d4-8e38-fa504f72c8ab None admin] PATH_INFO: `/v3/projects/0372b5f500b44066a9e11389f07e647e` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:35.764536 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ae3ea-9dca-45d4-8e38-fa504f72c8ab None admin] RBAC: Authorizing `identity:get_project(project_id=0372b5f500b44066a9e11389f07e647e)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:35.766638 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ae3ea-9dca-45d4-8e38-fa504f72c8ab None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:35.768353 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 69/146] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:05:35 2022] GET /identity/v3/projects/0372b5f500b44066a9e11389f07e647e => generated 298 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:35.774579 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45685d2f-8caa-4d31-86a0-c615453e0e7b None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:35.927493 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45685d2f-8caa-4d31-86a0-c615453e0e7b None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:35.979929 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373c71a-ef77-4659-8940-10d6a355edc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:35.980516 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373c71a-ef77-4659-8940-10d6a355edc5 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:35.980797 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373c71a-ef77-4659-8940-10d6a355edc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:35.981068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373c71a-ef77-4659-8940-10d6a355edc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:35.981816 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373c71a-ef77-4659-8940-10d6a355edc5 None admin] RBAC: Adding query filter params (role.id=d970607307684690803e8e97e2d39e8f, scope.project.id=0372b5f500b44066a9e11389f07e647e, user.id=e3a2729e92ec4f42844ed3a9746d1b14) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:35.982125 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373c71a-ef77-4659-8940-10d6a355edc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:35.983622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373c71a-ef77-4659-8940-10d6a355edc5 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:35.994733 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 78/147] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:05:35 2022] GET /identity/v3/role_assignments?user.id=e3a2729e92ec4f42844ed3a9746d1b14&scope.project.id=0372b5f500b44066a9e11389f07e647e&role.id=d970607307684690803e8e97e2d39e8f => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:36.174103 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68cb0a-a7b8-4481-bde7-9d4f8cdc45a9 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:36.174474 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68cb0a-a7b8-4481-bde7-9d4f8cdc45a9 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:36.174661 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68cb0a-a7b8-4481-bde7-9d4f8cdc45a9 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:36.176168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 70/148] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:36.182148 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13ed15-086b-433c-9ec3-165553d9d05c None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:36.182429 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13ed15-086b-433c-9ec3-165553d9d05c None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:36.182687 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13ed15-086b-433c-9ec3-165553d9d05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:36.212789 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-6f13ed15-086b-433c-9ec3-165553d9d05c None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:36.214048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6f13ed15-086b-433c-9ec3-165553d9d05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:36.238959 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:36.282446 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68cb0a-a7b8-4481-bde7-9d4f8cdc45a9 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:36.340919 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 79/149] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 20:05:36.380455 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:36.413169 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68cb0a-a7b8-4481-bde7-9d4f8cdc45a9 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:36.457116 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee114e6-c0c2-4c25-934d-a3b9f0dbb9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:36.458183 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee114e6-c0c2-4c25-934d-a3b9f0dbb9d8 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:36.458729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee114e6-c0c2-4c25-934d-a3b9f0dbb9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:36.459210 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee114e6-c0c2-4c25-934d-a3b9f0dbb9d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:36.460597 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee114e6-c0c2-4c25-934d-a3b9f0dbb9d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:36.462390 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee114e6-c0c2-4c25-934d-a3b9f0dbb9d8 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:36.464637 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 71/150] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:05:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:36.470530 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13ed15-086b-433c-9ec3-165553d9d05c None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:36.606142 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13ed15-086b-433c-9ec3-165553d9d05c None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:36.652296 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c65c4-ed2e-4a39-acf3-f336c596bc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:36.652925 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c65c4-ed2e-4a39-acf3-f336c596bc4a None admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:36.653206 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c65c4-ed2e-4a39-acf3-f336c596bc4a None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:36.653479 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c65c4-ed2e-4a39-acf3-f336c596bc4a None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:36.654149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c65c4-ed2e-4a39-acf3-f336c596bc4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:36.655630 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c65c4-ed2e-4a39-acf3-f336c596bc4a None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:36.732850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee114e6-c0c2-4c25-934d-a3b9f0dbb9d8 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:36.781309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 80/151] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Sep 6 20:05:36 2022] POST /identity/v3/users => generated 283 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:05:36.872860 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee114e6-c0c2-4c25-934d-a3b9f0dbb9d8 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:36.923912 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86071d8b-25a7-41d0-b606-ce19edcb73dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:36.924573 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86071d8b-25a7-41d0-b606-ce19edcb73dc None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:36.924852 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86071d8b-25a7-41d0-b606-ce19edcb73dc None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:36.925123 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86071d8b-25a7-41d0-b606-ce19edcb73dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:36.942002 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86071d8b-25a7-41d0-b606-ce19edcb73dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:36.947854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-86071d8b-25a7-41d0-b606-ce19edcb73dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:05:36.947854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:36.947854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:36.947854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:36.947854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:36.947854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:36.947854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:36.947854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:36.947854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:36.947854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:36.947854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:36.947854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:36.947854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:36.947854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:36.947854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:36.947854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:36.948773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:36.948773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:36.948773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:36.948773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:36.948773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:36.948773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:36.948773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:36.948773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:36.948773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:36.948773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:36.948773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:36.948773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:36.948773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:36.948773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:36.948773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:36.948773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:36.949540 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:36.949540 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:36.949540 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:36.949540 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:36.949540 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:36.949540 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:36.949540 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:36.949540 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:36.949540 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:36.949540 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:36.949540 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:05:36.949540 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:05:36.949540 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 72/152] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:05:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:05:36.955347 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c65c4-ed2e-4a39-acf3-f336c596bc4a None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:36.982259 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:37.054498 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e38683-e3d3-4163-9072-36a97d7227e0 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:37.054832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e38683-e3d3-4163-9072-36a97d7227e0 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:37.055051 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e38683-e3d3-4163-9072-36a97d7227e0 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:37.056918 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 73/153] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:37.062074 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26035b28-56b7-4474-887f-55497da9208c None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:37.062354 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26035b28-56b7-4474-887f-55497da9208c None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:37.062701 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26035b28-56b7-4474-887f-55497da9208c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:37.074067 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:37.092835 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-26035b28-56b7-4474-887f-55497da9208c None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:37.095217 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-26035b28-56b7-4474-887f-55497da9208c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:37.125941 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c65c4-ed2e-4a39-acf3-f336c596bc4a None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:37.177005 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f203ec-c0f8-4bbc-9156-e9591e806413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:37.177657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f203ec-c0f8-4bbc-9156-e9591e806413 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:37.177939 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f203ec-c0f8-4bbc-9156-e9591e806413 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:37.178215 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f203ec-c0f8-4bbc-9156-e9591e806413 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:37.178910 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f203ec-c0f8-4bbc-9156-e9591e806413 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:37.179217 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f203ec-c0f8-4bbc-9156-e9591e806413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:37.181152 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f203ec-c0f8-4bbc-9156-e9591e806413 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:37.195994 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 81/154] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:05:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:37.201576 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 74/155] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:37.201954 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f203ec-c0f8-4bbc-9156-e9591e806413 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:37.284145 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:37.313167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169e63a-a357-4d77-9478-fb4501db8dd1 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:37.313500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169e63a-a357-4d77-9478-fb4501db8dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:37.313711 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169e63a-a357-4d77-9478-fb4501db8dd1 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:37.316359 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 75/156] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:05:37.317701 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f203ec-c0f8-4bbc-9156-e9591e806413 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:37.322107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d51a0f-addf-4005-9b32-eeba3ca203a2 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:37.322387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d51a0f-addf-4005-9b32-eeba3ca203a2 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:37.322663 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d51a0f-addf-4005-9b32-eeba3ca203a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:37.345054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-b9d51a0f-addf-4005-9b32-eeba3ca203a2 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:37.346326 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-b9d51a0f-addf-4005-9b32-eeba3ca203a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:37.355705 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60724055-3f27-453c-94c0-9bbb80fff087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:37.356438 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60724055-3f27-453c-94c0-9bbb80fff087 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:37.356775 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60724055-3f27-453c-94c0-9bbb80fff087 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:37.357210 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60724055-3f27-453c-94c0-9bbb80fff087 None admin] PATH_INFO: `/v3/users/fb0b86a646b84622872ed6d032fae507` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:37.359294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60724055-3f27-453c-94c0-9bbb80fff087 None admin] RBAC: Authorizing `identity:get_user(user_id=fb0b86a646b84622872ed6d032fae507)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:37.360969 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60724055-3f27-453c-94c0-9bbb80fff087 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:37.362626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 82/157] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:37 2022] GET /identity/v3/users/fb0b86a646b84622872ed6d032fae507 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:37.368531 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60724055-3f27-453c-94c0-9bbb80fff087 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:37.431016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 76/158] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 20:05:37.483648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60724055-3f27-453c-94c0-9bbb80fff087 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:37.518556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d51a0f-addf-4005-9b32-eeba3ca203a2 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:37.521732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdb52e-2b56-435c-bc1e-62affa328e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:37.522352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdb52e-2b56-435c-bc1e-62affa328e6a None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:37.522629 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdb52e-2b56-435c-bc1e-62affa328e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:37.522898 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdb52e-2b56-435c-bc1e-62affa328e6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:37.534711 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:37.607401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:37.637921 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcdb52e-2b56-435c-bc1e-62affa328e6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:37.639740 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcdb52e-2b56-435c-bc1e-62affa328e6a None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:37.662216 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d51a0f-addf-4005-9b32-eeba3ca203a2 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:37.703210 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839ed70-ad2e-4e95-a83b-0843d9cffb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:37.704806 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839ed70-ad2e-4e95-a83b-0843d9cffb92 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:37.705233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839ed70-ad2e-4e95-a83b-0843d9cffb92 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:37.705658 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839ed70-ad2e-4e95-a83b-0843d9cffb92 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:37.718854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839ed70-ad2e-4e95-a83b-0843d9cffb92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:37.724568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-8839ed70-ad2e-4e95-a83b-0843d9cffb92 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 20:05:37.724568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:37.724568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:37.724568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:37.724568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:37.724568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:37.724568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:37.724568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:37.724568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:37.724568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:37.724568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:37.724568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:37.724568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:37.724568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:37.724568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:37.724568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:37.725710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:37.725710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:37.725710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:37.725710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:37.725710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:37.725710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:37.725710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:37.725710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:37.725710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:37.725710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:37.725710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:37.725710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:37.725710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:37.725710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:37.725710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:37.725710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:37.726760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:37.726760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:37.726760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:37.726760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:37.726760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:37.726760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:37.726760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:37.726760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:37.726760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:37.726760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:37.726760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 20:05:37.726760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:05:37.729189 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 77/159] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:05:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:05:37.734831 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839ed70-ad2e-4e95-a83b-0843d9cffb92 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:37.750038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 83/160] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:05:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 20:05:37.756624 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdb52e-2b56-435c-bc1e-62affa328e6a None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:37.801406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:37.862401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839ed70-ad2e-4e95-a83b-0843d9cffb92 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:37.882342 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdb52e-2b56-435c-bc1e-62affa328e6a None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:37.895396 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:37.910016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b85ff7-b298-4758-80cf-11957a7ad80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:37.910999 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b85ff7-b298-4758-80cf-11957a7ad80f None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:37.911479 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b85ff7-b298-4758-80cf-11957a7ad80f None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:37.911950 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b85ff7-b298-4758-80cf-11957a7ad80f None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:37.912806 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b85ff7-b298-4758-80cf-11957a7ad80f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:37.913261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b85ff7-b298-4758-80cf-11957a7ad80f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:37.915126 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b85ff7-b298-4758-80cf-11957a7ad80f None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:37.924056 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba813b02-8364-4893-abb7-2688be52d6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:37.924496 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba813b02-8364-4893-abb7-2688be52d6fb None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:37.924773 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba813b02-8364-4893-abb7-2688be52d6fb None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:37.925044 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba813b02-8364-4893-abb7-2688be52d6fb None admin] PATH_INFO: `/v3/projects/0372b5f500b44066a9e11389f07e647e` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:37.926259 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba813b02-8364-4893-abb7-2688be52d6fb None admin] RBAC: Authorizing `identity:get_project(project_id=0372b5f500b44066a9e11389f07e647e)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:37.927857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba813b02-8364-4893-abb7-2688be52d6fb None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:37.928641 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 78/161] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:05:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:37.929593 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 84/162] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:05:37 2022] GET /identity/v3/projects/0372b5f500b44066a9e11389f07e647e => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:37.930282 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b85ff7-b298-4758-80cf-11957a7ad80f None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:37.934150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba813b02-8364-4893-abb7-2688be52d6fb None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:38.056043 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b85ff7-b298-4758-80cf-11957a7ad80f None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:38.056613 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba813b02-8364-4893-abb7-2688be52d6fb None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:38.069887 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:38.106594 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe2e70-d043-415f-bc8c-93409d77797e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:38.107326 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe2e70-d043-415f-bc8c-93409d77797e None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:38.107738 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe2e70-d043-415f-bc8c-93409d77797e None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:38.108091 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe2e70-d043-415f-bc8c-93409d77797e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:38.114246 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88884aa-7121-4443-9ec6-ad6411e47875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:38.115098 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88884aa-7121-4443-9ec6-ad6411e47875 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:38.115621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88884aa-7121-4443-9ec6-ad6411e47875 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:38.116063 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88884aa-7121-4443-9ec6-ad6411e47875 None admin] PATH_INFO: `/v3/users/111441b2446544bfadabbd543f1f6fb3` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:38.117378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88884aa-7121-4443-9ec6-ad6411e47875 None admin] RBAC: Authorizing `identity:get_user(user_id=111441b2446544bfadabbd543f1f6fb3)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:38.118980 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88884aa-7121-4443-9ec6-ad6411e47875 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:38.120670 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe2e70-d043-415f-bc8c-93409d77797e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:38.122035 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 85/163] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:37 2022] GET /identity/v3/users/111441b2446544bfadabbd543f1f6fb3 => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:38.123006 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88884aa-7121-4443-9ec6-ad6411e47875 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:38.127154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-b3fe2e70-d043-415f-bc8c-93409d77797e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 20:05:38.127154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:38.127154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:38.127154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:38.127154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:38.127154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:38.127154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:38.127154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:38.127154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:38.127154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:38.127154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:38.127154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:38.127154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:38.127154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:38.127154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:38.127154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:38.128566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:38.128566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:38.128566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:38.128566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:38.128566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:38.128566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:38.128566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:38.128566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:38.128566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:38.128566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:38.128566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:38.128566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:38.128566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:38.128566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:38.128566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:38.128566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:38.129614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:38.129614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:38.129614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:38.129614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:38.129614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:38.129614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:38.129614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:38.129614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:38.129614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:38.129614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:38.129614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 20:05:38.129614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:05:38.129614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 79/164] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Sep 6 20:05:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:05:38.130526 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958e203-97d8-473b-b6c8-d8976ac35ffb None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:38.130526 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958e203-97d8-473b-b6c8-d8976ac35ffb None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:38.130526 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958e203-97d8-473b-b6c8-d8976ac35ffb None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:38.132184 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 80/165] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:38.132459 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958e203-97d8-473b-b6c8-d8976ac35ffb None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:38.193304 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:38.263172 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88884aa-7121-4443-9ec6-ad6411e47875 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:38.265814 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958e203-97d8-473b-b6c8-d8976ac35ffb None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:38.306642 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dec11-c0d5-4217-9846-0d5cdf23a80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:38.307631 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dec11-c0d5-4217-9846-0d5cdf23a80e None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:38.308175 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dec11-c0d5-4217-9846-0d5cdf23a80e None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:38.308651 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dec11-c0d5-4217-9846-0d5cdf23a80e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:38.309594 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dec11-c0d5-4217-9846-0d5cdf23a80e None admin] RBAC: Adding query filter params (role.id=1e2ac44410664e6b8f42ab3c37e2643f, scope.project.id=0372b5f500b44066a9e11389f07e647e, user.id=fb0b86a646b84622872ed6d032fae507) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:38.310109 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dec11-c0d5-4217-9846-0d5cdf23a80e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:38.311940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dec11-c0d5-4217-9846-0d5cdf23a80e None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:38.315258 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4fecb-9d04-47ae-a2f6-4a8b41d77d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:38.316513 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4fecb-9d04-47ae-a2f6-4a8b41d77d8b None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:38.316794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4fecb-9d04-47ae-a2f6-4a8b41d77d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:38.317081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4fecb-9d04-47ae-a2f6-4a8b41d77d8b None admin] PATH_INFO: `/v3/projects/0372b5f500b44066a9e11389f07e647e` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:38.318495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4fecb-9d04-47ae-a2f6-4a8b41d77d8b None admin] RBAC: Authorizing `identity:get_project(project_id=0372b5f500b44066a9e11389f07e647e)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:38.320001 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4fecb-9d04-47ae-a2f6-4a8b41d77d8b None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:38.320674 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 86/166] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:05:38 2022] GET /identity/v3/role_assignments?user.id=fb0b86a646b84622872ed6d032fae507&scope.project.id=0372b5f500b44066a9e11389f07e647e&role.id=1e2ac44410664e6b8f42ab3c37e2643f => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:38.321660 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 81/167] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:05:38 2022] GET /identity/v3/projects/0372b5f500b44066a9e11389f07e647e => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:38.322183 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dec11-c0d5-4217-9846-0d5cdf23a80e None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:38.327856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdc0f8-1db7-43cb-bb77-5d4c67b3f3c1 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:38.328205 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdc0f8-1db7-43cb-bb77-5d4c67b3f3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:38.328520 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdc0f8-1db7-43cb-bb77-5d4c67b3f3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:38.354223 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-e0fdc0f8-1db7-43cb-bb77-5d4c67b3f3c1 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:38.355526 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-e0fdc0f8-1db7-43cb-bb77-5d4c67b3f3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:38.390476 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:38.462643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 82/168] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:38.463631 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdc0f8-1db7-43cb-bb77-5d4c67b3f3c1 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:38.479326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dec11-c0d5-4217-9846-0d5cdf23a80e None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:38.521902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36bd85-fad9-4b8a-9d8c-0e8624c8b377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:38.523340 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36bd85-fad9-4b8a-9d8c-0e8624c8b377 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:38.523959 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36bd85-fad9-4b8a-9d8c-0e8624c8b377 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:38.524439 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36bd85-fad9-4b8a-9d8c-0e8624c8b377 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:38.525335 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36bd85-fad9-4b8a-9d8c-0e8624c8b377 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:38.525865 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36bd85-fad9-4b8a-9d8c-0e8624c8b377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:38.526418 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:38.527717 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36bd85-fad9-4b8a-9d8c-0e8624c8b377 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:38.540088 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 87/169] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:05:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:38.546932 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36bd85-fad9-4b8a-9d8c-0e8624c8b377 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:38.599144 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdc0f8-1db7-43cb-bb77-5d4c67b3f3c1 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:38.639362 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4e4f2-7600-457b-8101-43ece245e651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:38.640032 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4e4f2-7600-457b-8101-43ece245e651 None admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:38.640310 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4e4f2-7600-457b-8101-43ece245e651 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:38.640583 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4e4f2-7600-457b-8101-43ece245e651 None admin] PATH_INFO: `/v3/projects/0372b5f500b44066a9e11389f07e647e/users/111441b2446544bfadabbd543f1f6fb3/roles/118b6fc03d22492f83f70dd2da6b374d` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:38.643166 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4e4f2-7600-457b-8101-43ece245e651 None admin] RBAC: Authorizing `identity:create_grant(project_id=0372b5f500b44066a9e11389f07e647e, user_id=111441b2446544bfadabbd543f1f6fb3, role_id=118b6fc03d22492f83f70dd2da6b374d)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:38.644781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4e4f2-7600-457b-8101-43ece245e651 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:38.678558 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:38.682355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36bd85-fad9-4b8a-9d8c-0e8624c8b377 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:38.720826 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c772a-271f-4361-b422-c45c6bf1ed0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:38.721824 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c772a-271f-4361-b422-c45c6bf1ed0a None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:38.722284 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c772a-271f-4361-b422-c45c6bf1ed0a None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:38.722755 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c772a-271f-4361-b422-c45c6bf1ed0a None admin] PATH_INFO: `/v3/users/e3a2729e92ec4f42844ed3a9746d1b14` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:38.724166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c772a-271f-4361-b422-c45c6bf1ed0a None admin] RBAC: Authorizing `identity:get_user(user_id=e3a2729e92ec4f42844ed3a9746d1b14)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:38.725830 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c772a-271f-4361-b422-c45c6bf1ed0a None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:38.727962 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 88/170] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:38 2022] GET /identity/v3/users/e3a2729e92ec4f42844ed3a9746d1b14 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:38.734550 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c772a-271f-4361-b422-c45c6bf1ed0a None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:38.759178 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 83/171] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Sep 6 20:05:38 2022] PUT /identity/v3/projects/0372b5f500b44066a9e11389f07e647e/users/111441b2446544bfadabbd543f1f6fb3/roles/118b6fc03d22492f83f70dd2da6b374d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:05:38.870641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c772a-271f-4361-b422-c45c6bf1ed0a None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:38.917216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4c7bf-4612-412a-9e4e-5bffdd61b19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:38.917845 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4c7bf-4612-412a-9e4e-5bffdd61b19f None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:38.918127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4c7bf-4612-412a-9e4e-5bffdd61b19f None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:38.918408 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4c7bf-4612-412a-9e4e-5bffdd61b19f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:38.969231 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:39.015024 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4c7bf-4612-412a-9e4e-5bffdd61b19f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:39.017302 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4c7bf-4612-412a-9e4e-5bffdd61b19f None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:39.122949 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4e4f2-7600-457b-8101-43ece245e651 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:39.145301 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 89/172] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:05:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 20:05:39.152078 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4c7bf-4612-412a-9e4e-5bffdd61b19f None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:39.279827 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:39.327429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4e4f2-7600-457b-8101-43ece245e651 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:39.330390 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:39.336011 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4c7bf-4612-412a-9e4e-5bffdd61b19f None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:39.369646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd5a7d-e3ec-43f9-a270-228c5286387a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:39.369646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd5a7d-e3ec-43f9-a270-228c5286387a None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:39.369646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd5a7d-e3ec-43f9-a270-228c5286387a None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:39.369646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd5a7d-e3ec-43f9-a270-228c5286387a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:39.389525 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd5a7d-e3ec-43f9-a270-228c5286387a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:39.396599 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-70cd5a7d-e3ec-43f9-a270-228c5286387a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:05:39.396599 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:39.396599 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:39.396599 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:39.396599 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:39.396599 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:39.396599 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:39.396599 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:39.396599 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:39.396599 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:39.396599 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:39.396599 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:39.396599 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:39.396599 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:39.396599 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:39.396599 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:39.397492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:39.397492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:39.397492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:39.397492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:39.397492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:39.397492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:39.397492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:39.397492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:39.397492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:39.397492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:39.397492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:39.397492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:39.397492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:39.397492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:39.397492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:39.397492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:39.398265 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:39.398265 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:39.398265 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:39.398265 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:39.398265 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:39.398265 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:39.398265 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:39.398265 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:39.398265 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:39.398265 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:39.398265 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:05:39.398265 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:05:39.398265 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 84/173] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:05:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:05:39.407020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3b297-52eb-4eba-bfe0-9f4c7a27ac8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:39.408132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3b297-52eb-4eba-bfe0-9f4c7a27ac8e None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:39.408627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3b297-52eb-4eba-bfe0-9f4c7a27ac8e None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:39.409091 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3b297-52eb-4eba-bfe0-9f4c7a27ac8e None admin] PATH_INFO: `/v3/projects/0372b5f500b44066a9e11389f07e647e` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:39.411690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3b297-52eb-4eba-bfe0-9f4c7a27ac8e None admin] RBAC: Authorizing `identity:get_project(project_id=0372b5f500b44066a9e11389f07e647e)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:39.411959 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd5a7d-e3ec-43f9-a270-228c5286387a None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:39.413715 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3b297-52eb-4eba-bfe0-9f4c7a27ac8e None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:39.415946 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 90/174] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:05:39 2022] GET /identity/v3/projects/0372b5f500b44066a9e11389f07e647e => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:39.423248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3b297-52eb-4eba-bfe0-9f4c7a27ac8e None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:39.538039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3b297-52eb-4eba-bfe0-9f4c7a27ac8e None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:39.577246 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f615c7-254f-4c46-9a10-868ad3725b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:39.578354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f615c7-254f-4c46-9a10-868ad3725b8c None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:39.578843 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f615c7-254f-4c46-9a10-868ad3725b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:39.579314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f615c7-254f-4c46-9a10-868ad3725b8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:39.580420 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f615c7-254f-4c46-9a10-868ad3725b8c None admin] RBAC: Adding query filter params (role.id=8ad4b0e0a5384306acd6d162f21dcd3d, scope.project.id=0372b5f500b44066a9e11389f07e647e, user.id=e3a2729e92ec4f42844ed3a9746d1b14) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:39.580990 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f615c7-254f-4c46-9a10-868ad3725b8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:39.582728 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f615c7-254f-4c46-9a10-868ad3725b8c None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:39.586411 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:39.588486 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd5a7d-e3ec-43f9-a270-228c5286387a None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:39.591406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 91/175] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:05:39 2022] GET /identity/v3/role_assignments?user.id=e3a2729e92ec4f42844ed3a9746d1b14&scope.project.id=0372b5f500b44066a9e11389f07e647e&role.id=8ad4b0e0a5384306acd6d162f21dcd3d => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:39.634311 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192ce49-57d9-4ac4-a0f2-669dfe5a9960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:39.634959 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192ce49-57d9-4ac4-a0f2-669dfe5a9960 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:39.635271 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192ce49-57d9-4ac4-a0f2-669dfe5a9960 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:39.635608 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192ce49-57d9-4ac4-a0f2-669dfe5a9960 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:39.636371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192ce49-57d9-4ac4-a0f2-669dfe5a9960 None admin] RBAC: Adding query filter params (name=member) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:39.636684 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192ce49-57d9-4ac4-a0f2-669dfe5a9960 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:39.638149 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192ce49-57d9-4ac4-a0f2-669dfe5a9960 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:39.648116 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 85/176] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:05:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:39.655219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f615c7-254f-4c46-9a10-868ad3725b8c None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:39.804082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f615c7-254f-4c46-9a10-868ad3725b8c None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:39.857755 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf500bf-4f31-4cfe-abe2-ed5fb7d2b3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:39.858398 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf500bf-4f31-4cfe-abe2-ed5fb7d2b3a8 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:39.858676 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf500bf-4f31-4cfe-abe2-ed5fb7d2b3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:39.858945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf500bf-4f31-4cfe-abe2-ed5fb7d2b3a8 None admin] PATH_INFO: `/v3/users/e3a2729e92ec4f42844ed3a9746d1b14` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:39.864284 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf500bf-4f31-4cfe-abe2-ed5fb7d2b3a8 None admin] RBAC: Authorizing `identity:get_user(user_id=e3a2729e92ec4f42844ed3a9746d1b14)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:39.866627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf500bf-4f31-4cfe-abe2-ed5fb7d2b3a8 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:39.868558 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 92/177] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:39 2022] GET /identity/v3/users/e3a2729e92ec4f42844ed3a9746d1b14 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:39.874004 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192ce49-57d9-4ac4-a0f2-669dfe5a9960 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:39.909380 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:40.025640 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192ce49-57d9-4ac4-a0f2-669dfe5a9960 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:40.079998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d281a6-3626-447c-8773-283e0feef36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:40.080690 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d281a6-3626-447c-8773-283e0feef36c None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:40.080970 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d281a6-3626-447c-8773-283e0feef36c None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:40.081236 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d281a6-3626-447c-8773-283e0feef36c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:40.180624 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d281a6-3626-447c-8773-283e0feef36c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:40.182006 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d281a6-3626-447c-8773-283e0feef36c None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:40.215083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:40.309561 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 86/178] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:05:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:05:40.315265 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf500bf-4f31-4cfe-abe2-ed5fb7d2b3a8 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:40.403256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:40.447287 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf500bf-4f31-4cfe-abe2-ed5fb7d2b3a8 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:40.562419 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacb0e2-0457-420a-af0e-260091a18d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:40.563785 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacb0e2-0457-420a-af0e-260091a18d6d None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:40.563965 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacb0e2-0457-420a-af0e-260091a18d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:40.564283 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacb0e2-0457-420a-af0e-260091a18d6d None admin] PATH_INFO: `/v3/projects/1645b65690e848ccb77eb9ef2f091d98` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:40.565445 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcacb0e2-0457-420a-af0e-260091a18d6d None admin] RBAC: Authorizing `identity:get_project(project_id=1645b65690e848ccb77eb9ef2f091d98)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:40.566933 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcacb0e2-0457-420a-af0e-260091a18d6d None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:40.568808 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 93/179] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:05:40 2022] GET /identity/v3/projects/1645b65690e848ccb77eb9ef2f091d98 => generated 312 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:40.574755 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d281a6-3626-447c-8773-283e0feef36c None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:40.710583 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d281a6-3626-447c-8773-283e0feef36c None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:40.738461 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:40.751062 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25321960-f1ad-4d54-b8ce-2ede3172d8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:40.755215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25321960-f1ad-4d54-b8ce-2ede3172d8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:40.755215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25321960-f1ad-4d54-b8ce-2ede3172d8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:40.755215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25321960-f1ad-4d54-b8ce-2ede3172d8c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:40.755215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25321960-f1ad-4d54-b8ce-2ede3172d8c2 None admin] RBAC: Adding query filter params (role.id=d970607307684690803e8e97e2d39e8f, scope.project.id=1645b65690e848ccb77eb9ef2f091d98, user.id=e3a2729e92ec4f42844ed3a9746d1b14) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:40.755215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25321960-f1ad-4d54-b8ce-2ede3172d8c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:40.755215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25321960-f1ad-4d54-b8ce-2ede3172d8c2 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:40.761529 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 87/180] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:05:40 2022] GET /identity/v3/role_assignments?user.id=e3a2729e92ec4f42844ed3a9746d1b14&scope.project.id=1645b65690e848ccb77eb9ef2f091d98&role.id=d970607307684690803e8e97e2d39e8f => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:40.866790 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918d405-8df6-4ffc-9858-87b54221d7c3 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:40.867111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918d405-8df6-4ffc-9858-87b54221d7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:40.867353 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918d405-8df6-4ffc-9858-87b54221d7c3 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:40.869135 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 94/181] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:40.875076 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f697fc-2b24-47a9-b24d-eb654fb134b3 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:40.876156 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f697fc-2b24-47a9-b24d-eb654fb134b3 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:40.876370 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f697fc-2b24-47a9-b24d-eb654fb134b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:40.900059 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-c3f697fc-2b24-47a9-b24d-eb654fb134b3 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:40.901285 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-c3f697fc-2b24-47a9-b24d-eb654fb134b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:40.980374 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 88/182] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:41.253574 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f2152-c9f7-430b-ba51-05f27b132424 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:41.253909 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f2152-c9f7-430b-ba51-05f27b132424 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:41.254026 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f2152-c9f7-430b-ba51-05f27b132424 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:41.255407 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 95/183] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:41.261773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c89f5c-5295-40e7-be3e-111d18c3e83e None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:41.262045 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c89f5c-5295-40e7-be3e-111d18c3e83e None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:41.262316 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c89f5c-5295-40e7-be3e-111d18c3e83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:41.275719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f2152-c9f7-430b-ba51-05f27b132424 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:41.287995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-b9c89f5c-5295-40e7-be3e-111d18c3e83e None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:41.289298 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-b9c89f5c-5295-40e7-be3e-111d18c3e83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:41.367363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 89/184] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:41.368652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77b41d-1448-4619-b343-75e727990c4f None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:41.368936 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77b41d-1448-4619-b343-75e727990c4f None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:41.369324 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77b41d-1448-4619-b343-75e727990c4f None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:41.370769 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 90/185] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:41.376812 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b355e-67af-434f-acbd-b0b32f08f8e5 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:41.377096 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b355e-67af-434f-acbd-b0b32f08f8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:41.377622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b355e-67af-434f-acbd-b0b32f08f8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:41.398020 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-ab2b355e-67af-434f-acbd-b0b32f08f8e5 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:41.399514 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ab2b355e-67af-434f-acbd-b0b32f08f8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:41.409059 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f2152-c9f7-430b-ba51-05f27b132424 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:41.449535 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bc331-721e-4382-b834-f46b0111fde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:41.450175 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bc331-721e-4382-b834-f46b0111fde2 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:41.450459 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bc331-721e-4382-b834-f46b0111fde2 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:41.450735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bc331-721e-4382-b834-f46b0111fde2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:41.453674 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:41.458782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:41.464759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92bc331-721e-4382-b834-f46b0111fde2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:41.470684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-e92bc331-721e-4382-b834-f46b0111fde2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:05:41.470684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:41.470684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:41.470684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:41.470684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:41.470684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:41.470684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:41.470684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:41.470684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:41.470684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:41.470684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:41.470684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:41.470684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:41.470684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:41.470684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:41.470684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:41.473475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:41.473475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:41.473475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:41.473475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:41.473475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:41.473475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:41.473475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:41.473475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:41.473475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:41.473475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:41.473475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:41.473475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:41.473475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:41.473475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:41.473475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:41.473475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:41.474439 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:41.474439 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:41.474439 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:41.474439 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:41.474439 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:41.474439 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:41.474439 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:41.474439 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:41.474439 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:41.474439 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:41.474439 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:05:41.474439 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:05:41.474439 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 96/186] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:05:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:05:41.477937 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bc331-721e-4382-b834-f46b0111fde2 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:41.491074 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 91/187] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:41.592391 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bc331-721e-4382-b834-f46b0111fde2 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:41.629064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9d775-9254-4116-b027-c362ad293620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:41.629921 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9d775-9254-4116-b027-c362ad293620 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:41.630338 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9d775-9254-4116-b027-c362ad293620 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:41.630742 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9d775-9254-4116-b027-c362ad293620 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:41.631575 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9d775-9254-4116-b027-c362ad293620 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:41.632046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9d775-9254-4116-b027-c362ad293620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:41.633663 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9d775-9254-4116-b027-c362ad293620 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:41.643820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 97/188] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:05:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:41.646737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b355e-67af-434f-acbd-b0b32f08f8e5 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:41.657039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9d775-9254-4116-b027-c362ad293620 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:41.735838 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:41.776219 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b355e-67af-434f-acbd-b0b32f08f8e5 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:41.789356 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9d775-9254-4116-b027-c362ad293620 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:41.824488 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b57eb-a187-43db-8a48-7589f7002b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:41.827781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b57eb-a187-43db-8a48-7589f7002b82 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:41.827905 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb43b6-5853-4c59-9378-cabf1b5a48f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:41.827994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b57eb-a187-43db-8a48-7589f7002b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:41.827994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b57eb-a187-43db-8a48-7589f7002b82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:41.828114 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb43b6-5853-4c59-9378-cabf1b5a48f7 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:41.828114 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb43b6-5853-4c59-9378-cabf1b5a48f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:41.828114 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb43b6-5853-4c59-9378-cabf1b5a48f7 None admin] PATH_INFO: `/v3/users/f6ecae90436c475b9f3f943aabaf1d5d` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:41.832313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b57eb-a187-43db-8a48-7589f7002b82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:41.833890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b57eb-a187-43db-8a48-7589f7002b82 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:41.836329 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 92/189] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:05:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:41.837376 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b57eb-a187-43db-8a48-7589f7002b82 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:41.847948 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb43b6-5853-4c59-9378-cabf1b5a48f7 None admin] RBAC: Authorizing `identity:get_user(user_id=f6ecae90436c475b9f3f943aabaf1d5d)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:41.849153 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb43b6-5853-4c59-9378-cabf1b5a48f7 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:41.851021 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 98/190] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:41 2022] GET /identity/v3/users/f6ecae90436c475b9f3f943aabaf1d5d => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:41.851739 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb43b6-5853-4c59-9378-cabf1b5a48f7 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:41.901267 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:41.966333 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb43b6-5853-4c59-9378-cabf1b5a48f7 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:41.966803 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b57eb-a187-43db-8a48-7589f7002b82 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:41.984048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:42.003022 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7cd665-1c47-4756-ae11-2aa1656f60f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:42.003686 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cd665-1c47-4756-ae11-2aa1656f60f2 None admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:42.003973 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cd665-1c47-4756-ae11-2aa1656f60f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:42.004231 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cd665-1c47-4756-ae11-2aa1656f60f2 None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:42.004889 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7cd665-1c47-4756-ae11-2aa1656f60f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:42.006330 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7cd665-1c47-4756-ae11-2aa1656f60f2 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:42.014657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdece0-31da-4fef-886f-572b7dd3cc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:42.016616 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdece0-31da-4fef-886f-572b7dd3cc5e None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:42.017533 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdece0-31da-4fef-886f-572b7dd3cc5e None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:42.018019 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdece0-31da-4fef-886f-572b7dd3cc5e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:42.029428 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdece0-31da-4fef-886f-572b7dd3cc5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:42.034866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-eccdece0-31da-4fef-886f-572b7dd3cc5e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 20:05:42.034866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:42.034866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:42.034866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:42.034866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:42.034866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:42.034866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:42.034866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:42.034866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:42.034866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:42.034866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:42.034866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:42.034866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:42.034866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:42.034866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:42.034866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:42.035963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:42.035963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:42.035963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:42.035963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:42.035963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:42.035963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:42.035963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:42.035963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:42.035963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:42.035963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:42.035963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:42.035963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:42.035963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:42.035963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:42.035963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:42.035963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:42.036938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:42.036938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:42.036938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:42.036938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:42.036938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:42.036938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:42.036938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:42.036938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:42.036938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:42.036938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:42.036938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 20:05:42.036938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:05:42.036938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 93/191] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Sep 6 20:05:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:05:42.038717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdece0-31da-4fef-886f-572b7dd3cc5e None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:42.146298 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdece0-31da-4fef-886f-572b7dd3cc5e None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:42.153792 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:42.155581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 99/192] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Sep 6 20:05:41 2022] POST /identity/v3/users => generated 297 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:05:42.157036 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5aea6-9456-4640-a484-b7ec11051fe1 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:42.157322 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5aea6-9456-4640-a484-b7ec11051fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:42.157634 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5aea6-9456-4640-a484-b7ec11051fe1 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:42.159091 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 100/193] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:42.159807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5aea6-9456-4640-a484-b7ec11051fe1 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:42.195125 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d224248-b53e-4669-ba63-b054fabaa065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:42.195912 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d224248-b53e-4669-ba63-b054fabaa065 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:42.196088 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d224248-b53e-4669-ba63-b054fabaa065 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:42.196345 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d224248-b53e-4669-ba63-b054fabaa065 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:42.278652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d224248-b53e-4669-ba63-b054fabaa065 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:42.280222 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d224248-b53e-4669-ba63-b054fabaa065 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:42.290457 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5aea6-9456-4640-a484-b7ec11051fe1 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:42.331409 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af39b8d-f29b-4e1f-8ae2-092eac96d1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:42.332053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af39b8d-f29b-4e1f-8ae2-092eac96d1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:42.332332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af39b8d-f29b-4e1f-8ae2-092eac96d1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:42.333148 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af39b8d-f29b-4e1f-8ae2-092eac96d1d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:42.333841 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af39b8d-f29b-4e1f-8ae2-092eac96d1d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:42.334143 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af39b8d-f29b-4e1f-8ae2-092eac96d1d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:42.335971 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af39b8d-f29b-4e1f-8ae2-092eac96d1d1 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:42.347739 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 101/194] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:05:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:42.349676 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c477c-8af6-475c-bd80-6c1d7788db74 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:42.349925 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c477c-8af6-475c-bd80-6c1d7788db74 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:42.350200 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c477c-8af6-475c-bd80-6c1d7788db74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:42.373077 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-022c477c-8af6-475c-bd80-6c1d7788db74 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:42.374283 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-022c477c-8af6-475c-bd80-6c1d7788db74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:42.408432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:42.417256 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 94/195] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:05:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:05:42.418462 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d224248-b53e-4669-ba63-b054fabaa065 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:42.428811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:42.466010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 102/196] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:42.466962 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c477c-8af6-475c-bd80-6c1d7788db74 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:42.578261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d224248-b53e-4669-ba63-b054fabaa065 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:42.603082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c477c-8af6-475c-bd80-6c1d7788db74 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:42.627284 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866a99a-b4de-4594-8717-48108d3435b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:42.628292 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866a99a-b4de-4594-8717-48108d3435b7 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:42.628582 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866a99a-b4de-4594-8717-48108d3435b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:42.628859 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866a99a-b4de-4594-8717-48108d3435b7 None admin] PATH_INFO: `/v3/users/f6ecae90436c475b9f3f943aabaf1d5d` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:42.630226 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866a99a-b4de-4594-8717-48108d3435b7 None admin] RBAC: Authorizing `identity:get_user(user_id=f6ecae90436c475b9f3f943aabaf1d5d)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:42.632912 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866a99a-b4de-4594-8717-48108d3435b7 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:42.634818 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 95/197] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:42 2022] GET /identity/v3/users/f6ecae90436c475b9f3f943aabaf1d5d => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:42.641773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866a99a-b4de-4594-8717-48108d3435b7 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:42.650820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311101b7-c5f3-439c-83f3-cd9de742abcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:42.651526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311101b7-c5f3-439c-83f3-cd9de742abcf None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:42.651803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311101b7-c5f3-439c-83f3-cd9de742abcf None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:42.652070 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311101b7-c5f3-439c-83f3-cd9de742abcf None admin] PATH_INFO: `/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:42.653204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311101b7-c5f3-439c-83f3-cd9de742abcf None admin] RBAC: Authorizing `identity:get_project(project_id=f882e970082a40b2ad1a0f258ad7e3ba)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:42.655057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311101b7-c5f3-439c-83f3-cd9de742abcf None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:42.657201 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 103/198] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:05:42 2022] GET /identity/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:42.668803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311101b7-c5f3-439c-83f3-cd9de742abcf None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:42.746320 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:42.749066 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:42.778441 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866a99a-b4de-4594-8717-48108d3435b7 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:42.823474 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c61018-feee-4a72-b1a4-742b50bb62f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:42.823474 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c61018-feee-4a72-b1a4-742b50bb62f8 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:42.823474 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c61018-feee-4a72-b1a4-742b50bb62f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:42.823474 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c61018-feee-4a72-b1a4-742b50bb62f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:42.900818 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311101b7-c5f3-439c-83f3-cd9de742abcf None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:42.913642 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c61018-feee-4a72-b1a4-742b50bb62f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:42.915969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c61018-feee-4a72-b1a4-742b50bb62f8 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:42.948537 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed20cc-8e7c-4e12-a3b7-8346a1074bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:42.949339 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed20cc-8e7c-4e12-a3b7-8346a1074bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:42.949623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed20cc-8e7c-4e12-a3b7-8346a1074bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:42.949897 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed20cc-8e7c-4e12-a3b7-8346a1074bf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:42.950631 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed20cc-8e7c-4e12-a3b7-8346a1074bf9 None admin] RBAC: Adding query filter params (role.id=1e2ac44410664e6b8f42ab3c37e2643f, scope.project.id=f882e970082a40b2ad1a0f258ad7e3ba, user.id=f6ecae90436c475b9f3f943aabaf1d5d) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:42.950940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed20cc-8e7c-4e12-a3b7-8346a1074bf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:42.954050 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed20cc-8e7c-4e12-a3b7-8346a1074bf9 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:42.960009 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 104/199] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:05:42 2022] GET /identity/v3/role_assignments?user.id=f6ecae90436c475b9f3f943aabaf1d5d&scope.project.id=f882e970082a40b2ad1a0f258ad7e3ba&role.id=1e2ac44410664e6b8f42ab3c37e2643f => generated 259 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:42.968503 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed20cc-8e7c-4e12-a3b7-8346a1074bf9 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:43.021760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:43.086380 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 96/200] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:05:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:05:43.092514 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c61018-feee-4a72-b1a4-742b50bb62f8 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:43.190351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:43.193468 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed20cc-8e7c-4e12-a3b7-8346a1074bf9 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:43.246007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8108d-b5d8-4308-a4bd-613fca318f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:43.247129 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8108d-b5d8-4308-a4bd-613fca318f22 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:43.248119 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8108d-b5d8-4308-a4bd-613fca318f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:43.248693 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8108d-b5d8-4308-a4bd-613fca318f22 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:43.262445 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8108d-b5d8-4308-a4bd-613fca318f22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:43.268332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-04a8108d-b5d8-4308-a4bd-613fca318f22 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 20:05:43.268332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:43.268332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:43.268332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:43.268332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:43.268332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:43.268332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:43.268332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:43.268332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:43.268332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:43.268332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:43.268332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:43.268332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:43.268332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:43.268332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:43.268332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:43.269449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:43.269449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:43.269449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:43.269449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:43.269449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:43.269449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:43.269449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:43.269449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:43.269449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:43.269449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:43.269449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:43.269449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:43.269449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:43.269449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:43.269449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:43.269449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:43.270324 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:43.270324 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:43.270324 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:43.270324 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:43.270324 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:43.270324 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:43.270324 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:43.270324 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:43.270324 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:43.270324 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:43.270324 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 20:05:43.270324 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:05:43.272884 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 105/201] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:05:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:05:43.279210 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8108d-b5d8-4308-a4bd-613fca318f22 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:43.299956 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c61018-feee-4a72-b1a4-742b50bb62f8 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:43.392893 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6895ad-5fbd-43b2-b38b-1beec8161604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:43.393673 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6895ad-5fbd-43b2-b38b-1beec8161604 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:43.393953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6895ad-5fbd-43b2-b38b-1beec8161604 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:43.394235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6895ad-5fbd-43b2-b38b-1beec8161604 None admin] PATH_INFO: `/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:43.397602 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6895ad-5fbd-43b2-b38b-1beec8161604 None admin] RBAC: Authorizing `identity:get_project(project_id=f882e970082a40b2ad1a0f258ad7e3ba)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:43.399270 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6895ad-5fbd-43b2-b38b-1beec8161604 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:43.402422 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 97/202] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:05:43 2022] GET /identity/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba => generated 302 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:43.405569 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8108d-b5d8-4308-a4bd-613fca318f22 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:43.408279 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6895ad-5fbd-43b2-b38b-1beec8161604 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:43.456087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc1136-353f-4b55-9662-3800cee248f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:43.457428 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc1136-353f-4b55-9662-3800cee248f5 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:43.457874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc1136-353f-4b55-9662-3800cee248f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:43.458301 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc1136-353f-4b55-9662-3800cee248f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:43.459193 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc1136-353f-4b55-9662-3800cee248f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:43.460228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc1136-353f-4b55-9662-3800cee248f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:43.462096 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc1136-353f-4b55-9662-3800cee248f5 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:43.474320 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 106/203] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:05:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:43.486298 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc1136-353f-4b55-9662-3800cee248f5 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:43.505043 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:43.539827 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:43.610315 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc1136-353f-4b55-9662-3800cee248f5 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:43.681639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6895ad-5fbd-43b2-b38b-1beec8161604 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:43.686875 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a30b3-f602-4701-9c16-d4ce7e9c3e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:43.688098 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a30b3-f602-4701-9c16-d4ce7e9c3e56 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:43.688373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a30b3-f602-4701-9c16-d4ce7e9c3e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:43.688641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a30b3-f602-4701-9c16-d4ce7e9c3e56 None admin] PATH_INFO: `/v3/users/111441b2446544bfadabbd543f1f6fb3` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:43.694880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a30b3-f602-4701-9c16-d4ce7e9c3e56 None admin] RBAC: Authorizing `identity:get_user(user_id=111441b2446544bfadabbd543f1f6fb3)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:43.696448 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a30b3-f602-4701-9c16-d4ce7e9c3e56 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:43.698446 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 107/204] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:43 2022] GET /identity/v3/users/111441b2446544bfadabbd543f1f6fb3 => generated 289 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:43.705125 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a30b3-f602-4701-9c16-d4ce7e9c3e56 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:43.779944 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b15c8-02ee-41aa-889d-92142a387e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:43.780924 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b15c8-02ee-41aa-889d-92142a387e6f None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:43.781690 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b15c8-02ee-41aa-889d-92142a387e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:43.782938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b15c8-02ee-41aa-889d-92142a387e6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:43.784962 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b15c8-02ee-41aa-889d-92142a387e6f None admin] RBAC: Adding query filter params (role.id=8ad4b0e0a5384306acd6d162f21dcd3d, scope.project.id=f882e970082a40b2ad1a0f258ad7e3ba, user.id=f6ecae90436c475b9f3f943aabaf1d5d) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:43.785483 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b15c8-02ee-41aa-889d-92142a387e6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:43.787316 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b15c8-02ee-41aa-889d-92142a387e6f None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:43.793838 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 98/205] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:05:43 2022] GET /identity/v3/role_assignments?user.id=f6ecae90436c475b9f3f943aabaf1d5d&scope.project.id=f882e970082a40b2ad1a0f258ad7e3ba&role.id=8ad4b0e0a5384306acd6d162f21dcd3d => generated 259 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:43.871968 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:43.892969 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a30b3-f602-4701-9c16-d4ce7e9c3e56 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:43.948657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d543aaf-c889-4559-aab1-407c13fef5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:43.949548 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d543aaf-c889-4559-aab1-407c13fef5ac None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:43.950003 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d543aaf-c889-4559-aab1-407c13fef5ac None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:43.950417 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d543aaf-c889-4559-aab1-407c13fef5ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:44.048058 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d543aaf-c889-4559-aab1-407c13fef5ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:44.049685 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d543aaf-c889-4559-aab1-407c13fef5ac None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:44.170798 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:44.193901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 108/206] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:05:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:05:44.199596 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b15c8-02ee-41aa-889d-92142a387e6f None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:44.309852 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b15c8-02ee-41aa-889d-92142a387e6f None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:44.336884 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:44.359580 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0d289-c7cb-48e4-b867-9b2648402748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:44.360288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0d289-c7cb-48e4-b867-9b2648402748 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:44.360572 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0d289-c7cb-48e4-b867-9b2648402748 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:44.360842 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0d289-c7cb-48e4-b867-9b2648402748 None admin] PATH_INFO: `/v3/projects/0372b5f500b44066a9e11389f07e647e` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:44.361995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0d289-c7cb-48e4-b867-9b2648402748 None admin] RBAC: Authorizing `identity:get_project(project_id=0372b5f500b44066a9e11389f07e647e)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:44.363459 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0d289-c7cb-48e4-b867-9b2648402748 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:44.365466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 99/207] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:05:44 2022] GET /identity/v3/projects/0372b5f500b44066a9e11389f07e647e => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:44.371362 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d543aaf-c889-4559-aab1-407c13fef5ac None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:44.518769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d543aaf-c889-4559-aab1-407c13fef5ac None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:44.564846 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf3ed7-6741-4c06-b7d8-bd86d3133380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:44.565358 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf3ed7-6741-4c06-b7d8-bd86d3133380 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:44.565638 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf3ed7-6741-4c06-b7d8-bd86d3133380 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:44.565905 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf3ed7-6741-4c06-b7d8-bd86d3133380 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:44.566630 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf3ed7-6741-4c06-b7d8-bd86d3133380 None admin] RBAC: Adding query filter params (role.id=118b6fc03d22492f83f70dd2da6b374d, scope.project.id=0372b5f500b44066a9e11389f07e647e, user.id=111441b2446544bfadabbd543f1f6fb3) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:44.566933 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf3ed7-6741-4c06-b7d8-bd86d3133380 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:44.568395 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf3ed7-6741-4c06-b7d8-bd86d3133380 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:44.578809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 109/208] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:05:44 2022] GET /identity/v3/role_assignments?user.id=111441b2446544bfadabbd543f1f6fb3&scope.project.id=0372b5f500b44066a9e11389f07e647e&role.id=118b6fc03d22492f83f70dd2da6b374d => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:45.005893 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286c30c-3181-42af-a656-b46bb61b1f8a None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:45.006263 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286c30c-3181-42af-a656-b46bb61b1f8a None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:45.006451 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286c30c-3181-42af-a656-b46bb61b1f8a None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:45.007821 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 100/209] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:45.014496 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d778ca4-42b2-455c-9220-9dff5409fb6a None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:45.015004 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d778ca4-42b2-455c-9220-9dff5409fb6a None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:45.015080 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d778ca4-42b2-455c-9220-9dff5409fb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:45.037089 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-1d778ca4-42b2-455c-9220-9dff5409fb6a None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:45.038287 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-1d778ca4-42b2-455c-9220-9dff5409fb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:45.072585 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53c270-f934-4132-8789-47358485d824 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:45.072864 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53c270-f934-4132-8789-47358485d824 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:45.073043 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53c270-f934-4132-8789-47358485d824 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:45.075325 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 101/210] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:45.101482 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc2732-0124-4a32-b689-e0845fdfdabd None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:45.101813 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc2732-0124-4a32-b689-e0845fdfdabd None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:45.102033 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc2732-0124-4a32-b689-e0845fdfdabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:45.109332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:45.128332 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-b2cc2732-0124-4a32-b689-e0845fdfdabd None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:45.129556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-b2cc2732-0124-4a32-b689-e0845fdfdabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:45.137460 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 110/211] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 20:05:45.212073 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 102/212] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:45.419702 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d778ca4-42b2-455c-9220-9dff5409fb6a None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:45.488674 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc2732-0124-4a32-b689-e0845fdfdabd None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:45.538952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d778ca4-42b2-455c-9220-9dff5409fb6a None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:45.579220 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095bd36-51a6-43be-ae56-85465dc35cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:45.580346 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095bd36-51a6-43be-ae56-85465dc35cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:45.580844 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095bd36-51a6-43be-ae56-85465dc35cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:45.581319 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095bd36-51a6-43be-ae56-85465dc35cf8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:45.582886 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095bd36-51a6-43be-ae56-85465dc35cf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:45.584608 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095bd36-51a6-43be-ae56-85465dc35cf8 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:45.586578 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 111/213] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:05:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:45.592670 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095bd36-51a6-43be-ae56-85465dc35cf8 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:45.603482 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc2732-0124-4a32-b689-e0845fdfdabd None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:45.606450 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:45.655935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156a0fc-12f6-436d-bcbf-07b6f642254f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:45.657199 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156a0fc-12f6-436d-bcbf-07b6f642254f None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:45.658122 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156a0fc-12f6-436d-bcbf-07b6f642254f None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:45.658427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156a0fc-12f6-436d-bcbf-07b6f642254f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:45.661961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:45.675407 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156a0fc-12f6-436d-bcbf-07b6f642254f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:45.682735 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-2156a0fc-12f6-436d-bcbf-07b6f642254f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:05:45.682735 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:45.682735 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:45.682735 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:45.682735 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:45.682735 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:45.682735 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:45.682735 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:45.682735 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:45.682735 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:45.682735 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:45.682735 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:45.682735 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:45.682735 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:45.682735 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:45.682735 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:45.683748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:45.683748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:45.683748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:45.683748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:45.683748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:45.683748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:45.683748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:45.683748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:45.683748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:45.683748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:45.683748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:45.683748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:45.683748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:45.683748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:45.683748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:45.683748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:45.684556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:45.684556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:45.684556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:45.684556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:45.684556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:45.684556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:45.684556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:45.684556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:45.684556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:45.684556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:45.684556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:05:45.684556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:05:45.684556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 103/214] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:05:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:05:45.690821 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156a0fc-12f6-436d-bcbf-07b6f642254f None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:45.742525 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095bd36-51a6-43be-ae56-85465dc35cf8 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:45.796722 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc934c97-e8dc-4155-83d7-847d889ca5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:45.797394 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc934c97-e8dc-4155-83d7-847d889ca5a5 None admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:45.797674 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc934c97-e8dc-4155-83d7-847d889ca5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:45.797946 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc934c97-e8dc-4155-83d7-847d889ca5a5 None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:45.798597 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc934c97-e8dc-4155-83d7-847d889ca5a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:45.800493 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc934c97-e8dc-4155-83d7-847d889ca5a5 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:45.834531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156a0fc-12f6-436d-bcbf-07b6f642254f None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:45.866294 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26b972-6237-43be-a429-6c56dad9cb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:45.866915 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26b972-6237-43be-a429-6c56dad9cb77 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:45.867195 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26b972-6237-43be-a429-6c56dad9cb77 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:45.867491 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26b972-6237-43be-a429-6c56dad9cb77 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:45.868172 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26b972-6237-43be-a429-6c56dad9cb77 None admin] RBAC: Adding query filter params (name=member) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:45.868477 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26b972-6237-43be-a429-6c56dad9cb77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:45.870109 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26b972-6237-43be-a429-6c56dad9cb77 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:45.880262 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 104/215] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:05:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:45.881570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b6914-d85b-4f17-8764-887d3c3d9808 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:45.881855 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b6914-d85b-4f17-8764-887d3c3d9808 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:45.882126 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b6914-d85b-4f17-8764-887d3c3d9808 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:45.883357 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 105/216] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:45.888243 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b6914-d85b-4f17-8764-887d3c3d9808 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:45.910406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 112/217] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Sep 6 20:05:45 2022] POST /identity/v3/users => generated 297 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:05:45.910406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3ea3b-d21f-4723-ba01-fbfe0e9e4ff5 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:45.910406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3ea3b-d21f-4723-ba01-fbfe0e9e4ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:45.910406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3ea3b-d21f-4723-ba01-fbfe0e9e4ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:45.928217 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:45.944991 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-b4b3ea3b-d21f-4723-ba01-fbfe0e9e4ff5 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:45.949182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-b4b3ea3b-d21f-4723-ba01-fbfe0e9e4ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:46.044473 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 113/218] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:46.052952 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b6914-d85b-4f17-8764-887d3c3d9808 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:46.095253 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65bd3df-918f-4019-b21c-6c0ad219a078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:46.095999 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bd3df-918f-4019-b21c-6c0ad219a078 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:46.096283 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bd3df-918f-4019-b21c-6c0ad219a078 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:46.096559 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bd3df-918f-4019-b21c-6c0ad219a078 None admin] PATH_INFO: `/v3/users/d8b798260f224ab0bd254196266bbf39` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:46.113292 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65bd3df-918f-4019-b21c-6c0ad219a078 None admin] RBAC: Authorizing `identity:get_user(user_id=d8b798260f224ab0bd254196266bbf39)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:46.114881 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65bd3df-918f-4019-b21c-6c0ad219a078 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:46.116856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 106/219] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:45 2022] GET /identity/v3/users/d8b798260f224ab0bd254196266bbf39 => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:46.122348 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3ea3b-d21f-4723-ba01-fbfe0e9e4ff5 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:46.169454 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:46.253980 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3ea3b-d21f-4723-ba01-fbfe0e9e4ff5 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:46.282015 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1f817-6944-4af1-89f1-548b0389f1a6 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:46.285354 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1f817-6944-4af1-89f1-548b0389f1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:46.285863 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1f817-6944-4af1-89f1-548b0389f1a6 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:46.287546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 107/220] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:46.295134 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32bef5-c647-41da-96fe-dd9f0b6e3bee None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:46.295727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32bef5-c647-41da-96fe-dd9f0b6e3bee None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:46.296149 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32bef5-c647-41da-96fe-dd9f0b6e3bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:46.299719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c79b31-8d53-4c4e-b64c-0c5085ed8660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:46.300470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c79b31-8d53-4c4e-b64c-0c5085ed8660 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:46.300749 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c79b31-8d53-4c4e-b64c-0c5085ed8660 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:46.301021 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c79b31-8d53-4c4e-b64c-0c5085ed8660 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:46.333891 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-ce32bef5-c647-41da-96fe-dd9f0b6e3bee None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:46.335497 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ce32bef5-c647-41da-96fe-dd9f0b6e3bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:46.386933 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c79b31-8d53-4c4e-b64c-0c5085ed8660 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:46.388491 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c79b31-8d53-4c4e-b64c-0c5085ed8660 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:46.425295 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 108/221] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:46.426088 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32bef5-c647-41da-96fe-dd9f0b6e3bee None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:46.443857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:46.453056 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:46.515767 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 114/222] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:05:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:05:46.521704 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c79b31-8d53-4c4e-b64c-0c5085ed8660 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:46.635089 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c79b31-8d53-4c4e-b64c-0c5085ed8660 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:46.675745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0dcfc7-e1a1-454a-b0d8-2e2315eb4dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:46.676394 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dcfc7-e1a1-454a-b0d8-2e2315eb4dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:46.676671 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dcfc7-e1a1-454a-b0d8-2e2315eb4dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:46.677539 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dcfc7-e1a1-454a-b0d8-2e2315eb4dc8 None admin] PATH_INFO: `/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:46.678746 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0dcfc7-e1a1-454a-b0d8-2e2315eb4dc8 None admin] RBAC: Authorizing `identity:get_project(project_id=f882e970082a40b2ad1a0f258ad7e3ba)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:46.680410 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0dcfc7-e1a1-454a-b0d8-2e2315eb4dc8 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:46.683475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 115/223] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:05:46 2022] GET /identity/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:46.690185 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0dcfc7-e1a1-454a-b0d8-2e2315eb4dc8 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:46.702632 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:46.763740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32bef5-c647-41da-96fe-dd9f0b6e3bee None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:46.814736 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0dcfc7-e1a1-454a-b0d8-2e2315eb4dc8 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:46.854685 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51357fbc-2df6-4f2b-a90e-464f7c770580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:46.855326 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51357fbc-2df6-4f2b-a90e-464f7c770580 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:46.855664 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51357fbc-2df6-4f2b-a90e-464f7c770580 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:46.855937 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51357fbc-2df6-4f2b-a90e-464f7c770580 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:46.856949 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f465b1b-e0c4-4d2a-8d8a-49a669026b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:46.858052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f465b1b-e0c4-4d2a-8d8a-49a669026b9c None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:46.858472 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f465b1b-e0c4-4d2a-8d8a-49a669026b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:46.859319 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f465b1b-e0c4-4d2a-8d8a-49a669026b9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:46.860251 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f465b1b-e0c4-4d2a-8d8a-49a669026b9c None admin] RBAC: Adding query filter params (role.id=d970607307684690803e8e97e2d39e8f, scope.project.id=f882e970082a40b2ad1a0f258ad7e3ba, user.id=d8b798260f224ab0bd254196266bbf39) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:46.860727 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f465b1b-e0c4-4d2a-8d8a-49a669026b9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:46.862632 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f465b1b-e0c4-4d2a-8d8a-49a669026b9c None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:46.868349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51357fbc-2df6-4f2b-a90e-464f7c770580 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:46.870243 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 116/224] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:05:46 2022] GET /identity/v3/role_assignments?user.id=d8b798260f224ab0bd254196266bbf39&scope.project.id=f882e970082a40b2ad1a0f258ad7e3ba&role.id=d970607307684690803e8e97e2d39e8f => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:46.875546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-51357fbc-2df6-4f2b-a90e-464f7c770580 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:05:46.875546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:46.875546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:46.875546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:46.875546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:46.875546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:46.875546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:46.875546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:46.875546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:46.875546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:46.875546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:46.875546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:46.875546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:46.875546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:46.875546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:46.875546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:46.876681 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:46.876681 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:46.876681 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:46.876681 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:46.876681 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:46.876681 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:46.876681 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:46.876681 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:46.876681 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:46.876681 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:46.876681 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:46.876681 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:46.876681 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:46.876681 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:46.876681 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:46.876681 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:46.877874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:46.877874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:46.877874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:46.877874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:46.877874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:46.877874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:46.877874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:46.877874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:46.877874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:46.877874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:46.877874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:05:46.877874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:05:46.877874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 109/225] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:05:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 449 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:05:46.879564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f465b1b-e0c4-4d2a-8d8a-49a669026b9c None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:46.881592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51357fbc-2df6-4f2b-a90e-464f7c770580 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:47.031947 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:47.046763 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:47.091036 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51357fbc-2df6-4f2b-a90e-464f7c770580 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:47.101892 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f465b1b-e0c4-4d2a-8d8a-49a669026b9c None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:47.158569 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a4d5c-3bf7-408b-8c87-a2f4f9181c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:47.159201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a4d5c-3bf7-408b-8c87-a2f4f9181c88 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:47.159502 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a4d5c-3bf7-408b-8c87-a2f4f9181c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:47.159775 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a4d5c-3bf7-408b-8c87-a2f4f9181c88 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:47.160468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a4d5c-3bf7-408b-8c87-a2f4f9181c88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:47.160772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a4d5c-3bf7-408b-8c87-a2f4f9181c88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:47.162238 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a4d5c-3bf7-408b-8c87-a2f4f9181c88 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:47.170360 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141bfc7-aa7b-4a39-b0a0-008300c0f635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:47.171466 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141bfc7-aa7b-4a39-b0a0-008300c0f635 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:47.171959 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141bfc7-aa7b-4a39-b0a0-008300c0f635 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:47.173004 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141bfc7-aa7b-4a39-b0a0-008300c0f635 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:47.173144 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 110/226] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:05:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:47.178847 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a4d5c-3bf7-408b-8c87-a2f4f9181c88 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:47.187650 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141bfc7-aa7b-4a39-b0a0-008300c0f635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:47.193262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-c141bfc7-aa7b-4a39-b0a0-008300c0f635 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 20:05:47.193262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:47.193262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:47.193262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:47.193262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:47.193262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:47.193262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:47.193262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:47.193262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:47.193262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:47.193262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:47.193262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:47.193262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:47.193262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:47.193262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:47.193262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:47.194399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:47.194399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:47.194399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:47.194399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:47.194399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:47.194399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:47.194399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:47.194399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:47.194399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:47.194399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:47.194399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:47.194399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:47.194399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:47.194399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:47.194399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:47.194399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:47.195344 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:47.195344 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:47.195344 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:47.195344 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:47.195344 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:47.195344 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:47.195344 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:47.195344 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:47.195344 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:47.195344 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:47.195344 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 20:05:47.195344 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:05:47.197555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 117/227] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Sep 6 20:05:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:05:47.203730 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141bfc7-aa7b-4a39-b0a0-008300c0f635 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:47.307414 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a4d5c-3bf7-408b-8c87-a2f4f9181c88 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:47.326637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141bfc7-aa7b-4a39-b0a0-008300c0f635 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:47.346580 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dea0ad-f93f-4df2-8992-86de66456883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:47.347309 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dea0ad-f93f-4df2-8992-86de66456883 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:47.347712 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dea0ad-f93f-4df2-8992-86de66456883 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:47.348086 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dea0ad-f93f-4df2-8992-86de66456883 None admin] PATH_INFO: `/v3/users/f6ecae90436c475b9f3f943aabaf1d5d` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:47.349393 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dea0ad-f93f-4df2-8992-86de66456883 None admin] RBAC: Authorizing `identity:get_user(user_id=f6ecae90436c475b9f3f943aabaf1d5d)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:47.350947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dea0ad-f93f-4df2-8992-86de66456883 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:47.352935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 111/228] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:47 2022] GET /identity/v3/users/f6ecae90436c475b9f3f943aabaf1d5d => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:47.358511 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dea0ad-f93f-4df2-8992-86de66456883 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:47.359881 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:47.371575 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571ea7d-dbcf-40e2-bd06-86fa724c0d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:47.372870 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571ea7d-dbcf-40e2-bd06-86fa724c0d23 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:47.373520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571ea7d-dbcf-40e2-bd06-86fa724c0d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:47.374089 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571ea7d-dbcf-40e2-bd06-86fa724c0d23 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:47.378162 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571ea7d-dbcf-40e2-bd06-86fa724c0d23 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:47.378162 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571ea7d-dbcf-40e2-bd06-86fa724c0d23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:47.378162 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571ea7d-dbcf-40e2-bd06-86fa724c0d23 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:47.380973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:47.387344 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 118/229] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:05:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:47.394272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571ea7d-dbcf-40e2-bd06-86fa724c0d23 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:47.475491 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dea0ad-f93f-4df2-8992-86de66456883 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:47.556148 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df40f8-2226-4193-8d1b-29da0cca2887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:47.557179 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df40f8-2226-4193-8d1b-29da0cca2887 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:47.557662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df40f8-2226-4193-8d1b-29da0cca2887 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:47.558190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df40f8-2226-4193-8d1b-29da0cca2887 None admin] PATH_INFO: `/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:47.564612 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df40f8-2226-4193-8d1b-29da0cca2887 None admin] RBAC: Authorizing `identity:get_project(project_id=f882e970082a40b2ad1a0f258ad7e3ba)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:47.567369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df40f8-2226-4193-8d1b-29da0cca2887 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:47.569711 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 112/230] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:05:47 2022] GET /identity/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:47.573608 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571ea7d-dbcf-40e2-bd06-86fa724c0d23 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:47.577138 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df40f8-2226-4193-8d1b-29da0cca2887 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:47.624546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af97109-8155-4612-8b4c-c57244899f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:47.627052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af97109-8155-4612-8b4c-c57244899f7a None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:47.627939 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af97109-8155-4612-8b4c-c57244899f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:47.629287 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af97109-8155-4612-8b4c-c57244899f7a None admin] PATH_INFO: `/v3/users/f6ecae90436c475b9f3f943aabaf1d5d` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:47.631209 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af97109-8155-4612-8b4c-c57244899f7a None admin] RBAC: Authorizing `identity:get_user(user_id=f6ecae90436c475b9f3f943aabaf1d5d)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:47.635512 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af97109-8155-4612-8b4c-c57244899f7a None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:47.643178 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 119/231] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:47 2022] GET /identity/v3/users/f6ecae90436c475b9f3f943aabaf1d5d => generated 283 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:47.647037 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af97109-8155-4612-8b4c-c57244899f7a None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:47.720008 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:47.751817 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:47.810625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af97109-8155-4612-8b4c-c57244899f7a None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:47.847000 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df40f8-2226-4193-8d1b-29da0cca2887 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:47.849756 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd099a-a6a1-479d-a2f5-e347a03286d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:47.850444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd099a-a6a1-479d-a2f5-e347a03286d6 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:47.850727 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd099a-a6a1-479d-a2f5-e347a03286d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:47.851005 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd099a-a6a1-479d-a2f5-e347a03286d6 None admin] PATH_INFO: `/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:47.852199 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd099a-a6a1-479d-a2f5-e347a03286d6 None admin] RBAC: Authorizing `identity:get_project(project_id=f882e970082a40b2ad1a0f258ad7e3ba)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:47.853752 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd099a-a6a1-479d-a2f5-e347a03286d6 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:47.855416 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 120/232] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:05:47 2022] GET /identity/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:47.864645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd099a-a6a1-479d-a2f5-e347a03286d6 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:47.956378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca8a66-8642-4d4c-aeb5-8e6d1f12ff3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:47.957177 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca8a66-8642-4d4c-aeb5-8e6d1f12ff3a None admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:47.957467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca8a66-8642-4d4c-aeb5-8e6d1f12ff3a None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:47.957752 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca8a66-8642-4d4c-aeb5-8e6d1f12ff3a None admin] PATH_INFO: `/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba/users/f6ecae90436c475b9f3f943aabaf1d5d/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:47.964400 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca8a66-8642-4d4c-aeb5-8e6d1f12ff3a None admin] RBAC: Authorizing `identity:create_grant(project_id=f882e970082a40b2ad1a0f258ad7e3ba, user_id=f6ecae90436c475b9f3f943aabaf1d5d, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:47.965911 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca8a66-8642-4d4c-aeb5-8e6d1f12ff3a None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:47.978825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd099a-a6a1-479d-a2f5-e347a03286d6 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:48.006925 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:48.018468 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0c27f-be1e-483b-9592-1ee0c5467410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:48.019146 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0c27f-be1e-483b-9592-1ee0c5467410 None admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:48.019428 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0c27f-be1e-483b-9592-1ee0c5467410 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:48.020087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0c27f-be1e-483b-9592-1ee0c5467410 None admin] PATH_INFO: `/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba/users/f6ecae90436c475b9f3f943aabaf1d5d/roles/8ad4b0e0a5384306acd6d162f21dcd3d` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:48.021989 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0c27f-be1e-483b-9592-1ee0c5467410 None admin] RBAC: Authorizing `identity:create_grant(project_id=f882e970082a40b2ad1a0f258ad7e3ba, user_id=f6ecae90436c475b9f3f943aabaf1d5d, role_id=8ad4b0e0a5384306acd6d162f21dcd3d)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:48.023495 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0c27f-be1e-483b-9592-1ee0c5467410 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:48.069401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 113/233] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Sep 6 20:05:47 2022] PUT /identity/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba/users/f6ecae90436c475b9f3f943aabaf1d5d/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:05:48.154588 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 121/234] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Sep 6 20:05:47 2022] PUT /identity/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba/users/f6ecae90436c475b9f3f943aabaf1d5d/roles/8ad4b0e0a5384306acd6d162f21dcd3d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:05:48.565374 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19143c-ba9f-4eef-b0cb-2938175043ab None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:48.566417 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19143c-ba9f-4eef-b0cb-2938175043ab None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:48.566913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19143c-ba9f-4eef-b0cb-2938175043ab None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:48.568545 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 114/235] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:48.574309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24180230-571a-4f0f-a8f5-df474103538b None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:48.574886 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24180230-571a-4f0f-a8f5-df474103538b None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:48.575357 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24180230-571a-4f0f-a8f5-df474103538b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:48.600528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-24180230-571a-4f0f-a8f5-df474103538b None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:48.602158 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-24180230-571a-4f0f-a8f5-df474103538b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:48.695022 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 122/236] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:48.737114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b4cee-b067-4e93-b046-170bcf934c0e None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:48.737721 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b4cee-b067-4e93-b046-170bcf934c0e None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:48.738226 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b4cee-b067-4e93-b046-170bcf934c0e None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:48.739813 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 115/237] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:48.745461 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0c096-2d30-480c-916d-528a72e0c69a None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:48.746047 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0c096-2d30-480c-916d-528a72e0c69a None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:48.746513 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0c096-2d30-480c-916d-528a72e0c69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:48.765967 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-07d0c096-2d30-480c-916d-528a72e0c69a None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:48.767540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-07d0c096-2d30-480c-916d-528a72e0c69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:48.872312 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 123/238] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:49.022623 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b4cee-b067-4e93-b046-170bcf934c0e None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:49.167094 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b4cee-b067-4e93-b046-170bcf934c0e None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:49.212148 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:49.217127 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede61f3-3073-4e19-b6f9-f0a83eb766ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:49.217791 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede61f3-3073-4e19-b6f9-f0a83eb766ff None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:49.223940 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede61f3-3073-4e19-b6f9-f0a83eb766ff None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:49.224411 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede61f3-3073-4e19-b6f9-f0a83eb766ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:49.225634 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0c096-2d30-480c-916d-528a72e0c69a None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:49.239329 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede61f3-3073-4e19-b6f9-f0a83eb766ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:49.245636 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-aede61f3-3073-4e19-b6f9-f0a83eb766ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 20:05:49.245636 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:49.245636 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:49.245636 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:49.245636 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:49.245636 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:49.245636 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:49.245636 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:49.245636 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:49.245636 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:49.245636 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:49.245636 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:49.245636 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:49.245636 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:49.245636 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:49.245636 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:49.246762 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:49.246762 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:49.246762 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:49.246762 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:49.246762 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:49.246762 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:49.246762 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:49.246762 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:49.246762 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:49.246762 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:49.246762 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:49.246762 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:49.246762 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:49.246762 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:49.246762 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:49.246762 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:49.247723 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:49.247723 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:49.247723 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:49.247723 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:49.247723 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:49.247723 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:49.247723 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:49.247723 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:49.247723 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:49.247723 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:49.247723 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 20:05:49.247723 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:05:49.247723 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 116/239] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:05:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:05:49.255901 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede61f3-3073-4e19-b6f9-f0a83eb766ff None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:49.318324 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:49.397683 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0c096-2d30-480c-916d-528a72e0c69a None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:49.448505 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9ab01-f342-40de-aab4-6aa1c096831b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:49.449087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9ab01-f342-40de-aab4-6aa1c096831b None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:49.449438 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9ab01-f342-40de-aab4-6aa1c096831b None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:49.449732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9ab01-f342-40de-aab4-6aa1c096831b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:49.452230 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9ab01-f342-40de-aab4-6aa1c096831b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:49.454562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9ab01-f342-40de-aab4-6aa1c096831b None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:49.466500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 124/240] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:05:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:49.467484 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9ab01-f342-40de-aab4-6aa1c096831b None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:49.509269 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede61f3-3073-4e19-b6f9-f0a83eb766ff None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:49.565752 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a366352-f595-41e0-9926-63d094be0172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:49.566392 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a366352-f595-41e0-9926-63d094be0172 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:49.566637 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a366352-f595-41e0-9926-63d094be0172 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:49.566905 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a366352-f595-41e0-9926-63d094be0172 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:49.567608 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a366352-f595-41e0-9926-63d094be0172 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:49.567907 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a366352-f595-41e0-9926-63d094be0172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:49.569362 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a366352-f595-41e0-9926-63d094be0172 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:49.590963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 117/241] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:05:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:49.596462 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a366352-f595-41e0-9926-63d094be0172 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:49.634107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9ab01-f342-40de-aab4-6aa1c096831b None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:49.666886 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:49.699187 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24912e13-e2a6-4914-a2df-0f340f8b38ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:49.700311 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24912e13-e2a6-4914-a2df-0f340f8b38ca None admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:49.700786 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24912e13-e2a6-4914-a2df-0f340f8b38ca None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:49.701248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24912e13-e2a6-4914-a2df-0f340f8b38ca None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:49.702367 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24912e13-e2a6-4914-a2df-0f340f8b38ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:49.705467 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24912e13-e2a6-4914-a2df-0f340f8b38ca None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:49.749878 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:49.807595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a366352-f595-41e0-9926-63d094be0172 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:49.842550 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 125/242] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Sep 6 20:05:49 2022] POST /identity/v3/users => generated 293 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:05:49.867269 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef67651-c295-4e7e-adf6-ec8c3c40c7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:49.867957 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef67651-c295-4e7e-adf6-ec8c3c40c7f7 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:49.868278 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef67651-c295-4e7e-adf6-ec8c3c40c7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:49.868586 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef67651-c295-4e7e-adf6-ec8c3c40c7f7 None admin] PATH_INFO: `/v3/users/a64a99fc223e4a32bcee59adebc9033a` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:49.894843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef67651-c295-4e7e-adf6-ec8c3c40c7f7 None admin] RBAC: Authorizing `identity:get_user(user_id=a64a99fc223e4a32bcee59adebc9033a)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:49.896972 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef67651-c295-4e7e-adf6-ec8c3c40c7f7 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:49.899547 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 118/243] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:49 2022] GET /identity/v3/users/a64a99fc223e4a32bcee59adebc9033a => generated 297 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:49.905696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24912e13-e2a6-4914-a2df-0f340f8b38ca None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:50.018169 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec691ca3-7c93-4a85-bbdc-4e97e197d9ea None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:50.018795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec691ca3-7c93-4a85-bbdc-4e97e197d9ea None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:50.019397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec691ca3-7c93-4a85-bbdc-4e97e197d9ea None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:50.020996 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 119/244] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:50.037312 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc697c-4fab-4f67-a394-884a048f6b69 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:50.037925 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc697c-4fab-4f67-a394-884a048f6b69 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:50.038426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc697c-4fab-4f67-a394-884a048f6b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:50.073554 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-d8fc697c-4fab-4f67-a394-884a048f6b69 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:50.075108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-d8fc697c-4fab-4f67-a394-884a048f6b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:50.127922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24912e13-e2a6-4914-a2df-0f340f8b38ca None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:50.187412 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06846cdd-0f7b-4a2f-a8e9-788b3b40e5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:50.188523 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06846cdd-0f7b-4a2f-a8e9-788b3b40e5e0 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:50.188978 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06846cdd-0f7b-4a2f-a8e9-788b3b40e5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:50.189411 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06846cdd-0f7b-4a2f-a8e9-788b3b40e5e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:50.246854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 120/245] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 20:05:50.256260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:50.300772 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06846cdd-0f7b-4a2f-a8e9-788b3b40e5e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:50.302262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06846cdd-0f7b-4a2f-a8e9-788b3b40e5e0 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:50.426322 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 126/246] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:05:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:05:50.433182 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc697c-4fab-4f67-a394-884a048f6b69 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:50.549099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:50.559750 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06846cdd-0f7b-4a2f-a8e9-788b3b40e5e0 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:50.617525 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc697c-4fab-4f67-a394-884a048f6b69 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:50.640189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:50.660187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3b51f-f94c-4548-bca7-f3e5976ba39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:50.661103 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3b51f-f94c-4548-bca7-f3e5976ba39c None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:50.661522 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3b51f-f94c-4548-bca7-f3e5976ba39c None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:50.661945 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3b51f-f94c-4548-bca7-f3e5976ba39c None admin] PATH_INFO: `/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:50.663273 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3b51f-f94c-4548-bca7-f3e5976ba39c None admin] RBAC: Authorizing `identity:get_project(project_id=f882e970082a40b2ad1a0f258ad7e3ba)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:50.665150 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3b51f-f94c-4548-bca7-f3e5976ba39c None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:50.666993 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 121/247] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:05:50 2022] GET /identity/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:50.674489 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3b51f-f94c-4548-bca7-f3e5976ba39c None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:50.689877 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06846cdd-0f7b-4a2f-a8e9-788b3b40e5e0 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:50.734676 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bc73d-5975-471c-9672-4a64538f8808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:50.736275 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bc73d-5975-471c-9672-4a64538f8808 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:50.736685 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bc73d-5975-471c-9672-4a64538f8808 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:50.737069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bc73d-5975-471c-9672-4a64538f8808 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:50.753566 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48bc73d-5975-471c-9672-4a64538f8808 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:50.761236 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-d48bc73d-5975-471c-9672-4a64538f8808 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:05:50.761236 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:50.761236 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:50.761236 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:50.761236 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:50.761236 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:50.761236 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:50.761236 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:50.761236 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:50.761236 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:50.761236 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:50.761236 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:50.761236 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:50.761236 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:50.761236 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:50.761236 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:50.762328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:50.762328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:50.762328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:50.762328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:50.762328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:50.762328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:50.762328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:50.762328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:50.762328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:50.762328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:50.762328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:50.762328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:50.762328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:50.762328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:50.762328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:50.762328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:50.763116 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:50.763116 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:50.763116 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:50.763116 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:50.763116 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:50.763116 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:50.763116 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:50.763116 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:50.763116 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:50.763116 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:50.763116 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:05:50.763116 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:05:50.763116 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 127/248] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:05:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:05:50.770479 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bc73d-5975-471c-9672-4a64538f8808 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:50.814975 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3b51f-f94c-4548-bca7-f3e5976ba39c None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:50.833327 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:50.874815 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35635e87-748c-4d84-87a4-1d822db3ff26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:50.876261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35635e87-748c-4d84-87a4-1d822db3ff26 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:50.876690 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35635e87-748c-4d84-87a4-1d822db3ff26 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:50.876964 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35635e87-748c-4d84-87a4-1d822db3ff26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:50.877963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35635e87-748c-4d84-87a4-1d822db3ff26 None admin] RBAC: Adding query filter params (role.id=118b6fc03d22492f83f70dd2da6b374d, scope.project.id=f882e970082a40b2ad1a0f258ad7e3ba, user.id=a64a99fc223e4a32bcee59adebc9033a) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:50.878268 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35635e87-748c-4d84-87a4-1d822db3ff26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:50.879756 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35635e87-748c-4d84-87a4-1d822db3ff26 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:50.886815 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 122/249] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:05:50 2022] GET /identity/v3/role_assignments?user.id=a64a99fc223e4a32bcee59adebc9033a&scope.project.id=f882e970082a40b2ad1a0f258ad7e3ba&role.id=118b6fc03d22492f83f70dd2da6b374d => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:50.887935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf9dc6-a500-41f6-b4a1-b9608cd6599b None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:50.888209 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf9dc6-a500-41f6-b4a1-b9608cd6599b None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:50.888502 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf9dc6-a500-41f6-b4a1-b9608cd6599b None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:50.889876 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 123/250] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:50.901021 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00329b48-4450-40e7-997c-64e7a1cee85a None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:50.901336 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00329b48-4450-40e7-997c-64e7a1cee85a None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:50.901567 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00329b48-4450-40e7-997c-64e7a1cee85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:50.922510 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bc73d-5975-471c-9672-4a64538f8808 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:50.956670 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-00329b48-4450-40e7-997c-64e7a1cee85a None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:50.957919 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-00329b48-4450-40e7-997c-64e7a1cee85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:50.958448 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:50.970361 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70370b3f-a8e3-4402-8bde-9a3a6ddc7326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:50.972154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70370b3f-a8e3-4402-8bde-9a3a6ddc7326 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:50.972154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70370b3f-a8e3-4402-8bde-9a3a6ddc7326 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:50.972154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70370b3f-a8e3-4402-8bde-9a3a6ddc7326 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:50.972745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70370b3f-a8e3-4402-8bde-9a3a6ddc7326 None admin] RBAC: Adding query filter params (name=member) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:50.973148 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70370b3f-a8e3-4402-8bde-9a3a6ddc7326 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:50.974872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70370b3f-a8e3-4402-8bde-9a3a6ddc7326 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:50.990192 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 128/251] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:05:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:50.996977 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70370b3f-a8e3-4402-8bde-9a3a6ddc7326 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:51.124713 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70370b3f-a8e3-4402-8bde-9a3a6ddc7326 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:51.137492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 124/252] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:51.138922 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8b897-8073-463c-a0fa-06a569581e30 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:51.139191 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8b897-8073-463c-a0fa-06a569581e30 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:51.139501 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8b897-8073-463c-a0fa-06a569581e30 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:51.141154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 125/253] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:51.147837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaeb6ec-914a-4096-816a-f919eba09083 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:51.148152 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaeb6ec-914a-4096-816a-f919eba09083 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:51.148384 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaeb6ec-914a-4096-816a-f919eba09083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:51.184744 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-beaeb6ec-914a-4096-816a-f919eba09083 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:51.188687 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-beaeb6ec-914a-4096-816a-f919eba09083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:51.205214 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa346e88-7897-49be-9abb-2591e8ffd31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:51.205889 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa346e88-7897-49be-9abb-2591e8ffd31d None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:51.206171 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa346e88-7897-49be-9abb-2591e8ffd31d None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:51.206445 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa346e88-7897-49be-9abb-2591e8ffd31d None admin] PATH_INFO: `/v3/users/d8b798260f224ab0bd254196266bbf39` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:51.207911 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa346e88-7897-49be-9abb-2591e8ffd31d None admin] RBAC: Authorizing `identity:get_user(user_id=d8b798260f224ab0bd254196266bbf39)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:51.211978 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa346e88-7897-49be-9abb-2591e8ffd31d None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:51.213738 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 129/254] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:50 2022] GET /identity/v3/users/d8b798260f224ab0bd254196266bbf39 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:51.222627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa346e88-7897-49be-9abb-2591e8ffd31d None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:51.318281 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:51.355084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 126/255] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 20:05:51.389072 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa346e88-7897-49be-9abb-2591e8ffd31d None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:51.428821 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c984671-1461-44e2-a1db-5c21cfdcdf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:51.429947 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c984671-1461-44e2-a1db-5c21cfdcdf45 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:51.430420 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c984671-1461-44e2-a1db-5c21cfdcdf45 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:51.430920 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c984671-1461-44e2-a1db-5c21cfdcdf45 None admin] PATH_INFO: `/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:51.432331 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c984671-1461-44e2-a1db-5c21cfdcdf45 None admin] RBAC: Authorizing `identity:get_project(project_id=f882e970082a40b2ad1a0f258ad7e3ba)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:51.434266 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c984671-1461-44e2-a1db-5c21cfdcdf45 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:51.436248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 130/256] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:05:51 2022] GET /identity/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:51.444123 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaeb6ec-914a-4096-816a-f919eba09083 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:51.500276 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:51.566338 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaeb6ec-914a-4096-816a-f919eba09083 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:51.603253 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875f0bd-fb96-4244-922d-54cc7b6146e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:51.603995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875f0bd-fb96-4244-922d-54cc7b6146e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:51.604272 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875f0bd-fb96-4244-922d-54cc7b6146e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:51.604629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875f0bd-fb96-4244-922d-54cc7b6146e8 None admin] PATH_INFO: `/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba/users/d8b798260f224ab0bd254196266bbf39/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:51.606663 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875f0bd-fb96-4244-922d-54cc7b6146e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f882e970082a40b2ad1a0f258ad7e3ba, user_id=d8b798260f224ab0bd254196266bbf39, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:51.608147 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875f0bd-fb96-4244-922d-54cc7b6146e8 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:51.705710 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c984671-1461-44e2-a1db-5c21cfdcdf45 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:51.706520 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 127/257] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Sep 6 20:05:51 2022] PUT /identity/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba/users/d8b798260f224ab0bd254196266bbf39/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:05:51.830834 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875f0bd-fb96-4244-922d-54cc7b6146e8 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:51.867092 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c984671-1461-44e2-a1db-5c21cfdcdf45 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:51.923503 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:51.952261 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b398105-2760-472d-8bd7-7c17d2bd3009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:51.952922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b398105-2760-472d-8bd7-7c17d2bd3009 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:51.953470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b398105-2760-472d-8bd7-7c17d2bd3009 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:51.953795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b398105-2760-472d-8bd7-7c17d2bd3009 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:51.989558 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b398105-2760-472d-8bd7-7c17d2bd3009 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:52.006131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-8b398105-2760-472d-8bd7-7c17d2bd3009 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 20:05:52.006131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:52.006131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:52.006131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:52.006131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:52.006131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:52.006131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:52.006131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:52.006131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:52.006131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:52.006131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:52.006131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:52.006131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:52.006131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:52.006131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:52.006131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:52.007067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:52.007067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:52.007067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:52.007067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:52.007067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:52.007067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:52.007067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:52.007067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:52.007067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:52.007067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:52.007067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:52.007067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:52.007067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:52.007067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:52.007067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:52.007067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:52.007857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:52.007857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:52.007857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:52.007857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:52.007857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:52.007857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:52.007857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:52.007857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:52.007857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:52.007857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:52.007857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 20:05:52.007857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:05:52.007857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 131/258] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Sep 6 20:05:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:05:52.017433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b398105-2760-472d-8bd7-7c17d2bd3009 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:52.048595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:52.064870 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875f0bd-fb96-4244-922d-54cc7b6146e8 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:52.144768 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b398105-2760-472d-8bd7-7c17d2bd3009 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:52.160188 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e85c3-9d44-4980-9983-c4471a1a1675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:52.160880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e85c3-9d44-4980-9983-c4471a1a1675 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:52.161115 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e85c3-9d44-4980-9983-c4471a1a1675 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:52.161385 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e85c3-9d44-4980-9983-c4471a1a1675 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:52.187193 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e85c3-9d44-4980-9983-c4471a1a1675 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:52.192991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-618e85c3-9d44-4980-9983-c4471a1a1675 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:05:52.192991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:52.192991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:52.192991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:52.192991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:52.192991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:52.192991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:52.192991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:52.192991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:52.192991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:52.192991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:52.192991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:52.192991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:52.192991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:52.192991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:52.192991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:52.193879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:52.193879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:52.193879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:52.193879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:52.193879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:52.193879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:52.193879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:52.193879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:52.193879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:52.193879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:52.193879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:52.193879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:52.193879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:52.193879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:52.193879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:52.193879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:52.194729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:52.194729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:52.194729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:52.194729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:52.194729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:52.194729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:52.194729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:52.194729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:52.194729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:52.194729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:52.194729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:05:52.194729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:05:52.197506 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e237c-031c-4b6e-a395-d7de4d986739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:52.198374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e237c-031c-4b6e-a395-d7de4d986739 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:52.198846 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e237c-031c-4b6e-a395-d7de4d986739 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:52.199305 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e237c-031c-4b6e-a395-d7de4d986739 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:52.200192 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e237c-031c-4b6e-a395-d7de4d986739 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:52.200731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e237c-031c-4b6e-a395-d7de4d986739 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:52.202320 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e237c-031c-4b6e-a395-d7de4d986739 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:52.208054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 128/259] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:05:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:05:52.213948 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e85c3-9d44-4980-9983-c4471a1a1675 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:52.220955 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 132/260] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:05:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:52.237211 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e237c-031c-4b6e-a395-d7de4d986739 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:52.338505 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:52.362637 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e85c3-9d44-4980-9983-c4471a1a1675 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:52.405921 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0460e-0d99-41dc-95d8-c0d29dbebe24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:52.408009 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0460e-0d99-41dc-95d8-c0d29dbebe24 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:52.408683 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0460e-0d99-41dc-95d8-c0d29dbebe24 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:52.409260 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0460e-0d99-41dc-95d8-c0d29dbebe24 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:52.410127 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa0460e-0d99-41dc-95d8-c0d29dbebe24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:52.410625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa0460e-0d99-41dc-95d8-c0d29dbebe24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:52.412505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa0460e-0d99-41dc-95d8-c0d29dbebe24 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:52.423929 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 129/261] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:05:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:52.432974 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0460e-0d99-41dc-95d8-c0d29dbebe24 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:52.465754 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e237c-031c-4b6e-a395-d7de4d986739 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:52.473248 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:52.544133 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdbce5-711a-4da5-be8f-969c06dbb1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:52.544783 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdbce5-711a-4da5-be8f-969c06dbb1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:52.545067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdbce5-711a-4da5-be8f-969c06dbb1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:52.545340 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdbce5-711a-4da5-be8f-969c06dbb1f0 None admin] PATH_INFO: `/v3/users/f6ecae90436c475b9f3f943aabaf1d5d` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:52.546480 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cdbce5-711a-4da5-be8f-969c06dbb1f0 None admin] RBAC: Authorizing `identity:get_user(user_id=f6ecae90436c475b9f3f943aabaf1d5d)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:52.552089 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cdbce5-711a-4da5-be8f-969c06dbb1f0 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:52.553788 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 133/262] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:52 2022] GET /identity/v3/users/f6ecae90436c475b9f3f943aabaf1d5d => generated 283 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:52.560408 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdbce5-711a-4da5-be8f-969c06dbb1f0 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:52.653772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0460e-0d99-41dc-95d8-c0d29dbebe24 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:52.721516 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdbce5-711a-4da5-be8f-969c06dbb1f0 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:52.740777 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:52.755823 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140bb03-a75d-4280-8e01-c7b86a93ee60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:52.766426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140bb03-a75d-4280-8e01-c7b86a93ee60 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:52.766426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140bb03-a75d-4280-8e01-c7b86a93ee60 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:52.766426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140bb03-a75d-4280-8e01-c7b86a93ee60 None admin] PATH_INFO: `/v3/users/f6ecae90436c475b9f3f943aabaf1d5d` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:52.766684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5d828-4bda-44ea-bd2e-214795696902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:52.766795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140bb03-a75d-4280-8e01-c7b86a93ee60 None admin] RBAC: Authorizing `identity:get_user(user_id=f6ecae90436c475b9f3f943aabaf1d5d)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:52.766884 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5d828-4bda-44ea-bd2e-214795696902 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:52.766884 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5d828-4bda-44ea-bd2e-214795696902 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:52.766884 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5d828-4bda-44ea-bd2e-214795696902 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:52.767061 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140bb03-a75d-4280-8e01-c7b86a93ee60 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:52.767061 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 130/263] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:52 2022] GET /identity/v3/users/f6ecae90436c475b9f3f943aabaf1d5d => generated 283 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:52.769421 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140bb03-a75d-4280-8e01-c7b86a93ee60 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:52.834764 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5d828-4bda-44ea-bd2e-214795696902 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:52.836455 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5d828-4bda-44ea-bd2e-214795696902 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:52.941979 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 134/264] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:05:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:05:52.947370 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:52.948180 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5d828-4bda-44ea-bd2e-214795696902 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:52.966988 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:52.973065 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140bb03-a75d-4280-8e01-c7b86a93ee60 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:53.017818 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53888920-8559-4f5f-a93f-8d08e5c42184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:53.019382 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53888920-8559-4f5f-a93f-8d08e5c42184 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:53.019905 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53888920-8559-4f5f-a93f-8d08e5c42184 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:53.020380 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53888920-8559-4f5f-a93f-8d08e5c42184 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:53.118620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53888920-8559-4f5f-a93f-8d08e5c42184 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:53.120472 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53888920-8559-4f5f-a93f-8d08e5c42184 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:53.132752 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5d828-4bda-44ea-bd2e-214795696902 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:53.193319 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc2bfe-46c8-412e-8b99-82ca0695400b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:53.193878 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc2bfe-46c8-412e-8b99-82ca0695400b None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:53.194154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc2bfe-46c8-412e-8b99-82ca0695400b None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:53.194420 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc2bfe-46c8-412e-8b99-82ca0695400b None admin] PATH_INFO: `/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:53.200142 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc2bfe-46c8-412e-8b99-82ca0695400b None admin] RBAC: Authorizing `identity:get_project(project_id=f882e970082a40b2ad1a0f258ad7e3ba)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:53.201616 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc2bfe-46c8-412e-8b99-82ca0695400b None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:53.203999 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 135/265] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:05:52 2022] GET /identity/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:53.209851 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc2bfe-46c8-412e-8b99-82ca0695400b None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:53.218128 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:53.237523 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 131/266] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:05:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 20:05:53.245638 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53888920-8559-4f5f-a93f-8d08e5c42184 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:53.308270 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:53.323784 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc2bfe-46c8-412e-8b99-82ca0695400b None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:53.360812 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412a659-39ff-403e-a75d-72d381d680ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:53.361579 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412a659-39ff-403e-a75d-72d381d680ef None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:53.361762 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412a659-39ff-403e-a75d-72d381d680ef None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:53.362127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412a659-39ff-403e-a75d-72d381d680ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:53.362856 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412a659-39ff-403e-a75d-72d381d680ef None admin] RBAC: Adding query filter params (role.id=8ad4b0e0a5384306acd6d162f21dcd3d, scope.project.id=f882e970082a40b2ad1a0f258ad7e3ba, user.id=f6ecae90436c475b9f3f943aabaf1d5d) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:53.363161 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412a659-39ff-403e-a75d-72d381d680ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:53.371492 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412a659-39ff-403e-a75d-72d381d680ef None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:53.374837 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 136/267] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:05:53 2022] GET /identity/v3/role_assignments?user.id=f6ecae90436c475b9f3f943aabaf1d5d&scope.project.id=f882e970082a40b2ad1a0f258ad7e3ba&role.id=8ad4b0e0a5384306acd6d162f21dcd3d => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:53.429562 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53888920-8559-4f5f-a93f-8d08e5c42184 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:53.474531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e743d-e281-4d5b-acd6-7ee14c0da3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:53.475552 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e743d-e281-4d5b-acd6-7ee14c0da3b0 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:53.476053 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e743d-e281-4d5b-acd6-7ee14c0da3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:53.476555 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e743d-e281-4d5b-acd6-7ee14c0da3b0 None admin] PATH_INFO: `/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:53.478390 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e743d-e281-4d5b-acd6-7ee14c0da3b0 None admin] RBAC: Authorizing `identity:get_project(project_id=f882e970082a40b2ad1a0f258ad7e3ba)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:53.480237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e743d-e281-4d5b-acd6-7ee14c0da3b0 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:53.482178 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 132/268] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:05:53 2022] GET /identity/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:53.488451 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412a659-39ff-403e-a75d-72d381d680ef None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:53.516777 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d14f6-a26e-4885-9f16-dd975f15cc96 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:53.517387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d14f6-a26e-4885-9f16-dd975f15cc96 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:53.517851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d14f6-a26e-4885-9f16-dd975f15cc96 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:53.519654 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 133/269] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:53.525948 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09221615-4fa2-41f3-a24c-15b6113613a2 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:53.526271 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09221615-4fa2-41f3-a24c-15b6113613a2 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:53.526491 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09221615-4fa2-41f3-a24c-15b6113613a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:53.570722 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-09221615-4fa2-41f3-a24c-15b6113613a2 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:53.571956 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-09221615-4fa2-41f3-a24c-15b6113613a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:53.696163 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:53.717408 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412a659-39ff-403e-a75d-72d381d680ef None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:53.736726 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 134/270] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:53.770539 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e1a51-9d9e-4bb9-a690-108be3bc1f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:53.771158 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e1a51-9d9e-4bb9-a690-108be3bc1f02 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:53.771448 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e1a51-9d9e-4bb9-a690-108be3bc1f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:53.771724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e1a51-9d9e-4bb9-a690-108be3bc1f02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:53.772454 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e1a51-9d9e-4bb9-a690-108be3bc1f02 None admin] RBAC: Adding query filter params (role.id=1e2ac44410664e6b8f42ab3c37e2643f, scope.project.id=f882e970082a40b2ad1a0f258ad7e3ba, user.id=f6ecae90436c475b9f3f943aabaf1d5d) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:53.772757 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e1a51-9d9e-4bb9-a690-108be3bc1f02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:53.774179 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e1a51-9d9e-4bb9-a690-108be3bc1f02 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:53.780807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 137/271] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:05:53 2022] GET /identity/v3/role_assignments?user.id=f6ecae90436c475b9f3f943aabaf1d5d&scope.project.id=f882e970082a40b2ad1a0f258ad7e3ba&role.id=1e2ac44410664e6b8f42ab3c37e2643f => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:54.241594 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09221615-4fa2-41f3-a24c-15b6113613a2 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:54.342928 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687aeca8-f041-421a-b78c-492a53e5fddf None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:54.343311 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687aeca8-f041-421a-b78c-492a53e5fddf None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:54.343531 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687aeca8-f041-421a-b78c-492a53e5fddf None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:54.347414 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 138/272] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:54.351815 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c99801-7dd5-4e6e-be4d-771bcd12aacf None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:54.352337 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c99801-7dd5-4e6e-be4d-771bcd12aacf None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:54.352799 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c99801-7dd5-4e6e-be4d-771bcd12aacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:54.366667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09221615-4fa2-41f3-a24c-15b6113613a2 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:54.380973 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-20c99801-7dd5-4e6e-be4d-771bcd12aacf None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:54.382837 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-20c99801-7dd5-4e6e-be4d-771bcd12aacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:54.395109 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:54.422652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268e9b1-91ac-4e12-818d-6c1971a7bd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:54.423321 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268e9b1-91ac-4e12-818d-6c1971a7bd68 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:54.423633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268e9b1-91ac-4e12-818d-6c1971a7bd68 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:54.423906 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268e9b1-91ac-4e12-818d-6c1971a7bd68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:54.440746 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268e9b1-91ac-4e12-818d-6c1971a7bd68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:54.445794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-d268e9b1-91ac-4e12-818d-6c1971a7bd68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:05:54.445794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:54.445794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:54.445794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:54.445794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:54.445794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:54.445794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:54.445794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:54.445794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:54.445794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:54.445794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:54.445794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:54.445794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:54.445794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:54.445794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:54.445794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:54.446761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:54.446761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:54.446761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:54.446761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:54.446761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:54.446761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:54.446761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:54.446761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:54.446761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:54.446761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:54.446761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:54.446761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:54.446761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:54.446761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:54.446761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:54.446761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:54.447602 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:54.447602 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:54.447602 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:54.447602 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:54.447602 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:54.447602 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:54.447602 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:54.447602 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:54.447602 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:54.447602 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:54.447602 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:05:54.447602 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:05:54.452405 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 135/273] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:05:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:05:54.453769 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c134ea-2b52-467f-9f02-20e02eaac77b None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:54.453769 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c134ea-2b52-467f-9f02-20e02eaac77b None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:54.454014 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c134ea-2b52-467f-9f02-20e02eaac77b None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:54.455567 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 136/274] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:54.456204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c134ea-2b52-467f-9f02-20e02eaac77b None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:54.483422 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 139/275] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:54.485172 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef78a1-4a98-4de4-a067-20e5a1a9517c None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:54.485551 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef78a1-4a98-4de4-a067-20e5a1a9517c None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:54.485830 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef78a1-4a98-4de4-a067-20e5a1a9517c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:54.513073 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-12ef78a1-4a98-4de4-a067-20e5a1a9517c None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:54.514178 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-12ef78a1-4a98-4de4-a067-20e5a1a9517c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:54.529486 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:54.603769 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c134ea-2b52-467f-9f02-20e02eaac77b None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:54.608652 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 140/276] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:54.647165 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabca11-8eab-487a-9cab-8329cd4a07cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:54.648271 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabca11-8eab-487a-9cab-8329cd4a07cb None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:54.648751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabca11-8eab-487a-9cab-8329cd4a07cb None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:54.649249 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabca11-8eab-487a-9cab-8329cd4a07cb None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:54.650117 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabca11-8eab-487a-9cab-8329cd4a07cb None admin] RBAC: Adding query filter params (name=member) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:54.650615 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabca11-8eab-487a-9cab-8329cd4a07cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:54.652227 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabca11-8eab-487a-9cab-8329cd4a07cb None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:54.662106 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 137/277] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:05:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:54.668340 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef78a1-4a98-4de4-a067-20e5a1a9517c None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:54.741924 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:54.773837 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef78a1-4a98-4de4-a067-20e5a1a9517c None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:54.782614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabca11-8eab-487a-9cab-8329cd4a07cb None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:54.823122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb04408-26a8-48c8-8ea1-8f1b4937e10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:54.824141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb04408-26a8-48c8-8ea1-8f1b4937e10f None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:54.824646 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb04408-26a8-48c8-8ea1-8f1b4937e10f None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:54.830307 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb04408-26a8-48c8-8ea1-8f1b4937e10f None admin] PATH_INFO: `/v3/users/15582458c24f48fbbe2380b946061e36` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:54.847430 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb04408-26a8-48c8-8ea1-8f1b4937e10f None admin] RBAC: Authorizing `identity:get_user(user_id=15582458c24f48fbbe2380b946061e36)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:54.848927 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb04408-26a8-48c8-8ea1-8f1b4937e10f None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:54.855602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 141/278] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:54 2022] GET /identity/v3/users/15582458c24f48fbbe2380b946061e36 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:54.857728 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb04408-26a8-48c8-8ea1-8f1b4937e10f None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:54.923168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabca11-8eab-487a-9cab-8329cd4a07cb None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:54.926667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:54.964403 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4eb4e-01df-4559-a05b-723d24d73758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:54.965189 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4eb4e-01df-4559-a05b-723d24d73758 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:54.965852 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4eb4e-01df-4559-a05b-723d24d73758 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:54.966140 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4eb4e-01df-4559-a05b-723d24d73758 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:54.967634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4eb4e-01df-4559-a05b-723d24d73758 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:54.970086 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4eb4e-01df-4559-a05b-723d24d73758 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:54.975524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 138/279] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:05:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:54.975524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4eb4e-01df-4559-a05b-723d24d73758 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:54.990321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb04408-26a8-48c8-8ea1-8f1b4937e10f None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:55.020577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:55.027182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae709771-78f7-4e14-b2da-cac2d8c6fa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:55.027754 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae709771-78f7-4e14-b2da-cac2d8c6fa8e None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:55.028032 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae709771-78f7-4e14-b2da-cac2d8c6fa8e None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:55.028301 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae709771-78f7-4e14-b2da-cac2d8c6fa8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:55.029051 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae709771-78f7-4e14-b2da-cac2d8c6fa8e None admin] RBAC: Adding query filter params (role.id=d970607307684690803e8e97e2d39e8f, user.id=15582458c24f48fbbe2380b946061e36, scope.system=all) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:55.029372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae709771-78f7-4e14-b2da-cac2d8c6fa8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:55.030821 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae709771-78f7-4e14-b2da-cac2d8c6fa8e None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:55.047475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 142/280] 10.222.0.77 () {56 vars in 1308 bytes} [Tue Sep 6 20:05:54 2022] GET /identity/v3/role_assignments?user.id=15582458c24f48fbbe2380b946061e36&scope.system=all&role.id=d970607307684690803e8e97e2d39e8f => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:55.047475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae709771-78f7-4e14-b2da-cac2d8c6fa8e None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:55.110327 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4eb4e-01df-4559-a05b-723d24d73758 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:55.157873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47e4c9-4f04-49e9-a34b-d23881287c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:55.158529 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47e4c9-4f04-49e9-a34b-d23881287c35 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:55.158811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47e4c9-4f04-49e9-a34b-d23881287c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:55.159079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47e4c9-4f04-49e9-a34b-d23881287c35 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:55.159588 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae709771-78f7-4e14-b2da-cac2d8c6fa8e None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:55.174040 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47e4c9-4f04-49e9-a34b-d23881287c35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:55.179319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-8d47e4c9-4f04-49e9-a34b-d23881287c35 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 20:05:55.179319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:55.179319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:55.179319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:55.179319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:55.179319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:55.179319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:55.179319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:55.179319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:55.179319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:55.179319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:55.179319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:55.179319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:55.179319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:55.179319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:55.179319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:55.180480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:55.180480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:55.180480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:55.180480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:55.180480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:55.180480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:55.180480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:55.180480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:55.180480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:55.180480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:55.180480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:55.180480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:55.180480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:55.180480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:55.180480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:55.180480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:55.181268 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:55.181268 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:55.181268 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:55.181268 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:55.181268 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:55.181268 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:55.181268 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:55.181268 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:55.181268 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:55.181268 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:55.181268 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 20:05:55.181268 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:05:55.181268 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 139/281] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:05:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:05:55.182195 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470db24-177a-4d0d-b1f1-c25d4f04da15 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:55.182477 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470db24-177a-4d0d-b1f1-c25d4f04da15 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:55.182743 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470db24-177a-4d0d-b1f1-c25d4f04da15 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:55.184403 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 140/282] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:55.186684 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470db24-177a-4d0d-b1f1-c25d4f04da15 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:55.209435 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeadcaa-8790-480c-9d0d-ad4c11302009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:55.210164 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeadcaa-8790-480c-9d0d-ad4c11302009 None admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:55.210533 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeadcaa-8790-480c-9d0d-ad4c11302009 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:55.210874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeadcaa-8790-480c-9d0d-ad4c11302009 None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:55.211651 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeadcaa-8790-480c-9d0d-ad4c11302009 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:55.213172 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeadcaa-8790-480c-9d0d-ad4c11302009 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:55.233703 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:55.307051 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470db24-177a-4d0d-b1f1-c25d4f04da15 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:55.338419 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 143/283] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Sep 6 20:05:55 2022] POST /identity/v3/users => generated 293 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:05:55.344793 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa0fbf-0246-4a37-a6ba-4ca5681783fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:55.345532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa0fbf-0246-4a37-a6ba-4ca5681783fa None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:55.345841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa0fbf-0246-4a37-a6ba-4ca5681783fa None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:55.346075 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa0fbf-0246-4a37-a6ba-4ca5681783fa None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:55.346856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa0fbf-0246-4a37-a6ba-4ca5681783fa None admin] RBAC: Adding query filter params (name=reader) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:55.347164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa0fbf-0246-4a37-a6ba-4ca5681783fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:55.348660 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa0fbf-0246-4a37-a6ba-4ca5681783fa None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:55.349170 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84386c7d-a694-44e0-b6e9-6e422af03c31 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:55.349461 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84386c7d-a694-44e0-b6e9-6e422af03c31 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:55.349738 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84386c7d-a694-44e0-b6e9-6e422af03c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:55.363408 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 141/284] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:05:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:55.364749 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa0fbf-0246-4a37-a6ba-4ca5681783fa None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:55.404149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-84386c7d-a694-44e0-b6e9-6e422af03c31 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:55.407221 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-84386c7d-a694-44e0-b6e9-6e422af03c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:55.480892 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:55.509710 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 144/285] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:55.519853 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:55.523257 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa0fbf-0246-4a37-a6ba-4ca5681783fa None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:55.559424 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ac5a8-8a54-4d3e-8e1f-4860a18b81a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:55.560174 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ac5a8-8a54-4d3e-8e1f-4860a18b81a6 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:55.560544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ac5a8-8a54-4d3e-8e1f-4860a18b81a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:55.560936 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ac5a8-8a54-4d3e-8e1f-4860a18b81a6 None admin] PATH_INFO: `/v3/users/a64a99fc223e4a32bcee59adebc9033a` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:55.562187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ac5a8-8a54-4d3e-8e1f-4860a18b81a6 None admin] RBAC: Authorizing `identity:get_user(user_id=a64a99fc223e4a32bcee59adebc9033a)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:55.564364 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ac5a8-8a54-4d3e-8e1f-4860a18b81a6 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:55.566375 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 142/286] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:55 2022] GET /identity/v3/users/a64a99fc223e4a32bcee59adebc9033a => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:55.572079 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84386c7d-a694-44e0-b6e9-6e422af03c31 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:55.697055 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84386c7d-a694-44e0-b6e9-6e422af03c31 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:55.736823 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2eb78a-4ee4-4e9d-b1a6-bc5bc1c1157c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:55.737869 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2eb78a-4ee4-4e9d-b1a6-bc5bc1c1157c None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:55.738379 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2eb78a-4ee4-4e9d-b1a6-bc5bc1c1157c None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:55.738880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2eb78a-4ee4-4e9d-b1a6-bc5bc1c1157c None admin] PATH_INFO: `/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:55.740322 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2eb78a-4ee4-4e9d-b1a6-bc5bc1c1157c None admin] RBAC: Authorizing `identity:get_project(project_id=f882e970082a40b2ad1a0f258ad7e3ba)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:55.741984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2eb78a-4ee4-4e9d-b1a6-bc5bc1c1157c None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:55.743894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 145/287] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:05:55 2022] GET /identity/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:55.750687 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ac5a8-8a54-4d3e-8e1f-4860a18b81a6 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:55.792843 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2eb78a-4ee4-4e9d-b1a6-bc5bc1c1157c None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:55.869694 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:55.885420 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ac5a8-8a54-4d3e-8e1f-4860a18b81a6 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:55.923301 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2eb78a-4ee4-4e9d-b1a6-bc5bc1c1157c None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:55.929946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bb5c1-e073-4b58-a61b-5e756815888b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:55.930610 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bb5c1-e073-4b58-a61b-5e756815888b None admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:55.930887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bb5c1-e073-4b58-a61b-5e756815888b None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:55.931160 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bb5c1-e073-4b58-a61b-5e756815888b None admin] PATH_INFO: `/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba/users/a64a99fc223e4a32bcee59adebc9033a/roles/118b6fc03d22492f83f70dd2da6b374d` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:55.933600 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bb5c1-e073-4b58-a61b-5e756815888b None admin] RBAC: Authorizing `identity:create_grant(project_id=f882e970082a40b2ad1a0f258ad7e3ba, user_id=a64a99fc223e4a32bcee59adebc9033a, role_id=118b6fc03d22492f83f70dd2da6b374d)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:55.935550 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bb5c1-e073-4b58-a61b-5e756815888b None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:55.966573 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73746645-1e77-401b-a83f-4e83fe2c8906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:55.967431 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73746645-1e77-401b-a83f-4e83fe2c8906 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:55.967879 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73746645-1e77-401b-a83f-4e83fe2c8906 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:55.968253 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73746645-1e77-401b-a83f-4e83fe2c8906 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:55.981904 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73746645-1e77-401b-a83f-4e83fe2c8906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:55.987708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-73746645-1e77-401b-a83f-4e83fe2c8906 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:05:55.987708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:55.987708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:55.987708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:55.987708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:55.987708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:55.987708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:55.987708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:55.987708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:55.987708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:55.987708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:55.987708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:55.987708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:55.987708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:55.987708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:55.987708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:55.991576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:55.991576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:55.991576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:55.991576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:55.991576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:55.991576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:55.991576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:55.991576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:55.991576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:55.991576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:55.991576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:55.991576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:55.991576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:55.991576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:55.991576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:55.991576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:55.992409 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:55.992409 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:55.992409 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:55.992409 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:55.992409 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:55.992409 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:55.992409 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:55.992409 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:55.992409 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:55.992409 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:55.992409 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:05:55.992409 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:05:55.992409 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 146/288] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:05:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:05:55.995620 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73746645-1e77-401b-a83f-4e83fe2c8906 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:56.023303 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 143/289] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Sep 6 20:05:55 2022] PUT /identity/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba/users/a64a99fc223e4a32bcee59adebc9033a/roles/118b6fc03d22492f83f70dd2da6b374d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:05:56.132743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73746645-1e77-401b-a83f-4e83fe2c8906 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:56.144125 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:56.172705 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2b2a9-6cef-48d0-be59-044dbb87486e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:56.173521 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2b2a9-6cef-48d0-be59-044dbb87486e None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:56.173892 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2b2a9-6cef-48d0-be59-044dbb87486e None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:56.174260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2b2a9-6cef-48d0-be59-044dbb87486e None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:56.175184 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2b2a9-6cef-48d0-be59-044dbb87486e None admin] RBAC: Adding query filter params (name=member) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:56.175641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2b2a9-6cef-48d0-be59-044dbb87486e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:56.177284 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2b2a9-6cef-48d0-be59-044dbb87486e None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:56.186624 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 147/290] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:05:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:05:56.196649 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bb5c1-e073-4b58-a61b-5e756815888b None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:56.243024 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:56.347339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bb5c1-e073-4b58-a61b-5e756815888b None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:56.387159 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297aee36-8273-4b3f-abe3-4a1a0971dc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:56.387968 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297aee36-8273-4b3f-abe3-4a1a0971dc0a None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:56.388261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297aee36-8273-4b3f-abe3-4a1a0971dc0a None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:56.388527 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297aee36-8273-4b3f-abe3-4a1a0971dc0a None admin] PATH_INFO: `/v3/users/d8b798260f224ab0bd254196266bbf39` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:56.389682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297aee36-8273-4b3f-abe3-4a1a0971dc0a None admin] RBAC: Authorizing `identity:get_user(user_id=d8b798260f224ab0bd254196266bbf39)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:56.391180 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297aee36-8273-4b3f-abe3-4a1a0971dc0a None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:56.392872 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 144/291] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:56 2022] GET /identity/v3/users/d8b798260f224ab0bd254196266bbf39 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:56.398468 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2b2a9-6cef-48d0-be59-044dbb87486e None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:56.537365 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2b2a9-6cef-48d0-be59-044dbb87486e None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:56.589948 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f846849-a251-460d-b7f4-063d3e942bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:56.590569 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f846849-a251-460d-b7f4-063d3e942bbf None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:56.590848 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f846849-a251-460d-b7f4-063d3e942bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:56.591118 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f846849-a251-460d-b7f4-063d3e942bbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:56.644816 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:56.683166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f846849-a251-460d-b7f4-063d3e942bbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:56.684677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f846849-a251-460d-b7f4-063d3e942bbf None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:56.802722 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 148/292] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:05:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:05:56.808332 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297aee36-8273-4b3f-abe3-4a1a0971dc0a None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:56.961937 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:56.979395 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297aee36-8273-4b3f-abe3-4a1a0971dc0a None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:57.029374 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea270106-e07b-4d3f-9430-695aea33b106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:57.030020 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea270106-e07b-4d3f-9430-695aea33b106 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:57.030300 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea270106-e07b-4d3f-9430-695aea33b106 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:57.030584 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea270106-e07b-4d3f-9430-695aea33b106 None admin] PATH_INFO: `/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:57.032340 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea270106-e07b-4d3f-9430-695aea33b106 None admin] RBAC: Authorizing `identity:get_project(project_id=f882e970082a40b2ad1a0f258ad7e3ba)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:57.033921 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea270106-e07b-4d3f-9430-695aea33b106 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:57.035975 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 145/293] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:05:56 2022] GET /identity/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:57.041721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f846849-a251-460d-b7f4-063d3e942bbf None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:57.144118 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:57.186502 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f846849-a251-460d-b7f4-063d3e942bbf None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:57.232017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c82567-80a7-4790-95c2-1ff9dbea2b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:57.232985 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c82567-80a7-4790-95c2-1ff9dbea2b7b None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:57.233361 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c82567-80a7-4790-95c2-1ff9dbea2b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:57.233814 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c82567-80a7-4790-95c2-1ff9dbea2b7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:57.235235 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c82567-80a7-4790-95c2-1ff9dbea2b7b None admin] RBAC: Adding query filter params (role.id=d970607307684690803e8e97e2d39e8f, scope.project.id=f882e970082a40b2ad1a0f258ad7e3ba, user.id=d8b798260f224ab0bd254196266bbf39) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:57.235679 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c82567-80a7-4790-95c2-1ff9dbea2b7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:57.237241 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c82567-80a7-4790-95c2-1ff9dbea2b7b None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:57.247046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 149/294] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:05:57 2022] GET /identity/v3/role_assignments?user.id=d8b798260f224ab0bd254196266bbf39&scope.project.id=f882e970082a40b2ad1a0f258ad7e3ba&role.id=d970607307684690803e8e97e2d39e8f => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:57.593508 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf8d00-f730-4e46-ba02-dd4be9a4bee0 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:57.594603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf8d00-f730-4e46-ba02-dd4be9a4bee0 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:57.594707 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf8d00-f730-4e46-ba02-dd4be9a4bee0 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:57.596049 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 146/295] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:57.601792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4284cf8-9ac6-4126-a498-41d9b5eeceac None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:57.602244 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4284cf8-9ac6-4126-a498-41d9b5eeceac None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:57.602448 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4284cf8-9ac6-4126-a498-41d9b5eeceac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:57.626945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-b4284cf8-9ac6-4126-a498-41d9b5eeceac None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:57.628452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-b4284cf8-9ac6-4126-a498-41d9b5eeceac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:57.720974 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 150/296] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:58.004794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf8d00-f730-4e46-ba02-dd4be9a4bee0 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:58.129382 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf8d00-f730-4e46-ba02-dd4be9a4bee0 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:58.168370 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448a9f5-91b5-46a0-97c5-9ce023b9aaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:58.169073 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448a9f5-91b5-46a0-97c5-9ce023b9aaa1 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:58.169352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448a9f5-91b5-46a0-97c5-9ce023b9aaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:58.169623 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448a9f5-91b5-46a0-97c5-9ce023b9aaa1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:58.182306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4448a9f5-91b5-46a0-97c5-9ce023b9aaa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:58.187475 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-4448a9f5-91b5-46a0-97c5-9ce023b9aaa1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:05:58.187475 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:58.187475 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:58.187475 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:58.187475 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:58.187475 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:58.187475 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:58.187475 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:58.187475 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:58.187475 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:58.187475 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:58.187475 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:58.187475 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:58.187475 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:58.187475 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:58.187475 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:58.188946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:58.188946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:58.188946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:58.188946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:58.188946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:58.188946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:58.188946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:58.188946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:58.188946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:58.188946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:58.188946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:58.188946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:58.188946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:58.188946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:58.188946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:58.188946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:58.189730 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:58.189730 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:58.189730 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:58.189730 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:58.189730 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:58.189730 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:58.189730 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:58.189730 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:58.189730 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:58.189730 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:58.189730 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:05:58.189730 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:05:58.189730 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 147/297] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:05:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:05:58.197101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4284cf8-9ac6-4126-a498-41d9b5eeceac None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:58.274746 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:58.327376 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4284cf8-9ac6-4126-a498-41d9b5eeceac None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:58.350604 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89937e05-d605-47c2-9b50-e97a315d9e51 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:58.350944 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89937e05-d605-47c2-9b50-e97a315d9e51 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:58.351313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89937e05-d605-47c2-9b50-e97a315d9e51 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:58.353912 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 148/298] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:58.361954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6e686-c4ee-480c-a07d-0871040f6b86 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:58.362463 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6e686-c4ee-480c-a07d-0871040f6b86 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:58.363027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6e686-c4ee-480c-a07d-0871040f6b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:58.383000 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38262c96-e325-48f2-8a3f-e6c90f8aee9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:58.383657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38262c96-e325-48f2-8a3f-e6c90f8aee9e None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:58.383940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38262c96-e325-48f2-8a3f-e6c90f8aee9e None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:58.384246 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38262c96-e325-48f2-8a3f-e6c90f8aee9e None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:58.384967 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38262c96-e325-48f2-8a3f-e6c90f8aee9e None admin] RBAC: Adding query filter params (name=member) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:58.385224 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38262c96-e325-48f2-8a3f-e6c90f8aee9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:58.386660 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38262c96-e325-48f2-8a3f-e6c90f8aee9e None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:58.391658 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-0ce6e686-c4ee-480c-a07d-0871040f6b86 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:58.393390 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-0ce6e686-c4ee-480c-a07d-0871040f6b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:58.395806 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 151/299] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:05:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:58.399381 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df53109-8571-46d1-acfc-9e7d22bf73b0 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:58.399381 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df53109-8571-46d1-acfc-9e7d22bf73b0 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:58.399381 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df53109-8571-46d1-acfc-9e7d22bf73b0 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:58.405891 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 152/300] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:58.405891 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df53109-8571-46d1-acfc-9e7d22bf73b0 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:58.419696 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:58.514241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 149/301] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:58.516453 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b8d1d-5a25-4034-82e3-4873b5bd7fb9 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:58.516965 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b8d1d-5a25-4034-82e3-4873b5bd7fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:58.517471 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b8d1d-5a25-4034-82e3-4873b5bd7fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:58.543139 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-077b8d1d-5a25-4034-82e3-4873b5bd7fb9 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:58.544991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-077b8d1d-5a25-4034-82e3-4873b5bd7fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:58.561347 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df53109-8571-46d1-acfc-9e7d22bf73b0 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:58.595099 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:58.606480 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef83c5-9565-42fa-894f-e5721e595bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:58.607275 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef83c5-9565-42fa-894f-e5721e595bab None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:58.607550 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef83c5-9565-42fa-894f-e5721e595bab None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:58.607713 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef83c5-9565-42fa-894f-e5721e595bab None admin] PATH_INFO: `/v3/users/15582458c24f48fbbe2380b946061e36` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:58.609886 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef83c5-9565-42fa-894f-e5721e595bab None admin] RBAC: Authorizing `identity:get_user(user_id=15582458c24f48fbbe2380b946061e36)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:58.612034 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef83c5-9565-42fa-894f-e5721e595bab None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:58.615583 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 153/302] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:58 2022] GET /identity/v3/users/15582458c24f48fbbe2380b946061e36 => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:58.620216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef83c5-9565-42fa-894f-e5721e595bab None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:58.635767 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 150/303] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:58.738378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef83c5-9565-42fa-894f-e5721e595bab None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:58.774327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5dae24-72f8-46fd-a859-cdabd563bdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:58.774989 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5dae24-72f8-46fd-a859-cdabd563bdc0 None admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:58.775331 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5dae24-72f8-46fd-a859-cdabd563bdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:58.775642 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5dae24-72f8-46fd-a859-cdabd563bdc0 None admin] PATH_INFO: `/v3/system/users/15582458c24f48fbbe2380b946061e36/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:58.777152 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5dae24-72f8-46fd-a859-cdabd563bdc0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=15582458c24f48fbbe2380b946061e36, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:58.778530 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5dae24-72f8-46fd-a859-cdabd563bdc0 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:58.801079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b8d1d-5a25-4034-82e3-4873b5bd7fb9 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:58.875849 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 154/304] 10.222.0.77 () {58 vars in 1334 bytes} [Tue Sep 6 20:05:58 2022] PUT /identity/v3/system/users/15582458c24f48fbbe2380b946061e36/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:05:58.883731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7495f27-1210-4a03-b76d-bbc601fa0554 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:58.883731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7495f27-1210-4a03-b76d-bbc601fa0554 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:58.883731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7495f27-1210-4a03-b76d-bbc601fa0554 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:58.883731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 155/305] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:05:58.885590 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecf5ce-f1a4-4e95-83d1-0b17eee2a2b1 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:58.885884 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecf5ce-f1a4-4e95-83d1-0b17eee2a2b1 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:58.886154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ecf5ce-f1a4-4e95-83d1-0b17eee2a2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:58.899407 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:58.907951 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-05ecf5ce-f1a4-4e95-83d1-0b17eee2a2b1 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:05:58.909184 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-05ecf5ce-f1a4-4e95-83d1-0b17eee2a2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:05:58.929160 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b8d1d-5a25-4034-82e3-4873b5bd7fb9 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:58.972986 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f977c-bb99-4fb3-b621-84c3f133e75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:58.973815 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:58.974220 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f977c-bb99-4fb3-b621-84c3f133e75e None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:58.974509 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f977c-bb99-4fb3-b621-84c3f133e75e None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:58.974783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f977c-bb99-4fb3-b621-84c3f133e75e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:58.988678 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f977c-bb99-4fb3-b621-84c3f133e75e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:58.991172 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 156/306] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:05:58.992332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecf5ce-f1a4-4e95-83d1-0b17eee2a2b1 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:58.993953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-a28f977c-bb99-4fb3-b621-84c3f133e75e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 20:05:58.993953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:58.993953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:58.993953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:58.993953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:58.993953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:58.993953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:58.993953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:58.993953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:58.993953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:58.993953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:58.993953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:58.993953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:58.993953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:58.993953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:58.993953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:58.994867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:58.994867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:58.994867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:58.994867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:58.994867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:58.994867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:58.994867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:58.994867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:58.994867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:58.994867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:58.994867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:58.994867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:58.994867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:58.994867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:58.994867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:58.994867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:59.001138 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:59.001138 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:59.001138 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:59.001138 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:59.001138 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:59.001138 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:59.001138 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:59.001138 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:59.001138 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:59.001138 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:59.001138 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 20:05:59.001138 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:05:59.001138 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 151/307] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:05:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:05:59.001791 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f977c-bb99-4fb3-b621-84c3f133e75e None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:59.136165 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ecf5ce-f1a4-4e95-83d1-0b17eee2a2b1 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:59.170257 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f977c-bb99-4fb3-b621-84c3f133e75e None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:59.177101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142cd39-1fe2-4988-9d38-2f3b2b6ee465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:59.177843 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142cd39-1fe2-4988-9d38-2f3b2b6ee465 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:59.178195 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142cd39-1fe2-4988-9d38-2f3b2b6ee465 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:59.178555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142cd39-1fe2-4988-9d38-2f3b2b6ee465 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:59.179972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142cd39-1fe2-4988-9d38-2f3b2b6ee465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:59.181516 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142cd39-1fe2-4988-9d38-2f3b2b6ee465 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:59.183417 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 157/308] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:05:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:59.190186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142cd39-1fe2-4988-9d38-2f3b2b6ee465 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:59.212786 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb53b0a-b309-4f73-963a-2ff6cc703d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:59.213413 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb53b0a-b309-4f73-963a-2ff6cc703d65 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:59.213693 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb53b0a-b309-4f73-963a-2ff6cc703d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:59.213969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb53b0a-b309-4f73-963a-2ff6cc703d65 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:59.215238 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb53b0a-b309-4f73-963a-2ff6cc703d65 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:59.215584 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb53b0a-b309-4f73-963a-2ff6cc703d65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:59.217263 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb53b0a-b309-4f73-963a-2ff6cc703d65 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:59.225353 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:59.229340 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 152/309] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:05:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:59.235054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb53b0a-b309-4f73-963a-2ff6cc703d65 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:59.261396 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:59.316117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142cd39-1fe2-4988-9d38-2f3b2b6ee465 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:59.357552 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30982f57-2f90-4a23-9a61-c2e0f090319c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:59.358210 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30982f57-2f90-4a23-9a61-c2e0f090319c None admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:59.358452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30982f57-2f90-4a23-9a61-c2e0f090319c None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:59.358724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30982f57-2f90-4a23-9a61-c2e0f090319c None admin] PATH_INFO: `/v3/groups` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:59.359943 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30982f57-2f90-4a23-9a61-c2e0f090319c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:59.361387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30982f57-2f90-4a23-9a61-c2e0f090319c None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:59.368333 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb53b0a-b309-4f73-963a-2ff6cc703d65 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:59.406647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d62628-155b-4cbd-bdf9-63b04396e3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:59.407210 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d62628-155b-4cbd-bdf9-63b04396e3ec None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:59.407521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d62628-155b-4cbd-bdf9-63b04396e3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:59.407795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d62628-155b-4cbd-bdf9-63b04396e3ec None admin] PATH_INFO: `/v3/users/a2ea327648af4becadf50663784dc3df` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:59.427769 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d62628-155b-4cbd-bdf9-63b04396e3ec None admin] RBAC: Authorizing `identity:get_user(user_id=a2ea327648af4becadf50663784dc3df)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:59.429254 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d62628-155b-4cbd-bdf9-63b04396e3ec None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:59.430959 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 153/310] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:59 2022] GET /identity/v3/users/a2ea327648af4becadf50663784dc3df => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:59.432862 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d62628-155b-4cbd-bdf9-63b04396e3ec None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:59.443249 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 158/311] 10.222.0.77 () {60 vars in 1134 bytes} [Tue Sep 6 20:05:59 2022] POST /identity/v3/groups => generated 229 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:05:59.444005 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30982f57-2f90-4a23-9a61-c2e0f090319c None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:59.532757 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:59.589561 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d62628-155b-4cbd-bdf9-63b04396e3ec None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:59.634912 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765058da-efdf-448b-90cc-e0d750b89572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:59.635732 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765058da-efdf-448b-90cc-e0d750b89572 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:59.636082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765058da-efdf-448b-90cc-e0d750b89572 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:59.636655 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765058da-efdf-448b-90cc-e0d750b89572 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:59.650706 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765058da-efdf-448b-90cc-e0d750b89572 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:05:59.657646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-765058da-efdf-448b-90cc-e0d750b89572 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 20:05:59.657646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:05:59.657646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:05:59.657646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:05:59.657646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:05:59.657646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:05:59.657646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:05:59.657646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:05:59.657646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:05:59.657646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:05:59.657646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:05:59.657646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:05:59.657646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:05:59.657646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:05:59.657646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:05:59.657646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:05:59.658573 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:05:59.658573 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:05:59.658573 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:05:59.658573 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:05:59.658573 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:05:59.658573 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:05:59.658573 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:05:59.658573 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:05:59.658573 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:05:59.658573 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:05:59.658573 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:05:59.658573 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:05:59.658573 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:05:59.658573 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:05:59.658573 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:05:59.658573 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:05:59.659366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:05:59.659366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:05:59.659366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:05:59.659366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:05:59.659366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:05:59.659366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:05:59.659366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:05:59.659366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:05:59.659366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:05:59.659366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:05:59.659366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 20:05:59.659366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:05:59.659366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 154/312] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:05:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:05:59.663693 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30982f57-2f90-4a23-9a61-c2e0f090319c None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:59.664806 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765058da-efdf-448b-90cc-e0d750b89572 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:59.685348 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:59.720165 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d032a-c797-48f7-9659-cbf885ecf6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:59.720827 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d032a-c797-48f7-9659-cbf885ecf6cb None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:59.721074 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d032a-c797-48f7-9659-cbf885ecf6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:59.721900 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d032a-c797-48f7-9659-cbf885ecf6cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:59.722644 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d032a-c797-48f7-9659-cbf885ecf6cb None admin] RBAC: Adding query filter params (role.id=118b6fc03d22492f83f70dd2da6b374d, user.id=a2ea327648af4becadf50663784dc3df, scope.system=all) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:59.723697 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d032a-c797-48f7-9659-cbf885ecf6cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:59.725246 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d032a-c797-48f7-9659-cbf885ecf6cb None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:59.731533 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 159/313] 10.222.0.77 () {56 vars in 1308 bytes} [Tue Sep 6 20:05:59 2022] GET /identity/v3/role_assignments?user.id=a2ea327648af4becadf50663784dc3df&scope.system=all&role.id=118b6fc03d22492f83f70dd2da6b374d => generated 226 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:59.807888 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765058da-efdf-448b-90cc-e0d750b89572 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:05:59.830719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:05:59.850933 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19585c45-9e38-42f4-99fb-ad180f608d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:05:59.851590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19585c45-9e38-42f4-99fb-ad180f608d84 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:05:59.851877 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19585c45-9e38-42f4-99fb-ad180f608d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:05:59.852148 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19585c45-9e38-42f4-99fb-ad180f608d84 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:05:59.852822 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19585c45-9e38-42f4-99fb-ad180f608d84 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:05:59.853127 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19585c45-9e38-42f4-99fb-ad180f608d84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:05:59.854547 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19585c45-9e38-42f4-99fb-ad180f608d84 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:05:59.865422 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 155/314] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:05:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:05:59.871604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d032a-c797-48f7-9659-cbf885ecf6cb None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:05:59.990252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d032a-c797-48f7-9659-cbf885ecf6cb None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:00.029102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b93005-076d-4bad-9fb6-03e6c92dc17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:00.030004 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b93005-076d-4bad-9fb6-03e6c92dc17a None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:00.030359 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b93005-076d-4bad-9fb6-03e6c92dc17a None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:00.030634 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b93005-076d-4bad-9fb6-03e6c92dc17a None admin] PATH_INFO: `/v3/users/a64a99fc223e4a32bcee59adebc9033a` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:00.032112 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b93005-076d-4bad-9fb6-03e6c92dc17a None admin] RBAC: Authorizing `identity:get_user(user_id=a64a99fc223e4a32bcee59adebc9033a)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:00.033713 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b93005-076d-4bad-9fb6-03e6c92dc17a None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:00.035345 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 160/315] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:05:59 2022] GET /identity/v3/users/a64a99fc223e4a32bcee59adebc9033a => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:00.041029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19585c45-9e38-42f4-99fb-ad180f608d84 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:00.161465 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19585c45-9e38-42f4-99fb-ad180f608d84 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:00.200218 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfa806-6605-40ce-b22a-ce84df59ff5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:00.200838 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfa806-6605-40ce-b22a-ce84df59ff5b None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:00.201117 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfa806-6605-40ce-b22a-ce84df59ff5b None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:00.201392 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfa806-6605-40ce-b22a-ce84df59ff5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:00.256055 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:00.278028 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfa806-6605-40ce-b22a-ce84df59ff5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:00.279558 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfa806-6605-40ce-b22a-ce84df59ff5b None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:00.389998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 156/316] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:06:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:06:00.395401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b93005-076d-4bad-9fb6-03e6c92dc17a None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:00.460530 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:00.518661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b93005-076d-4bad-9fb6-03e6c92dc17a None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:00.556088 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8536ff-ad61-49f4-ba85-1453b420050e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:00.556751 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8536ff-ad61-49f4-ba85-1453b420050e None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:00.557031 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8536ff-ad61-49f4-ba85-1453b420050e None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:00.557303 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8536ff-ad61-49f4-ba85-1453b420050e None admin] PATH_INFO: `/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:00.558641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8536ff-ad61-49f4-ba85-1453b420050e None admin] RBAC: Authorizing `identity:get_project(project_id=f882e970082a40b2ad1a0f258ad7e3ba)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:00.560198 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8536ff-ad61-49f4-ba85-1453b420050e None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:00.562148 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 161/317] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:06:00 2022] GET /identity/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:00.568602 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfa806-6605-40ce-b22a-ce84df59ff5b None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:00.661687 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:00.682195 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfa806-6605-40ce-b22a-ce84df59ff5b None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:00.720186 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238cf9f-8b46-4196-bdc3-96818fda015b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:00.720805 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238cf9f-8b46-4196-bdc3-96818fda015b None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:00.721085 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238cf9f-8b46-4196-bdc3-96818fda015b None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:00.721354 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238cf9f-8b46-4196-bdc3-96818fda015b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:00.722090 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238cf9f-8b46-4196-bdc3-96818fda015b None admin] RBAC: Adding query filter params (role.id=118b6fc03d22492f83f70dd2da6b374d, scope.project.id=f882e970082a40b2ad1a0f258ad7e3ba, user.id=a64a99fc223e4a32bcee59adebc9033a) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:00.722395 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238cf9f-8b46-4196-bdc3-96818fda015b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:00.723932 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238cf9f-8b46-4196-bdc3-96818fda015b None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:00.731292 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 157/318] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:06:00 2022] GET /identity/v3/role_assignments?user.id=a64a99fc223e4a32bcee59adebc9033a&scope.project.id=f882e970082a40b2ad1a0f258ad7e3ba&role.id=118b6fc03d22492f83f70dd2da6b374d => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:06:01.137525 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78715277-c79e-4986-a0ef-3c8037dfab4e None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:01.138028 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78715277-c79e-4986-a0ef-3c8037dfab4e None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:01.138103 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78715277-c79e-4986-a0ef-3c8037dfab4e None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:01.139595 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 162/319] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:01.146146 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5dbf5-bc3d-4ab1-938c-9b17d1deb0de None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:01.146464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5dbf5-bc3d-4ab1-938c-9b17d1deb0de None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:01.146695 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5dbf5-bc3d-4ab1-938c-9b17d1deb0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:01.165499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-55a5dbf5-bc3d-4ab1-938c-9b17d1deb0de None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:01.166676 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-55a5dbf5-bc3d-4ab1-938c-9b17d1deb0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:01.238021 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 158/320] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:01.501898 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78715277-c79e-4986-a0ef-3c8037dfab4e None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:01.608139 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78715277-c79e-4986-a0ef-3c8037dfab4e None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:01.625408 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:01.645470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01e190-9254-4aa5-a5f6-48802b4c7fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:01.646113 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01e190-9254-4aa5-a5f6-48802b4c7fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:01.646388 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01e190-9254-4aa5-a5f6-48802b4c7fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:01.646659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01e190-9254-4aa5-a5f6-48802b4c7fa7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:01.657916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01e190-9254-4aa5-a5f6-48802b4c7fa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:01.663131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-cb01e190-9254-4aa5-a5f6-48802b4c7fa7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:06:01.663131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:01.663131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:01.663131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:01.663131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:01.663131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:01.663131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:01.663131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:01.663131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:01.663131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:01.663131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:01.663131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:01.663131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:01.663131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:01.663131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:01.663131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:01.664106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:01.664106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:01.664106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:01.664106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:01.664106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:01.664106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:01.664106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:01.664106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:01.664106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:01.664106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:01.664106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:01.664106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:01.664106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:01.664106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:01.664106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:01.664106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:01.664978 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:01.664978 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:01.664978 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:01.664978 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:01.664978 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:01.664978 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:01.664978 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:01.664978 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:01.664978 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:01.664978 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:01.664978 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:06:01.664978 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:01.664978 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 163/321] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:06:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:01.670168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5dbf5-bc3d-4ab1-938c-9b17d1deb0de None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:01.750635 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:01.778041 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5dbf5-bc3d-4ab1-938c-9b17d1deb0de None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:01.822760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe559a02-c644-48ce-aaed-1b3142519f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:01.823394 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe559a02-c644-48ce-aaed-1b3142519f42 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:01.823705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe559a02-c644-48ce-aaed-1b3142519f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:01.824002 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe559a02-c644-48ce-aaed-1b3142519f42 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:01.824675 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe559a02-c644-48ce-aaed-1b3142519f42 None admin] RBAC: Adding query filter params (name=member) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:01.824976 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe559a02-c644-48ce-aaed-1b3142519f42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:01.826369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe559a02-c644-48ce-aaed-1b3142519f42 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:01.839774 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 159/322] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:06:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:01.841230 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01e190-9254-4aa5-a5f6-48802b4c7fa7 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:01.902923 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2444c8-c1aa-4a53-a0ef-2f0c4d51f41f None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:01.903229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2444c8-c1aa-4a53-a0ef-2f0c4d51f41f None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:01.903510 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2444c8-c1aa-4a53-a0ef-2f0c4d51f41f None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:01.904861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 160/323] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:06:01.910160 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9829f-cf52-4401-8707-a35244f8e510 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:01.910458 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9829f-cf52-4401-8707-a35244f8e510 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:01.910734 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9829f-cf52-4401-8707-a35244f8e510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:01.930199 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-1ad9829f-cf52-4401-8707-a35244f8e510 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:01.931423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-1ad9829f-cf52-4401-8707-a35244f8e510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:01.951948 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01e190-9254-4aa5-a5f6-48802b4c7fa7 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:01.993833 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11022888-74c8-4589-b142-4c2e20f7a310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:01.994495 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11022888-74c8-4589-b142-4c2e20f7a310 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:01.994772 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11022888-74c8-4589-b142-4c2e20f7a310 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:01.995040 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11022888-74c8-4589-b142-4c2e20f7a310 None admin] PATH_INFO: `/v3/users/15582458c24f48fbbe2380b946061e36` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:01.996236 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11022888-74c8-4589-b142-4c2e20f7a310 None admin] RBAC: Authorizing `identity:get_user(user_id=15582458c24f48fbbe2380b946061e36)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:01.997692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11022888-74c8-4589-b142-4c2e20f7a310 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:01.999485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 164/324] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:06:01 2022] GET /identity/v3/users/15582458c24f48fbbe2380b946061e36 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:06:02.006195 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11022888-74c8-4589-b142-4c2e20f7a310 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:02.015287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 161/325] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 20:06:02.065902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:02.083369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57651e54-8b6a-4a69-8f89-e3ab7bba9c89 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:02.083708 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57651e54-8b6a-4a69-8f89-e3ab7bba9c89 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:02.083947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57651e54-8b6a-4a69-8f89-e3ab7bba9c89 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:02.085297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 162/326] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:02.090461 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43912f40-d44c-4eb2-a0c7-f9a0e88b53eb None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:02.090799 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43912f40-d44c-4eb2-a0c7-f9a0e88b53eb None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:02.091074 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43912f40-d44c-4eb2-a0c7-f9a0e88b53eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:02.111471 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-43912f40-d44c-4eb2-a0c7-f9a0e88b53eb None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:02.112727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-43912f40-d44c-4eb2-a0c7-f9a0e88b53eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:02.131935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11022888-74c8-4589-b142-4c2e20f7a310 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:02.173462 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b796040-fe36-4423-b6c6-3b267a280001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:02.174099 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b796040-fe36-4423-b6c6-3b267a280001 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:02.174339 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b796040-fe36-4423-b6c6-3b267a280001 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:02.174609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b796040-fe36-4423-b6c6-3b267a280001 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:02.175357 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b796040-fe36-4423-b6c6-3b267a280001 None admin] RBAC: Adding query filter params (role.id=d970607307684690803e8e97e2d39e8f, user.id=15582458c24f48fbbe2380b946061e36, scope.system=all) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:02.175691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b796040-fe36-4423-b6c6-3b267a280001 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:02.177144 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b796040-fe36-4423-b6c6-3b267a280001 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:02.184952 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:02.189902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 165/327] 10.222.0.77 () {56 vars in 1308 bytes} [Tue Sep 6 20:06:02 2022] GET /identity/v3/role_assignments?user.id=15582458c24f48fbbe2380b946061e36&scope.system=all&role.id=d970607307684690803e8e97e2d39e8f => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:02.193627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 163/328] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 20:06:02.287329 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b796040-fe36-4423-b6c6-3b267a280001 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:02.416401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b796040-fe36-4423-b6c6-3b267a280001 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:02.418190 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:02.453630 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26165b18-dc26-409b-b230-6f5a8f97678d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:02.454258 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26165b18-dc26-409b-b230-6f5a8f97678d None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:02.454536 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26165b18-dc26-409b-b230-6f5a8f97678d None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:02.454803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26165b18-dc26-409b-b230-6f5a8f97678d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:02.455921 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26165b18-dc26-409b-b230-6f5a8f97678d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:02.457373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26165b18-dc26-409b-b230-6f5a8f97678d None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:02.458942 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 166/329] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:02.464958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43912f40-d44c-4eb2-a0c7-f9a0e88b53eb None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:02.467307 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26165b18-dc26-409b-b230-6f5a8f97678d None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:02.568215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43912f40-d44c-4eb2-a0c7-f9a0e88b53eb None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:02.571104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26165b18-dc26-409b-b230-6f5a8f97678d None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:02.605058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b541963-f9f3-493d-985d-11efc58f2f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:02.605702 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b541963-f9f3-493d-985d-11efc58f2f73 None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:02.605803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a513ecb-112f-44b0-b23a-acbb7fb0935d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:02.605958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b541963-f9f3-493d-985d-11efc58f2f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:02.606226 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b541963-f9f3-493d-985d-11efc58f2f73 None admin] PATH_INFO: `/v3/groups` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:02.606441 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a513ecb-112f-44b0-b23a-acbb7fb0935d None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:02.606721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a513ecb-112f-44b0-b23a-acbb7fb0935d None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:02.606853 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b541963-f9f3-493d-985d-11efc58f2f73 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:02.606998 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a513ecb-112f-44b0-b23a-acbb7fb0935d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:02.608355 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b541963-f9f3-493d-985d-11efc58f2f73 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:02.617279 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a513ecb-112f-44b0-b23a-acbb7fb0935d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:02.622586 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-9a513ecb-112f-44b0-b23a-acbb7fb0935d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 20:06:02.622586 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:02.622586 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:02.622586 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:02.622586 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:02.622586 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:02.622586 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:02.622586 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:02.622586 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:02.622586 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:02.622586 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:02.622586 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:02.622586 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:02.622586 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:02.622586 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:02.622586 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:02.633082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:02.633082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:02.633082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:02.633082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:02.633082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:02.633082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:02.633082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:02.633082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:02.633082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:02.633082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:02.633082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:02.633082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:02.633082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:02.633082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:02.633082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:02.633082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:02.633846 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:02.633846 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:02.633846 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:02.633846 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:02.633846 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:02.633846 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:02.633846 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:02.633846 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:02.633846 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:02.633846 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:02.633846 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 20:06:02.633846 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:02.633846 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 167/330] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:06:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:02.633846 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a513ecb-112f-44b0-b23a-acbb7fb0935d None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:02.661105 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:02.732783 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a513ecb-112f-44b0-b23a-acbb7fb0935d None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:02.766337 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 164/331] 10.222.0.77 () {60 vars in 1134 bytes} [Tue Sep 6 20:06:02 2022] POST /identity/v3/groups => generated 226 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:06:02.768214 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034a5d2-cfdb-452a-bd3f-2349da62874a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:02.780731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034a5d2-cfdb-452a-bd3f-2349da62874a None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:02.780731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034a5d2-cfdb-452a-bd3f-2349da62874a None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:02.780731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034a5d2-cfdb-452a-bd3f-2349da62874a None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:02.780731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034a5d2-cfdb-452a-bd3f-2349da62874a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:02.780731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034a5d2-cfdb-452a-bd3f-2349da62874a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:02.780731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034a5d2-cfdb-452a-bd3f-2349da62874a None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:02.782160 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 168/332] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:06:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:06:02.788224 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b541963-f9f3-493d-985d-11efc58f2f73 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:02.853816 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:02.902698 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b541963-f9f3-493d-985d-11efc58f2f73 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:02.940744 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91452d32-7a81-47b4-abef-345a30b1bef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:02.941661 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91452d32-7a81-47b4-abef-345a30b1bef6 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:02.942097 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91452d32-7a81-47b4-abef-345a30b1bef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:02.942789 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91452d32-7a81-47b4-abef-345a30b1bef6 None admin] PATH_INFO: `/v3/users/a2ea327648af4becadf50663784dc3df` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:02.944013 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91452d32-7a81-47b4-abef-345a30b1bef6 None admin] RBAC: Authorizing `identity:get_user(user_id=a2ea327648af4becadf50663784dc3df)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:02.945459 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91452d32-7a81-47b4-abef-345a30b1bef6 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:02.947057 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 165/333] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:06:02 2022] GET /identity/v3/users/a2ea327648af4becadf50663784dc3df => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:02.952785 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034a5d2-cfdb-452a-bd3f-2349da62874a None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:03.053239 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:03.061979 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034a5d2-cfdb-452a-bd3f-2349da62874a None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:03.101301 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e547e5a-291d-465a-b699-534481a5bbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:03.102328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e547e5a-291d-465a-b699-534481a5bbaf None admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:03.102803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e547e5a-291d-465a-b699-534481a5bbaf None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:03.103082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e547e5a-291d-465a-b699-534481a5bbaf None admin] PATH_INFO: `/v3/system/users/a2ea327648af4becadf50663784dc3df/roles/118b6fc03d22492f83f70dd2da6b374d` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:03.104667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e547e5a-291d-465a-b699-534481a5bbaf None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a2ea327648af4becadf50663784dc3df, role_id=118b6fc03d22492f83f70dd2da6b374d)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:03.106051 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e547e5a-291d-465a-b699-534481a5bbaf None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:03.213183 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 169/334] 10.222.0.77 () {58 vars in 1334 bytes} [Tue Sep 6 20:06:02 2022] PUT /identity/v3/system/users/a2ea327648af4becadf50663784dc3df/roles/118b6fc03d22492f83f70dd2da6b374d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:06:05.166718 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0730837-394e-47e0-ae03-5f479fd0a9f0 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:05.167253 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0730837-394e-47e0-ae03-5f479fd0a9f0 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:05.167253 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0730837-394e-47e0-ae03-5f479fd0a9f0 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:05.168921 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 166/335] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:05.177451 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd340d3e-ac0b-40ad-80fb-c26c35ed3f87 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:05.178387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd340d3e-ac0b-40ad-80fb-c26c35ed3f87 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:05.178882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd340d3e-ac0b-40ad-80fb-c26c35ed3f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:05.208546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-dd340d3e-ac0b-40ad-80fb-c26c35ed3f87 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:05.210186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-dd340d3e-ac0b-40ad-80fb-c26c35ed3f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:05.293615 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 170/336] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 20:06:05.639381 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b1de4-d29b-459d-90bd-1c46827d5f6a None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:05.640241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b1de4-d29b-459d-90bd-1c46827d5f6a None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:05.641269 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b1de4-d29b-459d-90bd-1c46827d5f6a None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:05.643114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 167/337] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:05.648968 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12822e-e010-4f99-84df-9b3844d4f27b None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:05.649573 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12822e-e010-4f99-84df-9b3844d4f27b None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:05.650063 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12822e-e010-4f99-84df-9b3844d4f27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:05.680504 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-bd12822e-e010-4f99-84df-9b3844d4f27b None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:05.682096 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-bd12822e-e010-4f99-84df-9b3844d4f27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:05.768766 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 171/338] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:05.869051 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b1de4-d29b-459d-90bd-1c46827d5f6a None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:06.045121 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b1de4-d29b-459d-90bd-1c46827d5f6a None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:06.077262 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:06.094864 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e1945-13df-4740-ba59-f597b4236bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:06.107914 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e1945-13df-4740-ba59-f597b4236bcc None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:06.107914 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e1945-13df-4740-ba59-f597b4236bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:06.107914 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e1945-13df-4740-ba59-f597b4236bcc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:06.111854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e1945-13df-4740-ba59-f597b4236bcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:06.117044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-0f3e1945-13df-4740-ba59-f597b4236bcc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:06:06.117044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:06.117044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:06.117044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:06.117044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:06.117044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:06.117044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:06.117044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:06.117044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:06.117044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:06.117044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:06.117044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:06.117044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:06.117044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:06.117044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:06.117044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:06.118174 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:06.118174 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:06.118174 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:06.118174 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:06.118174 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:06.118174 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:06.118174 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:06.118174 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:06.118174 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:06.118174 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:06.118174 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:06.118174 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:06.118174 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:06.118174 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:06.118174 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:06.118174 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:06.119212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:06.119212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:06.119212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:06.119212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:06.119212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:06.119212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:06.119212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:06.119212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:06.119212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:06.119212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:06.119212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:06:06.119212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:06.121240 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 168/339] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:06:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:06.128101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12822e-e010-4f99-84df-9b3844d4f27b None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:06.147967 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:06.242959 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12822e-e010-4f99-84df-9b3844d4f27b None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:06.326774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5d006-c692-495e-9dc8-22c4912b7e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:06.326774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5d006-c692-495e-9dc8-22c4912b7e14 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:06.326774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5d006-c692-495e-9dc8-22c4912b7e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:06.326774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5d006-c692-495e-9dc8-22c4912b7e14 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:06.327182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5d006-c692-495e-9dc8-22c4912b7e14 None admin] RBAC: Adding query filter params (name=member) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:06.327182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5d006-c692-495e-9dc8-22c4912b7e14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:06.327182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5d006-c692-495e-9dc8-22c4912b7e14 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:06.327182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 172/340] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:06:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:06.327428 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e1945-13df-4740-ba59-f597b4236bcc None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:06.335143 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5d006-c692-495e-9dc8-22c4912b7e14 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:06.491831 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:06.498872 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e1945-13df-4740-ba59-f597b4236bcc None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:06.502620 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5d006-c692-495e-9dc8-22c4912b7e14 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:06.544138 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2dea2-a42e-4897-88b8-b32254be14cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:06.544769 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2dea2-a42e-4897-88b8-b32254be14cd None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:06.545056 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2dea2-a42e-4897-88b8-b32254be14cd None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:06.545329 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2dea2-a42e-4897-88b8-b32254be14cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:06.578481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943083ca-ac44-4a4d-ae44-5b22795d5373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:06.579007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943083ca-ac44-4a4d-ae44-5b22795d5373 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:06.579287 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943083ca-ac44-4a4d-ae44-5b22795d5373 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:06.579585 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943083ca-ac44-4a4d-ae44-5b22795d5373 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:06.594302 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943083ca-ac44-4a4d-ae44-5b22795d5373 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:06.599415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-943083ca-ac44-4a4d-ae44-5b22795d5373 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 20:06:06.599415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:06.599415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:06.599415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:06.599415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:06.599415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:06.599415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:06.599415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:06.599415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:06.599415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:06.599415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:06.599415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:06.599415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:06.599415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:06.599415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:06.599415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:06.600334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:06.600334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:06.600334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:06.600334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:06.600334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:06.600334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:06.600334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:06.600334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:06.600334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:06.600334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:06.600334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:06.600334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:06.600334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:06.600334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:06.600334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:06.600334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:06.601131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:06.601131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:06.601131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:06.601131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:06.601131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:06.601131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:06.601131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:06.601131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:06.601131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:06.601131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:06.601131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 20:06:06.601131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:06.601131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 173/341] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Sep 6 20:06:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:06.602262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37660ce6-3551-46a0-b113-2d03a06b3831 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:06.602262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37660ce6-3551-46a0-b113-2d03a06b3831 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:06.602547 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37660ce6-3551-46a0-b113-2d03a06b3831 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:06.610122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 174/342] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:06.611361 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72029a23-5eb9-4723-964e-c30694ccc79a None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:06.611668 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72029a23-5eb9-4723-964e-c30694ccc79a None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:06.611945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72029a23-5eb9-4723-964e-c30694ccc79a None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:06.614024 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 175/343] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:06.614756 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72029a23-5eb9-4723-964e-c30694ccc79a None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:06.614959 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:06.641118 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2dea2-a42e-4897-88b8-b32254be14cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:06.643091 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2dea2-a42e-4897-88b8-b32254be14cd None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:06.739404 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72029a23-5eb9-4723-964e-c30694ccc79a None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:06.772466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 169/344] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:06:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:06:06.774115 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1176e-e6ae-4398-a3f8-13c0454a2e52 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:06.774561 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1176e-e6ae-4398-a3f8-13c0454a2e52 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:06.774844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1176e-e6ae-4398-a3f8-13c0454a2e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:06.786953 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65378743-23be-4340-ab95-26332a195f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:06.787706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65378743-23be-4340-ab95-26332a195f47 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:06.787987 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65378743-23be-4340-ab95-26332a195f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:06.788261 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65378743-23be-4340-ab95-26332a195f47 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:06.789012 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65378743-23be-4340-ab95-26332a195f47 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:06.789316 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65378743-23be-4340-ab95-26332a195f47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:06.790691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65378743-23be-4340-ab95-26332a195f47 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:06.796610 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:06.799395 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-41f1176e-e6ae-4398-a3f8-13c0454a2e52 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:06.800641 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-41f1176e-e6ae-4398-a3f8-13c0454a2e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:06.800910 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 176/345] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:06:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:06.807824 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7555c5-654e-44df-b8ba-f2d5a73bd6a5 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:06.811226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7555c5-654e-44df-b8ba-f2d5a73bd6a5 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:06.811226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7555c5-654e-44df-b8ba-f2d5a73bd6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:06.836961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-bd7555c5-654e-44df-b8ba-f2d5a73bd6a5 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:06.838361 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-bd7555c5-654e-44df-b8ba-f2d5a73bd6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:06.903400 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 170/346] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:06.904603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1176e-e6ae-4398-a3f8-13c0454a2e52 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:06.927552 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:06.965483 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 177/347] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:06.967107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7555c5-654e-44df-b8ba-f2d5a73bd6a5 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:07.053077 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1176e-e6ae-4398-a3f8-13c0454a2e52 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:07.098804 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49971ee7-fcb1-4bec-bb83-821bfb3f98ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:07.099633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49971ee7-fcb1-4bec-bb83-821bfb3f98ee None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:07.099923 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49971ee7-fcb1-4bec-bb83-821bfb3f98ee None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:07.100196 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49971ee7-fcb1-4bec-bb83-821bfb3f98ee None admin] PATH_INFO: `/v3/projects/0372b5f500b44066a9e11389f07e647e` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:07.101746 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49971ee7-fcb1-4bec-bb83-821bfb3f98ee None admin] RBAC: Authorizing `identity:get_project(project_id=0372b5f500b44066a9e11389f07e647e)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:07.103739 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49971ee7-fcb1-4bec-bb83-821bfb3f98ee None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:07.106368 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 171/348] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:06:06 2022] GET /identity/v3/projects/0372b5f500b44066a9e11389f07e647e => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:07.108064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7555c5-654e-44df-b8ba-f2d5a73bd6a5 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:07.111958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49971ee7-fcb1-4bec-bb83-821bfb3f98ee None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:07.151536 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:07.168854 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3302638-78e9-480a-8be5-5db94b1283fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:07.171712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3302638-78e9-480a-8be5-5db94b1283fc None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:07.171712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3302638-78e9-480a-8be5-5db94b1283fc None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:07.171712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3302638-78e9-480a-8be5-5db94b1283fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:07.272943 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:07.320711 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49971ee7-fcb1-4bec-bb83-821bfb3f98ee None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:07.332499 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3302638-78e9-480a-8be5-5db94b1283fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:07.337132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3302638-78e9-480a-8be5-5db94b1283fc None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:07.392156 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648bf7d-e11b-479c-9d65-66ccf7ecd443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:07.392785 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648bf7d-e11b-479c-9d65-66ccf7ecd443 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:07.392997 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648bf7d-e11b-479c-9d65-66ccf7ecd443 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:07.393272 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648bf7d-e11b-479c-9d65-66ccf7ecd443 None admin] PATH_INFO: `/v3/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:07.413333 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648bf7d-e11b-479c-9d65-66ccf7ecd443 None admin] RBAC: Authorizing `identity:get_group(group_id=e3c6f0ef212b4ef4a5007d1c2f4d048c)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:07.415707 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648bf7d-e11b-479c-9d65-66ccf7ecd443 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:07.417621 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 172/349] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Sep 6 20:06:07 2022] GET /identity/v3/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c => generated 226 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:07.426535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648bf7d-e11b-479c-9d65-66ccf7ecd443 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:07.551876 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 178/350] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:06:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:06:07.552738 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3302638-78e9-480a-8be5-5db94b1283fc None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:07.588006 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:07.589175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648bf7d-e11b-479c-9d65-66ccf7ecd443 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:07.632043 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1e761-f344-49b4-81cc-3c9fc17af7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:07.632841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1e761-f344-49b4-81cc-3c9fc17af7ca None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:07.633131 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1e761-f344-49b4-81cc-3c9fc17af7ca None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:07.633433 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1e761-f344-49b4-81cc-3c9fc17af7ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:07.634246 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a1e761-f344-49b4-81cc-3c9fc17af7ca None admin] RBAC: Adding query filter params (group.id=e3c6f0ef212b4ef4a5007d1c2f4d048c, role.id=d970607307684690803e8e97e2d39e8f, scope.project.id=0372b5f500b44066a9e11389f07e647e) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:07.634560 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a1e761-f344-49b4-81cc-3c9fc17af7ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:07.638569 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a1e761-f344-49b4-81cc-3c9fc17af7ca None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:07.646386 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 173/351] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Sep 6 20:06:07 2022] GET /identity/v3/role_assignments?group.id=e3c6f0ef212b4ef4a5007d1c2f4d048c&scope.project.id=0372b5f500b44066a9e11389f07e647e&role.id=d970607307684690803e8e97e2d39e8f => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:07.648406 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1e761-f344-49b4-81cc-3c9fc17af7ca None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:07.666285 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:07.685824 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3302638-78e9-480a-8be5-5db94b1283fc None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:07.760815 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62c153-6b5b-4797-a9c0-1dca1a7d6ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:07.761471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62c153-6b5b-4797-a9c0-1dca1a7d6ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:07.761982 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62c153-6b5b-4797-a9c0-1dca1a7d6ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:07.762275 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62c153-6b5b-4797-a9c0-1dca1a7d6ed7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:07.778155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab62c153-6b5b-4797-a9c0-1dca1a7d6ed7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:07.783164 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-ab62c153-6b5b-4797-a9c0-1dca1a7d6ed7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 20:06:07.783164 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:07.783164 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:07.783164 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:07.783164 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:07.783164 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:07.783164 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:07.783164 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:07.783164 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:07.783164 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:07.783164 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:07.783164 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:07.783164 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:07.783164 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:07.783164 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:07.783164 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:07.784252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:07.784252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:07.784252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:07.784252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:07.784252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:07.784252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:07.784252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:07.784252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:07.784252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:07.784252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:07.784252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:07.784252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:07.784252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:07.784252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:07.784252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:07.784252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:07.785052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:07.785052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:07.785052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:07.785052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:07.785052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:07.785052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:07.785052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:07.785052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:07.785052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:07.785052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:07.785052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 20:06:07.785052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:07.785052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 179/352] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:06:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:07.785716 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62c153-6b5b-4797-a9c0-1dca1a7d6ed7 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:07.802959 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1e761-f344-49b4-81cc-3c9fc17af7ca None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:07.856853 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75991070-46a1-4e1f-8fe7-51f853829575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:07.857655 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75991070-46a1-4e1f-8fe7-51f853829575 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:07.858031 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75991070-46a1-4e1f-8fe7-51f853829575 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:07.858312 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75991070-46a1-4e1f-8fe7-51f853829575 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:07.874445 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75991070-46a1-4e1f-8fe7-51f853829575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:07.880505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-75991070-46a1-4e1f-8fe7-51f853829575 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:06:07.880505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:07.880505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:07.880505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:07.880505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:07.880505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:07.880505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:07.880505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:07.880505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:07.880505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:07.880505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:07.880505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:07.880505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:07.880505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:07.880505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:07.880505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:07.881643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:07.881643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:07.881643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:07.881643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:07.881643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:07.881643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:07.881643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:07.881643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:07.881643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:07.881643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:07.881643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:07.881643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:07.881643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:07.881643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:07.881643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:07.881643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:07.882458 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:07.882458 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:07.882458 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:07.882458 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:07.882458 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:07.882458 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:07.882458 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:07.882458 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:07.882458 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:07.882458 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:07.882458 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:06:07.882458 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:07.882458 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 174/353] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:06:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:07.883106 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2ed90-0e54-4a82-8b12-82afebf1c4d8 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:07.883349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2ed90-0e54-4a82-8b12-82afebf1c4d8 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:07.884655 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2ed90-0e54-4a82-8b12-82afebf1c4d8 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:07.886843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 175/354] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:07.892838 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49384026-ef7b-4cf0-b6c7-2704168c0e3d None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:07.892838 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49384026-ef7b-4cf0-b6c7-2704168c0e3d None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:07.893291 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49384026-ef7b-4cf0-b6c7-2704168c0e3d None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:07.895026 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 176/355] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:07.896737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49384026-ef7b-4cf0-b6c7-2704168c0e3d None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:07.917859 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:07.939010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62c153-6b5b-4797-a9c0-1dca1a7d6ed7 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:07.986869 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2f913-451b-44f7-b363-5a204c216439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:07.986869 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2f913-451b-44f7-b363-5a204c216439 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:07.986869 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2f913-451b-44f7-b363-5a204c216439 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:07.987180 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2f913-451b-44f7-b363-5a204c216439 None admin] PATH_INFO: `/v3/projects/0372b5f500b44066a9e11389f07e647e` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:07.989891 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2f913-451b-44f7-b363-5a204c216439 None admin] RBAC: Authorizing `identity:get_project(project_id=0372b5f500b44066a9e11389f07e647e)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:07.991360 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2f913-451b-44f7-b363-5a204c216439 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:07.993244 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 180/356] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:06:07 2022] GET /identity/v3/projects/0372b5f500b44066a9e11389f07e647e => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:07.994467 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b32a3a-3ff0-4aa8-a65c-efd1e7ee7785 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:07.994764 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b32a3a-3ff0-4aa8-a65c-efd1e7ee7785 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:07.995077 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b32a3a-3ff0-4aa8-a65c-efd1e7ee7785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:07.995560 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:08.015624 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-74b32a3a-3ff0-4aa8-a65c-efd1e7ee7785 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:08.016854 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-74b32a3a-3ff0-4aa8-a65c-efd1e7ee7785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:08.048581 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49384026-ef7b-4cf0-b6c7-2704168c0e3d None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:08.094370 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d1dd2-f0fb-488d-b178-7c82ac383432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:08.095207 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d1dd2-f0fb-488d-b178-7c82ac383432 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:08.095531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d1dd2-f0fb-488d-b178-7c82ac383432 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:08.095807 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d1dd2-f0fb-488d-b178-7c82ac383432 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:08.096532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d1dd2-f0fb-488d-b178-7c82ac383432 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:08.096835 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d1dd2-f0fb-488d-b178-7c82ac383432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:08.098555 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d1dd2-f0fb-488d-b178-7c82ac383432 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:08.106509 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 181/357] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:08.107683 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b32a3a-3ff0-4aa8-a65c-efd1e7ee7785 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:08.112655 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 177/358] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:06:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:08.114328 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bc12a-1aa6-45ba-a387-3b4dd6e70575 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:08.114790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bc12a-1aa6-45ba-a387-3b4dd6e70575 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:08.115246 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bc12a-1aa6-45ba-a387-3b4dd6e70575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:08.141019 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-503bc12a-1aa6-45ba-a387-3b4dd6e70575 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:08.143067 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-503bc12a-1aa6-45ba-a387-3b4dd6e70575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:08.223902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:08.235671 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 178/359] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:08.241398 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503bc12a-1aa6-45ba-a387-3b4dd6e70575 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:08.241545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b32a3a-3ff0-4aa8-a65c-efd1e7ee7785 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:08.288364 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51259ff-24c1-4daa-84b5-71a60bed49a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:08.289448 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51259ff-24c1-4daa-84b5-71a60bed49a9 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:08.289927 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51259ff-24c1-4daa-84b5-71a60bed49a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:08.290864 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51259ff-24c1-4daa-84b5-71a60bed49a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:08.291788 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51259ff-24c1-4daa-84b5-71a60bed49a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:08.292263 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51259ff-24c1-4daa-84b5-71a60bed49a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:08.294545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51259ff-24c1-4daa-84b5-71a60bed49a9 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:08.308788 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 182/360] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:06:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:08.310505 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51259ff-24c1-4daa-84b5-71a60bed49a9 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:08.320548 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:08.373466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503bc12a-1aa6-45ba-a387-3b4dd6e70575 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:08.433724 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50061dd7-1c04-4930-9124-c4ea58906c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:08.435287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50061dd7-1c04-4930-9124-c4ea58906c9d None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:08.435836 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50061dd7-1c04-4930-9124-c4ea58906c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:08.436490 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50061dd7-1c04-4930-9124-c4ea58906c9d None admin] PATH_INFO: `/v3/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:08.438346 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50061dd7-1c04-4930-9124-c4ea58906c9d None admin] RBAC: Authorizing `identity:get_group(group_id=e3c6f0ef212b4ef4a5007d1c2f4d048c)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:08.439980 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50061dd7-1c04-4930-9124-c4ea58906c9d None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:08.442926 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 179/361] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Sep 6 20:06:08 2022] GET /identity/v3/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:08.444136 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50061dd7-1c04-4930-9124-c4ea58906c9d None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:08.467505 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51259ff-24c1-4daa-84b5-71a60bed49a9 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:08.508961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78fc29-14c1-4676-bedb-ac23ae883106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:08.509458 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78fc29-14c1-4676-bedb-ac23ae883106 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:08.509837 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78fc29-14c1-4676-bedb-ac23ae883106 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:08.510213 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78fc29-14c1-4676-bedb-ac23ae883106 None admin] PATH_INFO: `/v3/users/a2ea327648af4becadf50663784dc3df` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:08.511692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78fc29-14c1-4676-bedb-ac23ae883106 None admin] RBAC: Authorizing `identity:get_user(user_id=a2ea327648af4becadf50663784dc3df)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:08.513322 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78fc29-14c1-4676-bedb-ac23ae883106 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:08.515018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 183/362] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:06:08 2022] GET /identity/v3/users/a2ea327648af4becadf50663784dc3df => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:08.516311 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78fc29-14c1-4676-bedb-ac23ae883106 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:08.539006 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:08.588705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50061dd7-1c04-4930-9124-c4ea58906c9d None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:08.632804 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:08.641697 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534185c-97bd-4c24-ba39-9a86dbbd5832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:08.647621 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534185c-97bd-4c24-ba39-9a86dbbd5832 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:08.647621 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534185c-97bd-4c24-ba39-9a86dbbd5832 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:08.647621 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534185c-97bd-4c24-ba39-9a86dbbd5832 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:08.655814 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78fc29-14c1-4676-bedb-ac23ae883106 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:08.702382 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf764e-ac92-43d8-8a8d-4d6a7be55b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:08.703650 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf764e-ac92-43d8-8a8d-4d6a7be55b5d None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:08.703932 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf764e-ac92-43d8-8a8d-4d6a7be55b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:08.704202 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf764e-ac92-43d8-8a8d-4d6a7be55b5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:08.704963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf764e-ac92-43d8-8a8d-4d6a7be55b5d None admin] RBAC: Adding query filter params (group.id=e3c6f0ef212b4ef4a5007d1c2f4d048c, role.id=8ad4b0e0a5384306acd6d162f21dcd3d, scope.project.id=0372b5f500b44066a9e11389f07e647e) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:08.705274 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf764e-ac92-43d8-8a8d-4d6a7be55b5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:08.706770 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf764e-ac92-43d8-8a8d-4d6a7be55b5d None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:08.713431 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 184/363] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Sep 6 20:06:08 2022] GET /identity/v3/role_assignments?group.id=e3c6f0ef212b4ef4a5007d1c2f4d048c&scope.project.id=0372b5f500b44066a9e11389f07e647e&role.id=8ad4b0e0a5384306acd6d162f21dcd3d => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:08.714551 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf764e-ac92-43d8-8a8d-4d6a7be55b5d None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:08.741840 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534185c-97bd-4c24-ba39-9a86dbbd5832 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:08.743754 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534185c-97bd-4c24-ba39-9a86dbbd5832 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:08.836048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:08.860361 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf764e-ac92-43d8-8a8d-4d6a7be55b5d None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:08.911714 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 180/364] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:06:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:06:08.913336 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534185c-97bd-4c24-ba39-9a86dbbd5832 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:08.914346 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6d727-c007-43b0-b4bd-108ff6cb82be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:08.914982 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6d727-c007-43b0-b4bd-108ff6cb82be None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:08.915264 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6d727-c007-43b0-b4bd-108ff6cb82be None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:08.915571 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6d727-c007-43b0-b4bd-108ff6cb82be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:08.916446 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c6d727-c007-43b0-b4bd-108ff6cb82be None admin] RBAC: Adding query filter params (role.id=118b6fc03d22492f83f70dd2da6b374d, user.id=a2ea327648af4becadf50663784dc3df, scope.system=all) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:08.916766 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c6d727-c007-43b0-b4bd-108ff6cb82be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:08.918295 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c6d727-c007-43b0-b4bd-108ff6cb82be None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:08.932319 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 185/365] 10.222.0.77 () {56 vars in 1308 bytes} [Tue Sep 6 20:06:08 2022] GET /identity/v3/role_assignments?user.id=a2ea327648af4becadf50663784dc3df&scope.system=all&role.id=118b6fc03d22492f83f70dd2da6b374d => generated 510 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:08.933191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6d727-c007-43b0-b4bd-108ff6cb82be None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:08.961084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:09.082244 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534185c-97bd-4c24-ba39-9a86dbbd5832 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:09.089697 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6d727-c007-43b0-b4bd-108ff6cb82be None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:09.137441 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059de6ec-24ef-44d7-b3dc-d2e320674967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:09.138217 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059de6ec-24ef-44d7-b3dc-d2e320674967 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:09.138504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059de6ec-24ef-44d7-b3dc-d2e320674967 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:09.138779 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059de6ec-24ef-44d7-b3dc-d2e320674967 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:09.147381 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b0933-2495-4915-bc84-887b58fb12a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:09.147990 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b0933-2495-4915-bc84-887b58fb12a9 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:09.148271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b0933-2495-4915-bc84-887b58fb12a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:09.148548 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b0933-2495-4915-bc84-887b58fb12a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:09.160480 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:09.160965 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059de6ec-24ef-44d7-b3dc-d2e320674967 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:09.164618 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b0933-2495-4915-bc84-887b58fb12a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:09.166204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-059de6ec-24ef-44d7-b3dc-d2e320674967 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 20:06:09.166204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:09.166204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:09.166204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:09.166204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:09.166204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:09.166204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:09.166204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:09.166204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:09.166204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:09.166204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:09.166204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:09.166204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:09.166204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:09.166204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:09.166204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:09.167133 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:09.167133 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:09.167133 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:09.167133 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:09.167133 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:09.167133 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:09.167133 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:09.167133 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:09.167133 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:09.167133 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:09.167133 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:09.167133 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:09.167133 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:09.167133 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:09.167133 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:09.167133 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:09.167966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:09.167966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:09.167966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:09.167966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:09.167966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:09.167966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:09.167966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:09.167966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:09.167966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:09.167966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:09.167966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 20:06:09.167966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:09.167966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 181/366] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Sep 6 20:06:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:09.168629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059de6ec-24ef-44d7-b3dc-d2e320674967 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:09.170956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-028b0933-2495-4915-bc84-887b58fb12a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:06:09.170956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:09.170956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:09.170956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:09.170956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:09.170956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:09.170956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:09.170956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:09.170956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:09.170956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:09.170956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:09.170956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:09.170956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:09.170956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:09.170956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:09.170956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:09.171880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:09.171880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:09.171880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:09.171880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:09.171880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:09.171880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:09.171880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:09.171880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:09.171880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:09.171880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:09.171880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:09.171880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:09.171880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:09.171880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:09.171880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:09.171880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:09.180501 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:09.180501 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:09.180501 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:09.180501 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:09.180501 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:09.180501 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:09.180501 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:09.180501 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:09.180501 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:09.180501 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:09.180501 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:06:09.180501 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:09.180501 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 186/367] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:06:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:09.180501 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b0933-2495-4915-bc84-887b58fb12a9 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:09.306155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b0933-2495-4915-bc84-887b58fb12a9 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:09.327903 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:09.342134 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059de6ec-24ef-44d7-b3dc-d2e320674967 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:09.345842 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98753f0b-c149-4142-9982-2125dd3d4430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:09.346459 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98753f0b-c149-4142-9982-2125dd3d4430 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:09.346736 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98753f0b-c149-4142-9982-2125dd3d4430 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:09.347004 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98753f0b-c149-4142-9982-2125dd3d4430 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:09.347795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98753f0b-c149-4142-9982-2125dd3d4430 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:09.348021 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98753f0b-c149-4142-9982-2125dd3d4430 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:09.349737 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98753f0b-c149-4142-9982-2125dd3d4430 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:09.360772 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 187/368] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:06:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:09.361650 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98753f0b-c149-4142-9982-2125dd3d4430 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:09.393643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e2e8d-552f-4163-a54d-92ff5520c6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:09.394379 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e2e8d-552f-4163-a54d-92ff5520c6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:09.394668 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e2e8d-552f-4163-a54d-92ff5520c6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:09.394942 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e2e8d-552f-4163-a54d-92ff5520c6f1 None admin] PATH_INFO: `/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:09.396261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e2e8d-552f-4163-a54d-92ff5520c6f1 None admin] RBAC: Authorizing `identity:get_project(project_id=f882e970082a40b2ad1a0f258ad7e3ba)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:09.397836 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e2e8d-552f-4163-a54d-92ff5520c6f1 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:09.401088 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 182/369] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:06:09 2022] GET /identity/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:09.401973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e2e8d-552f-4163-a54d-92ff5520c6f1 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:09.439207 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:09.486077 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98753f0b-c149-4142-9982-2125dd3d4430 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:09.528373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2a8c6-23bd-4f92-890a-3c0b575b06b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:09.528758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e2e8d-552f-4163-a54d-92ff5520c6f1 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:09.529379 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2a8c6-23bd-4f92-890a-3c0b575b06b3 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:09.529662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2a8c6-23bd-4f92-890a-3c0b575b06b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:09.529932 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2a8c6-23bd-4f92-890a-3c0b575b06b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:09.530611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2a8c6-23bd-4f92-890a-3c0b575b06b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:09.530934 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2a8c6-23bd-4f92-890a-3c0b575b06b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:09.533230 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2a8c6-23bd-4f92-890a-3c0b575b06b3 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:09.543729 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 188/370] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:06:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:09.549953 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2a8c6-23bd-4f92-890a-3c0b575b06b3 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:09.573448 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218449c-f967-4220-8ad1-5538cf999a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:09.574201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218449c-f967-4220-8ad1-5538cf999a51 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:09.574571 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218449c-f967-4220-8ad1-5538cf999a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:09.574915 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218449c-f967-4220-8ad1-5538cf999a51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:09.607927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:09.659879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218449c-f967-4220-8ad1-5538cf999a51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:09.661355 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218449c-f967-4220-8ad1-5538cf999a51 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:09.662503 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2a8c6-23bd-4f92-890a-3c0b575b06b3 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:09.689203 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:09.701262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdf870-88fd-4141-881b-4f6157cbd711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:09.705274 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdf870-88fd-4141-881b-4f6157cbd711 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:09.705274 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdf870-88fd-4141-881b-4f6157cbd711 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:09.705274 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdf870-88fd-4141-881b-4f6157cbd711 None admin] PATH_INFO: `/v3/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:09.705274 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cdf870-88fd-4141-881b-4f6157cbd711 None admin] RBAC: Authorizing `identity:get_group(group_id=e3c6f0ef212b4ef4a5007d1c2f4d048c)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:09.705274 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cdf870-88fd-4141-881b-4f6157cbd711 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:09.707074 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 189/371] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Sep 6 20:06:09 2022] GET /identity/v3/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:09.714963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdf870-88fd-4141-881b-4f6157cbd711 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:09.792226 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 183/372] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:06:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:06:09.793387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218449c-f967-4220-8ad1-5538cf999a51 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:09.844556 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdf870-88fd-4141-881b-4f6157cbd711 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:09.883516 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb836e4-8bc3-4a57-bf0f-e34422e67bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:09.884235 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb836e4-8bc3-4a57-bf0f-e34422e67bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:09.884519 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb836e4-8bc3-4a57-bf0f-e34422e67bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:09.884791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb836e4-8bc3-4a57-bf0f-e34422e67bd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:09.907827 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:09.940363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218449c-f967-4220-8ad1-5538cf999a51 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:09.981084 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb836e4-8bc3-4a57-bf0f-e34422e67bd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:09.983019 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb836e4-8bc3-4a57-bf0f-e34422e67bd3 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:09.987836 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:10.001815 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd7727-aa31-45ae-852a-1ab2fd769aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:10.001815 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd7727-aa31-45ae-852a-1ab2fd769aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:10.001815 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd7727-aa31-45ae-852a-1ab2fd769aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:10.002659 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd7727-aa31-45ae-852a-1ab2fd769aa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:10.007477 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd7727-aa31-45ae-852a-1ab2fd769aa2 None admin] RBAC: Adding query filter params (group.id=e3c6f0ef212b4ef4a5007d1c2f4d048c, role.id=d970607307684690803e8e97e2d39e8f, scope.project.id=f882e970082a40b2ad1a0f258ad7e3ba) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:10.007477 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd7727-aa31-45ae-852a-1ab2fd769aa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:10.007477 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd7727-aa31-45ae-852a-1ab2fd769aa2 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:10.012087 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 184/373] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Sep 6 20:06:09 2022] GET /identity/v3/role_assignments?group.id=e3c6f0ef212b4ef4a5007d1c2f4d048c&scope.project.id=f882e970082a40b2ad1a0f258ad7e3ba&role.id=d970607307684690803e8e97e2d39e8f => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:10.016824 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd7727-aa31-45ae-852a-1ab2fd769aa2 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:10.171993 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 190/374] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:06:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:06:10.178971 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb836e4-8bc3-4a57-bf0f-e34422e67bd3 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:10.265935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd7727-aa31-45ae-852a-1ab2fd769aa2 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:10.299375 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:10.318831 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a9154-b83d-4a87-bed0-82ffb45afd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:10.319567 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a9154-b83d-4a87-bed0-82ffb45afd8d None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:10.319847 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a9154-b83d-4a87-bed0-82ffb45afd8d None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:10.320138 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a9154-b83d-4a87-bed0-82ffb45afd8d None admin] PATH_INFO: `/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:10.321410 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a9154-b83d-4a87-bed0-82ffb45afd8d None admin] RBAC: Authorizing `identity:get_project(project_id=f882e970082a40b2ad1a0f258ad7e3ba)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:10.323135 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a9154-b83d-4a87-bed0-82ffb45afd8d None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:10.325321 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 185/375] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:06:10 2022] GET /identity/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba => generated 302 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:10.332002 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a9154-b83d-4a87-bed0-82ffb45afd8d None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:10.341617 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb836e4-8bc3-4a57-bf0f-e34422e67bd3 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:10.367255 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:10.383747 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e5b0e-d643-4657-945c-91cb4bb428d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:10.384395 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e5b0e-d643-4657-945c-91cb4bb428d3 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:10.386331 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e5b0e-d643-4657-945c-91cb4bb428d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:10.386331 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e5b0e-d643-4657-945c-91cb4bb428d3 None admin] PATH_INFO: `/v3/projects/003d1519e9c64c4283d31426f50dd5d3` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:10.386331 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e5b0e-d643-4657-945c-91cb4bb428d3 None admin] RBAC: Authorizing `identity:get_project(project_id=003d1519e9c64c4283d31426f50dd5d3)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:10.387676 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e5b0e-d643-4657-945c-91cb4bb428d3 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:10.389477 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 191/376] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:06:10 2022] GET /identity/v3/projects/003d1519e9c64c4283d31426f50dd5d3 => generated 344 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:06:10.395944 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e5b0e-d643-4657-945c-91cb4bb428d3 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:10.477202 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a9154-b83d-4a87-bed0-82ffb45afd8d None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:10.511651 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e5b0e-d643-4657-945c-91cb4bb428d3 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:10.519017 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704f1e0-82c0-4b5f-88e4-e52a245eef4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:10.519680 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704f1e0-82c0-4b5f-88e4-e52a245eef4f None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:10.519972 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704f1e0-82c0-4b5f-88e4-e52a245eef4f None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:10.520231 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704f1e0-82c0-4b5f-88e4-e52a245eef4f None admin] PATH_INFO: `/v3/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:10.521418 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704f1e0-82c0-4b5f-88e4-e52a245eef4f None admin] RBAC: Authorizing `identity:get_group(group_id=e3c6f0ef212b4ef4a5007d1c2f4d048c)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:10.522880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704f1e0-82c0-4b5f-88e4-e52a245eef4f None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:10.525504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 186/377] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Sep 6 20:06:10 2022] GET /identity/v3/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:06:10.529764 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a83af-48b7-42c3-be55-8fac024d0a68 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:10.530385 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a83af-48b7-42c3-be55-8fac024d0a68 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:10.530385 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a83af-48b7-42c3-be55-8fac024d0a68 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:10.531960 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 187/378] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:06:10.536256 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a83af-48b7-42c3-be55-8fac024d0a68 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:10.550077 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24a90e-48e0-47e6-b7d2-0360ba6eb1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:10.550732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24a90e-48e0-47e6-b7d2-0360ba6eb1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:10.551015 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24a90e-48e0-47e6-b7d2-0360ba6eb1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:10.551294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24a90e-48e0-47e6-b7d2-0360ba6eb1f0 None admin] PATH_INFO: `/v3/groups/fc6935ec974543228382b093f4bf782c` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:10.559580 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24a90e-48e0-47e6-b7d2-0360ba6eb1f0 None admin] RBAC: Authorizing `identity:get_group(group_id=fc6935ec974543228382b093f4bf782c)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:10.561061 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24a90e-48e0-47e6-b7d2-0360ba6eb1f0 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:10.566702 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 192/379] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Sep 6 20:06:10 2022] GET /identity/v3/groups/fc6935ec974543228382b093f4bf782c => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:10.568161 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca399a-d706-42d8-9445-29f911b1368c None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:10.568553 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca399a-d706-42d8-9445-29f911b1368c None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:10.568834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca399a-d706-42d8-9445-29f911b1368c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:10.592210 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-4dca399a-d706-42d8-9445-29f911b1368c None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:10.593620 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-4dca399a-d706-42d8-9445-29f911b1368c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:10.607078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:10.614457 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:10.655165 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a83af-48b7-42c3-be55-8fac024d0a68 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:10.669356 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 193/380] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:10.670290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca399a-d706-42d8-9445-29f911b1368c None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:10.715967 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02b8b4-bebf-4161-bf33-261b28d4b7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:10.715967 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02b8b4-bebf-4161-bf33-261b28d4b7df None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:10.715967 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02b8b4-bebf-4161-bf33-261b28d4b7df None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:10.715967 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02b8b4-bebf-4161-bf33-261b28d4b7df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:10.717871 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02b8b4-bebf-4161-bf33-261b28d4b7df None admin] RBAC: Adding query filter params (group.id=e3c6f0ef212b4ef4a5007d1c2f4d048c, role.id=8ad4b0e0a5384306acd6d162f21dcd3d, scope.project.id=f882e970082a40b2ad1a0f258ad7e3ba) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:10.723230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02b8b4-bebf-4161-bf33-261b28d4b7df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:10.723230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02b8b4-bebf-4161-bf33-261b28d4b7df None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:10.732039 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 188/381] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Sep 6 20:06:10 2022] GET /identity/v3/role_assignments?group.id=e3c6f0ef212b4ef4a5007d1c2f4d048c&scope.project.id=f882e970082a40b2ad1a0f258ad7e3ba&role.id=8ad4b0e0a5384306acd6d162f21dcd3d => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:10.791713 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca399a-d706-42d8-9445-29f911b1368c None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:10.844290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2ce8b-b409-473d-83d4-4356110c52af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:10.844918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2ce8b-b409-473d-83d4-4356110c52af None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:10.845200 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2ce8b-b409-473d-83d4-4356110c52af None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:10.845476 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2ce8b-b409-473d-83d4-4356110c52af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:10.846211 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2ce8b-b409-473d-83d4-4356110c52af None admin] RBAC: Adding query filter params (group.id=fc6935ec974543228382b093f4bf782c, role.id=1e2ac44410664e6b8f42ab3c37e2643f, scope.project.id=003d1519e9c64c4283d31426f50dd5d3) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:10.846522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2ce8b-b409-473d-83d4-4356110c52af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:10.849706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2ce8b-b409-473d-83d4-4356110c52af None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:10.860946 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 194/382] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Sep 6 20:06:10 2022] GET /identity/v3/role_assignments?group.id=fc6935ec974543228382b093f4bf782c&scope.project.id=003d1519e9c64c4283d31426f50dd5d3&role.id=1e2ac44410664e6b8f42ab3c37e2643f => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:11.018244 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02b8b4-bebf-4161-bf33-261b28d4b7df None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:11.143354 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02b8b4-bebf-4161-bf33-261b28d4b7df None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:11.173817 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:11.187392 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be259cb5-0ae5-4658-9863-40bc52ea59b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:11.188166 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be259cb5-0ae5-4658-9863-40bc52ea59b4 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:11.188356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be259cb5-0ae5-4658-9863-40bc52ea59b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:11.188593 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be259cb5-0ae5-4658-9863-40bc52ea59b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:11.202736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be259cb5-0ae5-4658-9863-40bc52ea59b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:11.208173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-be259cb5-0ae5-4658-9863-40bc52ea59b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:06:11.208173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:11.208173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:11.208173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:11.208173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:11.208173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:11.208173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:11.208173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:11.208173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:11.208173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:11.208173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:11.208173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:11.208173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:11.208173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:11.208173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:11.208173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:11.209099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:11.209099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:11.209099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:11.209099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:11.209099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:11.209099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:11.209099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:11.209099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:11.209099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:11.209099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:11.209099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:11.209099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:11.209099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:11.209099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:11.209099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:11.209099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:11.210598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:11.210598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:11.210598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:11.210598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:11.210598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:11.210598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:11.210598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:11.210598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:11.210598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:11.210598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:11.210598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:06:11.210598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:11.214213 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 189/383] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:06:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:11.221424 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2ce8b-b409-473d-83d4-4356110c52af None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:11.250363 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:11.367700 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2ce8b-b409-473d-83d4-4356110c52af None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:11.411597 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82ffd5-8f2e-457a-9b24-a4751ff20216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:11.412234 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82ffd5-8f2e-457a-9b24-a4751ff20216 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:11.412570 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82ffd5-8f2e-457a-9b24-a4751ff20216 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:11.412848 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82ffd5-8f2e-457a-9b24-a4751ff20216 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:11.413526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82ffd5-8f2e-457a-9b24-a4751ff20216 None admin] RBAC: Adding query filter params (name=member) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:11.413836 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82ffd5-8f2e-457a-9b24-a4751ff20216 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:11.415226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82ffd5-8f2e-457a-9b24-a4751ff20216 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:11.426651 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 195/384] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:06:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:06:11.432333 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be259cb5-0ae5-4658-9863-40bc52ea59b4 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:11.594341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be259cb5-0ae5-4658-9863-40bc52ea59b4 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:11.621930 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae3be3-47c7-4f5a-9370-e0d1c14a847e None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:11.622444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae3be3-47c7-4f5a-9370-e0d1c14a847e None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:11.622444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae3be3-47c7-4f5a-9370-e0d1c14a847e None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:11.624052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 196/385] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:11.630906 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9999772-054a-4eb9-99a8-142963dbbb03 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:11.631188 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9999772-054a-4eb9-99a8-142963dbbb03 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:11.631643 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9999772-054a-4eb9-99a8-142963dbbb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:11.646928 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92652d0-9671-4f7e-8389-eb5ac933a80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:11.650038 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92652d0-9671-4f7e-8389-eb5ac933a80e None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:11.650425 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92652d0-9671-4f7e-8389-eb5ac933a80e None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:11.650796 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92652d0-9671-4f7e-8389-eb5ac933a80e None admin] PATH_INFO: `/v3/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:11.654975 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92652d0-9671-4f7e-8389-eb5ac933a80e None admin] RBAC: Authorizing `identity:get_group(group_id=e3c6f0ef212b4ef4a5007d1c2f4d048c)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:11.657142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92652d0-9671-4f7e-8389-eb5ac933a80e None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:11.658786 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 190/386] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Sep 6 20:06:11 2022] GET /identity/v3/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:11.664928 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92652d0-9671-4f7e-8389-eb5ac933a80e None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:11.670383 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-e9999772-054a-4eb9-99a8-142963dbbb03 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:11.671677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-e9999772-054a-4eb9-99a8-142963dbbb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:11.760800 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:11.772418 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 197/387] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 20:06:11.835484 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92652d0-9671-4f7e-8389-eb5ac933a80e None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:11.870491 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71d6bb-103b-4862-8d6c-9294733da24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:11.871142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71d6bb-103b-4862-8d6c-9294733da24d None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:11.871427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71d6bb-103b-4862-8d6c-9294733da24d None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:11.871772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71d6bb-103b-4862-8d6c-9294733da24d None admin] PATH_INFO: `/v3/projects/0372b5f500b44066a9e11389f07e647e` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:11.873046 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71d6bb-103b-4862-8d6c-9294733da24d None admin] RBAC: Authorizing `identity:get_project(project_id=0372b5f500b44066a9e11389f07e647e)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:11.874429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71d6bb-103b-4862-8d6c-9294733da24d None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:11.876487 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 191/388] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:06:11 2022] GET /identity/v3/projects/0372b5f500b44066a9e11389f07e647e => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:06:11.885420 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9999772-054a-4eb9-99a8-142963dbbb03 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:11.913880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:12.088109 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9999772-054a-4eb9-99a8-142963dbbb03 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:12.149973 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857be98-d6fa-412f-a12a-d6d237abf335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:12.150906 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857be98-d6fa-412f-a12a-d6d237abf335 None admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:12.151381 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857be98-d6fa-412f-a12a-d6d237abf335 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:12.151883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857be98-d6fa-412f-a12a-d6d237abf335 None admin] PATH_INFO: `/v3/projects/0372b5f500b44066a9e11389f07e647e/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:12.156086 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857be98-d6fa-412f-a12a-d6d237abf335 None admin] RBAC: Authorizing `identity:create_grant(project_id=0372b5f500b44066a9e11389f07e647e, group_id=e3c6f0ef212b4ef4a5007d1c2f4d048c, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:12.158570 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857be98-d6fa-412f-a12a-d6d237abf335 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:12.236627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 198/389] 10.222.0.77 () {58 vars in 1442 bytes} [Tue Sep 6 20:06:11 2022] PUT /identity/v3/projects/0372b5f500b44066a9e11389f07e647e/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:06:12.280818 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71d6bb-103b-4862-8d6c-9294733da24d None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:12.422252 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71d6bb-103b-4862-8d6c-9294733da24d None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:12.448244 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:12.472262 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce17ef3-80bb-42a5-9020-4b7bea647e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:12.473192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce17ef3-80bb-42a5-9020-4b7bea647e37 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:12.474617 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce17ef3-80bb-42a5-9020-4b7bea647e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:12.475047 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce17ef3-80bb-42a5-9020-4b7bea647e37 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:12.494089 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce17ef3-80bb-42a5-9020-4b7bea647e37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:12.502647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-2ce17ef3-80bb-42a5-9020-4b7bea647e37 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 20:06:12.502647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:12.502647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:12.502647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:12.502647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:12.502647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:12.502647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:12.502647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:12.502647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:12.502647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:12.502647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:12.502647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:12.502647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:12.502647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:12.502647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:12.502647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:12.504232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:12.504232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:12.504232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:12.504232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:12.504232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:12.504232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:12.504232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:12.504232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:12.504232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:12.504232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:12.504232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:12.504232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:12.504232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:12.504232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:12.504232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:12.504232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:12.506302 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:12.506302 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:12.506302 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:12.506302 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:12.506302 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:12.506302 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:12.506302 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:12.506302 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:12.506302 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:12.506302 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:12.506302 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 20:06:12.506302 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:12.508473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 192/390] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Sep 6 20:06:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:12.514611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857be98-d6fa-412f-a12a-d6d237abf335 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:12.615107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:12.653292 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857be98-d6fa-412f-a12a-d6d237abf335 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:12.695157 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195698d-52fc-4783-a81a-920c68821084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:12.695737 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195698d-52fc-4783-a81a-920c68821084 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:12.695994 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195698d-52fc-4783-a81a-920c68821084 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:12.696258 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195698d-52fc-4783-a81a-920c68821084 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:12.697061 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195698d-52fc-4783-a81a-920c68821084 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:12.697360 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195698d-52fc-4783-a81a-920c68821084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:12.698751 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195698d-52fc-4783-a81a-920c68821084 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:12.712467 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 199/391] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:06:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:12.718170 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce17ef3-80bb-42a5-9020-4b7bea647e37 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:12.888491 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce17ef3-80bb-42a5-9020-4b7bea647e37 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:12.936853 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9089b5-a85a-4b84-b2d9-621d469efc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:12.937541 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9089b5-a85a-4b84-b2d9-621d469efc01 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:12.937876 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9089b5-a85a-4b84-b2d9-621d469efc01 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:12.938147 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9089b5-a85a-4b84-b2d9-621d469efc01 None admin] PATH_INFO: `/v3/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:12.940132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9089b5-a85a-4b84-b2d9-621d469efc01 None admin] RBAC: Authorizing `identity:get_group(group_id=e3c6f0ef212b4ef4a5007d1c2f4d048c)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:12.941588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9089b5-a85a-4b84-b2d9-621d469efc01 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:12.943641 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 193/392] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Sep 6 20:06:12 2022] GET /identity/v3/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:12.949763 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195698d-52fc-4783-a81a-920c68821084 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:13.103239 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195698d-52fc-4783-a81a-920c68821084 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:13.144205 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:13.156948 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b233998-afbf-451c-bd62-0c2c7ff5c9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:13.157877 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b233998-afbf-451c-bd62-0c2c7ff5c9fe None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:13.158308 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b233998-afbf-451c-bd62-0c2c7ff5c9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:13.158728 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b233998-afbf-451c-bd62-0c2c7ff5c9fe None admin] PATH_INFO: `/v3/projects/0372b5f500b44066a9e11389f07e647e` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:13.160189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b233998-afbf-451c-bd62-0c2c7ff5c9fe None admin] RBAC: Authorizing `identity:get_project(project_id=0372b5f500b44066a9e11389f07e647e)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:13.161769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b233998-afbf-451c-bd62-0c2c7ff5c9fe None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:13.163591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 200/393] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:06:12 2022] GET /identity/v3/projects/0372b5f500b44066a9e11389f07e647e => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:13.172951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9089b5-a85a-4b84-b2d9-621d469efc01 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:13.254851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:13.284028 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e861f-af43-4089-9b72-633d35efcd49 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:13.284581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e861f-af43-4089-9b72-633d35efcd49 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:13.285009 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e861f-af43-4089-9b72-633d35efcd49 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:13.286994 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 201/394] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:13.295030 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938e556-1e1c-4432-904f-90d3d10cf7dc None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:13.295704 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938e556-1e1c-4432-904f-90d3d10cf7dc None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:13.296237 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938e556-1e1c-4432-904f-90d3d10cf7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:13.323157 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-e938e556-1e1c-4432-904f-90d3d10cf7dc None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:13.327040 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-e938e556-1e1c-4432-904f-90d3d10cf7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:13.343119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9089b5-a85a-4b84-b2d9-621d469efc01 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:13.382619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df269577-8ae3-4a47-8d40-8f841ee696cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:13.383789 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df269577-8ae3-4a47-8d40-8f841ee696cc None admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:13.384274 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df269577-8ae3-4a47-8d40-8f841ee696cc None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:13.384769 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df269577-8ae3-4a47-8d40-8f841ee696cc None admin] PATH_INFO: `/v3/projects/0372b5f500b44066a9e11389f07e647e/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c/roles/8ad4b0e0a5384306acd6d162f21dcd3d` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:13.387365 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df269577-8ae3-4a47-8d40-8f841ee696cc None admin] RBAC: Authorizing `identity:create_grant(project_id=0372b5f500b44066a9e11389f07e647e, group_id=e3c6f0ef212b4ef4a5007d1c2f4d048c, role_id=8ad4b0e0a5384306acd6d162f21dcd3d)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:13.389197 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df269577-8ae3-4a47-8d40-8f841ee696cc None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:13.442629 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 202/395] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 20:06:13.499078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 194/396] 10.222.0.77 () {58 vars in 1442 bytes} [Tue Sep 6 20:06:13 2022] PUT /identity/v3/projects/0372b5f500b44066a9e11389f07e647e/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c/roles/8ad4b0e0a5384306acd6d162f21dcd3d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:06:13.902081 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938e556-1e1c-4432-904f-90d3d10cf7dc None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:13.951980 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf1d55-0805-4829-8b4c-d35eade96bc4 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:13.953003 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf1d55-0805-4829-8b4c-d35eade96bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:13.953518 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf1d55-0805-4829-8b4c-d35eade96bc4 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:13.955402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 195/397] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:13.961201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28dd0d-06eb-41a4-a5bd-09e174578f23 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:13.961763 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28dd0d-06eb-41a4-a5bd-09e174578f23 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:13.962274 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28dd0d-06eb-41a4-a5bd-09e174578f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:13.988077 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-8d28dd0d-06eb-41a4-a5bd-09e174578f23 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:13.989639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-8d28dd0d-06eb-41a4-a5bd-09e174578f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:14.096389 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 196/398] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 20:06:14.126854 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938e556-1e1c-4432-904f-90d3d10cf7dc None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:14.182550 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:14.188780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92602b-9488-42d3-83ad-120180dabae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:14.189426 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92602b-9488-42d3-83ad-120180dabae7 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:14.189704 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92602b-9488-42d3-83ad-120180dabae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:14.190008 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92602b-9488-42d3-83ad-120180dabae7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:14.212166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92602b-9488-42d3-83ad-120180dabae7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:14.220303 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-3b92602b-9488-42d3-83ad-120180dabae7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:06:14.220303 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:14.220303 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:14.220303 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:14.220303 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:14.220303 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:14.220303 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:14.220303 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:14.220303 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:14.220303 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:14.220303 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:14.220303 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:14.220303 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:14.220303 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:14.220303 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:14.220303 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:14.221223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:14.221223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:14.221223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:14.221223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:14.221223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:14.221223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:14.221223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:14.221223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:14.221223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:14.221223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:14.221223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:14.221223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:14.221223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:14.221223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:14.221223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:14.221223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:14.222010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:14.222010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:14.222010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:14.222010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:14.222010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:14.222010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:14.222010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:14.222010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:14.222010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:14.222010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:14.222010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:06:14.222010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:14.222010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 203/399] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:06:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:14.229117 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28dd0d-06eb-41a4-a5bd-09e174578f23 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:14.267066 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ecb11-646e-471d-8dd4-aae5e7561d1c None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:14.267400 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ecb11-646e-471d-8dd4-aae5e7561d1c None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:14.267748 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ecb11-646e-471d-8dd4-aae5e7561d1c None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:14.269616 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 204/400] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:06:14.275215 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d070c4-401d-4004-88e4-71189e3b0450 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:14.275541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d070c4-401d-4004-88e4-71189e3b0450 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:14.275799 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d070c4-401d-4004-88e4-71189e3b0450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:14.284579 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:14.300744 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-33d070c4-401d-4004-88e4-71189e3b0450 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:14.301965 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-33d070c4-401d-4004-88e4-71189e3b0450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:14.396788 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28dd0d-06eb-41a4-a5bd-09e174578f23 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:14.439465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 205/401] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:14.449009 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fe00f-c285-43f0-bffd-bcbfc86b64c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:14.449893 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fe00f-c285-43f0-bffd-bcbfc86b64c6 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:14.450386 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fe00f-c285-43f0-bffd-bcbfc86b64c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:14.450936 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fe00f-c285-43f0-bffd-bcbfc86b64c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:14.451844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fe00f-c285-43f0-bffd-bcbfc86b64c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:14.452347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fe00f-c285-43f0-bffd-bcbfc86b64c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:14.453946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fe00f-c285-43f0-bffd-bcbfc86b64c6 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:14.458121 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d070c4-401d-4004-88e4-71189e3b0450 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:14.472074 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 197/402] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:06:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:14.477197 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fe00f-c285-43f0-bffd-bcbfc86b64c6 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:14.608474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d070c4-401d-4004-88e4-71189e3b0450 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:14.653679 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:14.671065 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:14.677627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fe00f-c285-43f0-bffd-bcbfc86b64c6 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:14.679433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d14c4-354f-47fc-800b-3f77b90e68b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:14.680383 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d14c4-354f-47fc-800b-3f77b90e68b8 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:14.680849 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d14c4-354f-47fc-800b-3f77b90e68b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:14.681302 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d14c4-354f-47fc-800b-3f77b90e68b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:14.712110 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d14c4-354f-47fc-800b-3f77b90e68b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:14.716329 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3707a8-7998-411a-8aec-ef29a451bfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:14.716966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3707a8-7998-411a-8aec-ef29a451bfa1 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:14.717238 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3707a8-7998-411a-8aec-ef29a451bfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:14.717506 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3707a8-7998-411a-8aec-ef29a451bfa1 None admin] PATH_INFO: `/v3/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:14.719298 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3707a8-7998-411a-8aec-ef29a451bfa1 None admin] RBAC: Authorizing `identity:get_group(group_id=e3c6f0ef212b4ef4a5007d1c2f4d048c)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:14.720723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-6e4d14c4-354f-47fc-800b-3f77b90e68b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 20:06:14.720723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:14.720723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:14.720723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:14.720723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:14.720723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:14.720723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:14.720723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:14.720723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:14.720723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:14.720723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:14.720723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:14.720723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:14.720723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:14.720723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:14.720723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:14.721621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:14.721621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:14.721621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:14.721621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:14.721621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:14.721621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:14.721621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:14.721621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:14.721621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:14.721621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:14.721621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:14.721621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:14.721621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:14.721621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:14.721621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:14.721621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:14.722429 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:14.722429 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:14.722429 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:14.722429 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:14.722429 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:14.722429 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:14.722429 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:14.722429 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:14.722429 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:14.722429 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:14.722429 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 20:06:14.722429 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:14.723034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3707a8-7998-411a-8aec-ef29a451bfa1 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:14.723641 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 198/403] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Sep 6 20:06:14 2022] GET /identity/v3/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:06:14.724686 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 206/404] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Sep 6 20:06:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:14.730612 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3707a8-7998-411a-8aec-ef29a451bfa1 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:14.732284 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d14c4-354f-47fc-800b-3f77b90e68b8 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:14.920455 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d14c4-354f-47fc-800b-3f77b90e68b8 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:14.934584 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3707a8-7998-411a-8aec-ef29a451bfa1 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:14.958064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1791147-150a-4bb3-a418-e91327c54283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:14.959129 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1791147-150a-4bb3-a418-e91327c54283 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:14.959589 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1791147-150a-4bb3-a418-e91327c54283 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:14.960009 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1791147-150a-4bb3-a418-e91327c54283 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:14.960816 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1791147-150a-4bb3-a418-e91327c54283 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:14.961264 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1791147-150a-4bb3-a418-e91327c54283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:14.962800 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1791147-150a-4bb3-a418-e91327c54283 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:14.974208 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 207/405] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:06:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:14.976108 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1791147-150a-4bb3-a418-e91327c54283 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:14.995925 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20565dd-f4d3-4434-b2dd-0e5d96f7bf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:14.996758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20565dd-f4d3-4434-b2dd-0e5d96f7bf05 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:14.996977 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20565dd-f4d3-4434-b2dd-0e5d96f7bf05 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:14.997317 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20565dd-f4d3-4434-b2dd-0e5d96f7bf05 None admin] PATH_INFO: `/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:14.998941 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20565dd-f4d3-4434-b2dd-0e5d96f7bf05 None admin] RBAC: Authorizing `identity:get_project(project_id=f882e970082a40b2ad1a0f258ad7e3ba)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:15.001016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20565dd-f4d3-4434-b2dd-0e5d96f7bf05 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:15.007481 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 199/406] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:06:14 2022] GET /identity/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:15.007481 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20565dd-f4d3-4434-b2dd-0e5d96f7bf05 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:15.046980 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:15.073485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:15.116791 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20565dd-f4d3-4434-b2dd-0e5d96f7bf05 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:15.155470 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096bf27-d27f-41ce-8696-31a8b20c2b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:15.156667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096bf27-d27f-41ce-8696-31a8b20c2b22 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:15.156944 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096bf27-d27f-41ce-8696-31a8b20c2b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:15.157214 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096bf27-d27f-41ce-8696-31a8b20c2b22 None admin] PATH_INFO: `/v3/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:15.158478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096bf27-d27f-41ce-8696-31a8b20c2b22 None admin] RBAC: Authorizing `identity:get_group(group_id=e3c6f0ef212b4ef4a5007d1c2f4d048c)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:15.160081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096bf27-d27f-41ce-8696-31a8b20c2b22 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:15.161765 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 200/407] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Sep 6 20:06:15 2022] GET /identity/v3/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:15.162549 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096bf27-d27f-41ce-8696-31a8b20c2b22 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:15.193448 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1791147-150a-4bb3-a418-e91327c54283 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:15.260186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa8a54-03e3-44b3-9cf6-97d7d8f65aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:15.261761 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa8a54-03e3-44b3-9cf6-97d7d8f65aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:15.262516 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa8a54-03e3-44b3-9cf6-97d7d8f65aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:15.263317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa8a54-03e3-44b3-9cf6-97d7d8f65aa1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:15.284531 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa8a54-03e3-44b3-9cf6-97d7d8f65aa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:15.285601 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096bf27-d27f-41ce-8696-31a8b20c2b22 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:15.287301 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:15.295935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-2baa8a54-03e3-44b3-9cf6-97d7d8f65aa1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:06:15.295935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:15.295935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:15.295935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:15.295935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:15.295935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:15.295935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:15.295935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:15.295935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:15.295935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:15.295935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:15.295935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:15.295935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:15.295935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:15.295935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:15.295935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:15.296883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:15.296883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:15.296883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:15.296883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:15.296883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:15.296883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:15.296883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:15.296883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:15.296883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:15.296883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:15.296883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:15.296883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:15.296883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:15.296883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:15.296883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:15.296883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:15.297646 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:15.297646 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:15.297646 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:15.297646 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:15.297646 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:15.297646 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:15.297646 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:15.297646 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:15.297646 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:15.297646 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:15.297646 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:06:15.297646 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:15.298248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 208/408] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:06:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:15.299355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa8a54-03e3-44b3-9cf6-97d7d8f65aa1 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:15.327393 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b80be6-9b3f-4be5-9fc4-aacaad2d8da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:15.328602 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b80be6-9b3f-4be5-9fc4-aacaad2d8da1 None admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:15.329522 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b80be6-9b3f-4be5-9fc4-aacaad2d8da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:15.329916 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b80be6-9b3f-4be5-9fc4-aacaad2d8da1 None admin] PATH_INFO: `/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:15.331837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b80be6-9b3f-4be5-9fc4-aacaad2d8da1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f882e970082a40b2ad1a0f258ad7e3ba, group_id=e3c6f0ef212b4ef4a5007d1c2f4d048c, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:15.333281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b80be6-9b3f-4be5-9fc4-aacaad2d8da1 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:15.407295 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa8a54-03e3-44b3-9cf6-97d7d8f65aa1 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:15.408884 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:15.424884 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 201/409] 10.222.0.77 () {58 vars in 1442 bytes} [Tue Sep 6 20:06:15 2022] PUT /identity/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:06:15.426051 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e384e-8cd1-4cd7-9f31-33f8af9d4c76 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:15.426339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e384e-8cd1-4cd7-9f31-33f8af9d4c76 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:15.426905 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e384e-8cd1-4cd7-9f31-33f8af9d4c76 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:15.428454 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 202/410] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:15.434057 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e384e-8cd1-4cd7-9f31-33f8af9d4c76 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:15.457510 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d656e-1c8c-4589-a2da-7a80dc3d2d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:15.457510 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d656e-1c8c-4589-a2da-7a80dc3d2d25 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:15.457510 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d656e-1c8c-4589-a2da-7a80dc3d2d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:15.457510 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d656e-1c8c-4589-a2da-7a80dc3d2d25 None admin] PATH_INFO: `/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:15.457907 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d656e-1c8c-4589-a2da-7a80dc3d2d25 None admin] RBAC: Authorizing `identity:get_project(project_id=f882e970082a40b2ad1a0f258ad7e3ba)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:15.458780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d656e-1c8c-4589-a2da-7a80dc3d2d25 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:15.466103 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 209/411] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:06:15 2022] GET /identity/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:15.467836 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5f044-fa5b-47f5-9c8c-88d18e61a974 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:15.468319 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5f044-fa5b-47f5-9c8c-88d18e61a974 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:15.469435 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5f044-fa5b-47f5-9c8c-88d18e61a974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:15.489699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-11c5f044-fa5b-47f5-9c8c-88d18e61a974 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:15.491231 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-11c5f044-fa5b-47f5-9c8c-88d18e61a974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:15.574175 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 210/412] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:15.575423 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5f044-fa5b-47f5-9c8c-88d18e61a974 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:15.599329 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e384e-8cd1-4cd7-9f31-33f8af9d4c76 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:15.650002 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434eb51-fff2-40b4-871b-2b73968dfe02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:15.650620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434eb51-fff2-40b4-871b-2b73968dfe02 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:15.650893 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434eb51-fff2-40b4-871b-2b73968dfe02 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:15.651166 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434eb51-fff2-40b4-871b-2b73968dfe02 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:15.651867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434eb51-fff2-40b4-871b-2b73968dfe02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:15.652169 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434eb51-fff2-40b4-871b-2b73968dfe02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:15.653558 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434eb51-fff2-40b4-871b-2b73968dfe02 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:15.664688 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 203/413] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:06:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:15.671053 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434eb51-fff2-40b4-871b-2b73968dfe02 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:15.701731 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:15.718868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:15.725270 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5f044-fa5b-47f5-9c8c-88d18e61a974 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:15.769235 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726d101-39f0-4d7c-9f72-ce381fb65951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:15.770128 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726d101-39f0-4d7c-9f72-ce381fb65951 None admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:15.770445 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726d101-39f0-4d7c-9f72-ce381fb65951 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:15.770718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726d101-39f0-4d7c-9f72-ce381fb65951 None admin] PATH_INFO: `/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c/roles/8ad4b0e0a5384306acd6d162f21dcd3d` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:15.773754 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726d101-39f0-4d7c-9f72-ce381fb65951 None admin] RBAC: Authorizing `identity:create_grant(project_id=f882e970082a40b2ad1a0f258ad7e3ba, group_id=e3c6f0ef212b4ef4a5007d1c2f4d048c, role_id=8ad4b0e0a5384306acd6d162f21dcd3d)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:15.775777 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726d101-39f0-4d7c-9f72-ce381fb65951 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:15.796093 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434eb51-fff2-40b4-871b-2b73968dfe02 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:15.837639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcbd7f-d627-4372-838b-87ff206d873a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:15.838720 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcbd7f-d627-4372-838b-87ff206d873a None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:15.839203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcbd7f-d627-4372-838b-87ff206d873a None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:15.839719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcbd7f-d627-4372-838b-87ff206d873a None admin] PATH_INFO: `/v3/groups/fc6935ec974543228382b093f4bf782c` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:15.841119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bcbd7f-d627-4372-838b-87ff206d873a None admin] RBAC: Authorizing `identity:get_group(group_id=fc6935ec974543228382b093f4bf782c)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:15.843082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bcbd7f-d627-4372-838b-87ff206d873a None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:15.845788 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 204/414] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Sep 6 20:06:15 2022] GET /identity/v3/groups/fc6935ec974543228382b093f4bf782c => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:06:15.851616 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcbd7f-d627-4372-838b-87ff206d873a None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:15.866183 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 211/415] 10.222.0.77 () {58 vars in 1442 bytes} [Tue Sep 6 20:06:15 2022] PUT /identity/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c/roles/8ad4b0e0a5384306acd6d162f21dcd3d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:06:15.956133 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726d101-39f0-4d7c-9f72-ce381fb65951 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:16.022293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:16.050041 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcbd7f-d627-4372-838b-87ff206d873a None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:16.131064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726d101-39f0-4d7c-9f72-ce381fb65951 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:16.148153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5c89a-4c8f-4775-aedc-a2db34435e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:16.148815 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5c89a-4c8f-4775-aedc-a2db34435e61 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:16.149122 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5c89a-4c8f-4775-aedc-a2db34435e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:16.149391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5c89a-4c8f-4775-aedc-a2db34435e61 None admin] PATH_INFO: `/v3/projects/003d1519e9c64c4283d31426f50dd5d3` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:16.151756 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5c89a-4c8f-4775-aedc-a2db34435e61 None admin] RBAC: Authorizing `identity:get_project(project_id=003d1519e9c64c4283d31426f50dd5d3)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:16.153283 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5c89a-4c8f-4775-aedc-a2db34435e61 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:16.155427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 205/416] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:06:15 2022] GET /identity/v3/projects/003d1519e9c64c4283d31426f50dd5d3 => generated 344 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:06:16.161842 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5c89a-4c8f-4775-aedc-a2db34435e61 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:16.177657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc8e6c-334b-4e35-83c0-e8851485ac39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:16.178733 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc8e6c-334b-4e35-83c0-e8851485ac39 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:16.179009 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc8e6c-334b-4e35-83c0-e8851485ac39 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:16.179274 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc8e6c-334b-4e35-83c0-e8851485ac39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:16.192314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc8e6c-334b-4e35-83c0-e8851485ac39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:16.197780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-a5bc8e6c-334b-4e35-83c0-e8851485ac39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:06:16.197780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:16.197780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:16.197780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:16.197780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:16.197780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:16.197780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:16.197780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:16.197780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:16.197780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:16.197780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:16.197780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:16.197780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:16.197780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:16.197780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:16.197780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:16.198735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:16.198735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:16.198735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:16.198735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:16.198735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:16.198735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:16.198735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:16.198735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:16.198735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:16.198735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:16.198735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:16.198735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:16.198735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:16.198735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:16.198735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:16.198735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:16.199627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:16.199627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:16.199627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:16.199627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:16.199627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:16.199627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:16.199627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:16.199627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:16.199627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:16.199627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:16.199627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:06:16.199627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:16.199627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 212/417] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:06:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:16.200821 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99325ebc-629e-42c3-8c12-60a11e208081 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:16.200821 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99325ebc-629e-42c3-8c12-60a11e208081 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:16.201062 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99325ebc-629e-42c3-8c12-60a11e208081 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:16.204204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 213/418] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:16.208011 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99325ebc-629e-42c3-8c12-60a11e208081 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:16.242725 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:16.312917 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5c89a-4c8f-4775-aedc-a2db34435e61 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:16.341521 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99325ebc-629e-42c3-8c12-60a11e208081 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:16.360938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae786c-d007-468d-9800-d6eb6bf60fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:16.361651 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae786c-d007-468d-9800-d6eb6bf60fb9 None admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:16.362171 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae786c-d007-468d-9800-d6eb6bf60fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:16.362449 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae786c-d007-468d-9800-d6eb6bf60fb9 None admin] PATH_INFO: `/v3/projects/003d1519e9c64c4283d31426f50dd5d3/groups/fc6935ec974543228382b093f4bf782c/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:16.365059 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae786c-d007-468d-9800-d6eb6bf60fb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=003d1519e9c64c4283d31426f50dd5d3, group_id=fc6935ec974543228382b093f4bf782c, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:16.366627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae786c-d007-468d-9800-d6eb6bf60fb9 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:16.388292 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2772042-8173-4733-9e66-a0ad1804e1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:16.389032 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2772042-8173-4733-9e66-a0ad1804e1ff None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:16.389394 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2772042-8173-4733-9e66-a0ad1804e1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:16.389731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2772042-8173-4733-9e66-a0ad1804e1ff None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:16.391013 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2772042-8173-4733-9e66-a0ad1804e1ff None admin] RBAC: Adding query filter params (name=member) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:16.391314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2772042-8173-4733-9e66-a0ad1804e1ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:16.392987 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2772042-8173-4733-9e66-a0ad1804e1ff None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:16.411568 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 214/419] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:06:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:06:16.412957 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4979f35-264a-4cc7-9b7a-8279039a7ac0 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:16.413316 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4979f35-264a-4cc7-9b7a-8279039a7ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:16.413598 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4979f35-264a-4cc7-9b7a-8279039a7ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:16.437027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 206/420] 10.222.0.77 () {58 vars in 1442 bytes} [Tue Sep 6 20:06:16 2022] PUT /identity/v3/projects/003d1519e9c64c4283d31426f50dd5d3/groups/fc6935ec974543228382b093f4bf782c/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:06:16.438518 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae786c-d007-468d-9800-d6eb6bf60fb9 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:16.445497 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-f4979f35-264a-4cc7-9b7a-8279039a7ac0 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:16.445497 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f4979f35-264a-4cc7-9b7a-8279039a7ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:16.471560 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:16.587787 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae786c-d007-468d-9800-d6eb6bf60fb9 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:16.636289 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d649166-b87f-4e8d-8aa4-47cbe6641de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:16.636924 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d649166-b87f-4e8d-8aa4-47cbe6641de3 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:16.637205 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d649166-b87f-4e8d-8aa4-47cbe6641de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:16.637480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d649166-b87f-4e8d-8aa4-47cbe6641de3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:16.654615 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 215/421] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:16.721481 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d649166-b87f-4e8d-8aa4-47cbe6641de3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:16.723414 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d649166-b87f-4e8d-8aa4-47cbe6641de3 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:16.748050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:16.843967 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 207/422] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:06:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:06:16.846720 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4979f35-264a-4cc7-9b7a-8279039a7ac0 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:16.867292 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:16.998413 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4979f35-264a-4cc7-9b7a-8279039a7ac0 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:17.048761 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8308a1c-a23d-41fb-a600-c7ef455e1f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:17.049431 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8308a1c-a23d-41fb-a600-c7ef455e1f2d None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:17.049714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8308a1c-a23d-41fb-a600-c7ef455e1f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:17.049990 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8308a1c-a23d-41fb-a600-c7ef455e1f2d None admin] PATH_INFO: `/v3/projects/0372b5f500b44066a9e11389f07e647e` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:17.056541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8308a1c-a23d-41fb-a600-c7ef455e1f2d None admin] RBAC: Authorizing `identity:get_project(project_id=0372b5f500b44066a9e11389f07e647e)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:17.058168 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8308a1c-a23d-41fb-a600-c7ef455e1f2d None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:17.060367 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 216/423] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:06:16 2022] GET /identity/v3/projects/0372b5f500b44066a9e11389f07e647e => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:17.067494 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d649166-b87f-4e8d-8aa4-47cbe6641de3 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:17.171319 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8308a1c-a23d-41fb-a600-c7ef455e1f2d None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:17.248630 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d649166-b87f-4e8d-8aa4-47cbe6641de3 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:17.295769 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:17.328369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eeb6ba-57bd-4a29-a0c1-941b41ebd762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:17.329138 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eeb6ba-57bd-4a29-a0c1-941b41ebd762 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:17.329497 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eeb6ba-57bd-4a29-a0c1-941b41ebd762 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:17.329957 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eeb6ba-57bd-4a29-a0c1-941b41ebd762 None admin] PATH_INFO: `/v3/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:17.331213 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eeb6ba-57bd-4a29-a0c1-941b41ebd762 None admin] RBAC: Authorizing `identity:get_group(group_id=e3c6f0ef212b4ef4a5007d1c2f4d048c)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:17.332794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eeb6ba-57bd-4a29-a0c1-941b41ebd762 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:17.335001 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 208/424] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Sep 6 20:06:17 2022] GET /identity/v3/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:17.340768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eeb6ba-57bd-4a29-a0c1-941b41ebd762 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:17.350269 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8308a1c-a23d-41fb-a600-c7ef455e1f2d None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:17.355868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:17.396830 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e80f0-4253-4663-a99e-d041b27e3c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:17.397792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e80f0-4253-4663-a99e-d041b27e3c0b None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:17.398223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e80f0-4253-4663-a99e-d041b27e3c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:17.398641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e80f0-4253-4663-a99e-d041b27e3c0b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:17.436748 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e80f0-4253-4663-a99e-d041b27e3c0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:17.445961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-908e80f0-4253-4663-a99e-d041b27e3c0b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 20:06:17.445961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:17.445961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:17.445961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:17.445961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:17.445961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:17.445961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:17.445961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:17.445961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:17.445961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:17.445961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:17.445961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:17.445961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:17.445961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:17.445961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:17.445961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:17.447707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:17.447707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:17.447707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:17.447707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:17.447707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:17.447707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:17.447707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:17.447707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:17.447707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:17.447707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:17.447707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:17.447707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:17.447707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:17.447707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:17.447707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:17.447707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:17.449268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:17.449268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:17.449268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:17.449268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:17.449268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:17.449268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:17.449268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:17.449268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:17.449268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:17.449268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:17.449268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 20:06:17.449268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:17.456237 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 217/425] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Sep 6 20:06:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:06:17.462307 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e80f0-4253-4663-a99e-d041b27e3c0b None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:17.523842 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eeb6ba-57bd-4a29-a0c1-941b41ebd762 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:17.566133 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95788329-55b4-48b7-878a-a8b45d00cfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:17.567648 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95788329-55b4-48b7-878a-a8b45d00cfeb None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:17.568079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95788329-55b4-48b7-878a-a8b45d00cfeb None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:17.568500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95788329-55b4-48b7-878a-a8b45d00cfeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:17.569410 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95788329-55b4-48b7-878a-a8b45d00cfeb None admin] RBAC: Adding query filter params (group.id=e3c6f0ef212b4ef4a5007d1c2f4d048c, role.id=d970607307684690803e8e97e2d39e8f, scope.project.id=0372b5f500b44066a9e11389f07e647e) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:17.569873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95788329-55b4-48b7-878a-a8b45d00cfeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:17.571492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95788329-55b4-48b7-878a-a8b45d00cfeb None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:17.581182 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 209/426] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Sep 6 20:06:17 2022] GET /identity/v3/role_assignments?group.id=e3c6f0ef212b4ef4a5007d1c2f4d048c&scope.project.id=0372b5f500b44066a9e11389f07e647e&role.id=d970607307684690803e8e97e2d39e8f => generated 611 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:06:17.660410 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e80f0-4253-4663-a99e-d041b27e3c0b None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:17.712293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d63d3d-5590-41d3-84b0-15115d562257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:17.713269 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d63d3d-5590-41d3-84b0-15115d562257 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:17.713710 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d63d3d-5590-41d3-84b0-15115d562257 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:17.714137 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d63d3d-5590-41d3-84b0-15115d562257 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:17.715002 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d63d3d-5590-41d3-84b0-15115d562257 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:17.715524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d63d3d-5590-41d3-84b0-15115d562257 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:17.717119 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d63d3d-5590-41d3-84b0-15115d562257 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:17.727871 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 218/427] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:06:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:17.733463 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95788329-55b4-48b7-878a-a8b45d00cfeb None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:17.844340 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:17.877786 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95788329-55b4-48b7-878a-a8b45d00cfeb None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:17.920669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229bb91-a1e0-4693-9aa9-b70a1bf0f964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:17.921364 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229bb91-a1e0-4693-9aa9-b70a1bf0f964 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:17.921693 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229bb91-a1e0-4693-9aa9-b70a1bf0f964 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:17.921963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229bb91-a1e0-4693-9aa9-b70a1bf0f964 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:18.000092 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229bb91-a1e0-4693-9aa9-b70a1bf0f964 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:18.001802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229bb91-a1e0-4693-9aa9-b70a1bf0f964 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:18.064588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:18.122431 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 210/428] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:06:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:06:18.132604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d63d3d-5590-41d3-84b0-15115d562257 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:18.135870 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:18.195161 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33495894-8373-4c3f-a0e2-4436be24f2b0 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:18.195705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33495894-8373-4c3f-a0e2-4436be24f2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:18.196148 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33495894-8373-4c3f-a0e2-4436be24f2b0 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:18.197983 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 211/429] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:18.204144 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180c780-de7c-4fb5-b682-cb16e27bbeae None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:18.204678 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180c780-de7c-4fb5-b682-cb16e27bbeae None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:18.205096 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180c780-de7c-4fb5-b682-cb16e27bbeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:18.227132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-7180c780-de7c-4fb5-b682-cb16e27bbeae None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:18.228739 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-7180c780-de7c-4fb5-b682-cb16e27bbeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:18.270807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d63d3d-5590-41d3-84b0-15115d562257 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:18.312411 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ca0b5-cfe3-42e3-9c30-9277740bc7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:18.313066 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ca0b5-cfe3-42e3-9c30-9277740bc7b8 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:18.313342 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ca0b5-cfe3-42e3-9c30-9277740bc7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:18.313613 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ca0b5-cfe3-42e3-9c30-9277740bc7b8 None admin] PATH_INFO: `/v3/projects/0372b5f500b44066a9e11389f07e647e` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:18.314947 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ca0b5-cfe3-42e3-9c30-9277740bc7b8 None admin] RBAC: Authorizing `identity:get_project(project_id=0372b5f500b44066a9e11389f07e647e)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:18.316859 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 212/430] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 20:06:18.316989 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ca0b5-cfe3-42e3-9c30-9277740bc7b8 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:18.323465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 219/431] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:06:18 2022] GET /identity/v3/projects/0372b5f500b44066a9e11389f07e647e => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:18.325381 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180c780-de7c-4fb5-b682-cb16e27bbeae None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:18.427523 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:18.447791 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180c780-de7c-4fb5-b682-cb16e27bbeae None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:18.486319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9e48a-e421-45a3-a20e-1fbe6deb0dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:18.487075 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9e48a-e421-45a3-a20e-1fbe6deb0dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:18.487356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9e48a-e421-45a3-a20e-1fbe6deb0dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:18.487658 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9e48a-e421-45a3-a20e-1fbe6deb0dd6 None admin] PATH_INFO: `/v3/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:18.488825 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de9e48a-e421-45a3-a20e-1fbe6deb0dd6 None admin] RBAC: Authorizing `identity:get_group(group_id=e3c6f0ef212b4ef4a5007d1c2f4d048c)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:18.490373 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de9e48a-e421-45a3-a20e-1fbe6deb0dd6 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:18.493417 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 213/432] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Sep 6 20:06:18 2022] GET /identity/v3/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:06:18.499455 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ca0b5-cfe3-42e3-9c30-9277740bc7b8 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:18.603930 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:18.645406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ca0b5-cfe3-42e3-9c30-9277740bc7b8 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:18.677322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377b33b-96c5-491f-937b-f0e9cc6daed6 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:18.677629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377b33b-96c5-491f-937b-f0e9cc6daed6 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:18.677922 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377b33b-96c5-491f-937b-f0e9cc6daed6 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:18.681266 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 214/433] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:06:18.683996 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377b33b-96c5-491f-937b-f0e9cc6daed6 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:18.691735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348ca45-7202-4bbe-8c6c-6bafd458e58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:18.693724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348ca45-7202-4bbe-8c6c-6bafd458e58f None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:18.694180 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348ca45-7202-4bbe-8c6c-6bafd458e58f None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:18.694622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348ca45-7202-4bbe-8c6c-6bafd458e58f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:18.695937 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348ca45-7202-4bbe-8c6c-6bafd458e58f None admin] RBAC: Adding query filter params (group.id=e3c6f0ef212b4ef4a5007d1c2f4d048c, role.id=8ad4b0e0a5384306acd6d162f21dcd3d, scope.project.id=0372b5f500b44066a9e11389f07e647e) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:18.696445 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348ca45-7202-4bbe-8c6c-6bafd458e58f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:18.698953 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348ca45-7202-4bbe-8c6c-6bafd458e58f None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:18.711826 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 220/434] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Sep 6 20:06:18 2022] GET /identity/v3/role_assignments?group.id=e3c6f0ef212b4ef4a5007d1c2f4d048c&scope.project.id=0372b5f500b44066a9e11389f07e647e&role.id=8ad4b0e0a5384306acd6d162f21dcd3d => generated 611 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:18.713746 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c35275-c53a-4bd2-9298-55843958e2b2 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:18.714221 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c35275-c53a-4bd2-9298-55843958e2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:18.714649 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c35275-c53a-4bd2-9298-55843958e2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:18.746203 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-e1c35275-c53a-4bd2-9298-55843958e2b2 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:18.748189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-e1c35275-c53a-4bd2-9298-55843958e2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:18.859589 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 221/435] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:18.861766 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377b33b-96c5-491f-937b-f0e9cc6daed6 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:18.910561 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdef880-b5d6-486e-8bdc-fcb3eed16b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:18.911523 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdef880-b5d6-486e-8bdc-fcb3eed16b4b None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:18.911957 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdef880-b5d6-486e-8bdc-fcb3eed16b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:18.912470 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdef880-b5d6-486e-8bdc-fcb3eed16b4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:18.926036 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdef880-b5d6-486e-8bdc-fcb3eed16b4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:18.931429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-9fdef880-b5d6-486e-8bdc-fcb3eed16b4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:06:18.931429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:18.931429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:18.931429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:18.931429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:18.931429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:18.931429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:18.931429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:18.931429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:18.931429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:18.931429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:18.931429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:18.931429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:18.931429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:18.931429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:18.931429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:18.932583 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:18.932583 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:18.932583 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:18.932583 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:18.932583 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:18.932583 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:18.932583 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:18.932583 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:18.932583 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:18.932583 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:18.932583 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:18.932583 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:18.932583 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:18.932583 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:18.932583 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:18.932583 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:18.933613 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:18.933613 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:18.933613 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:18.933613 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:18.933613 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:18.933613 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:18.933613 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:18.933613 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:18.933613 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:18.933613 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:18.933613 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 20:06:18.933613 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:18.936016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 215/436] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:06:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:18.943320 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c35275-c53a-4bd2-9298-55843958e2b2 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:19.024441 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:19.068710 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c35275-c53a-4bd2-9298-55843958e2b2 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:19.108393 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f10720-91cb-42b9-a1f2-d133895bd889 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:19.108698 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f10720-91cb-42b9-a1f2-d133895bd889 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:19.109689 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f10720-91cb-42b9-a1f2-d133895bd889 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:19.111854 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f9b9c-a2b2-4a2f-aaff-39ff2d17f976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:19.111996 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 216/437] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:19.112487 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f9b9c-a2b2-4a2f-aaff-39ff2d17f976 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:19.112775 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f9b9c-a2b2-4a2f-aaff-39ff2d17f976 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:19.113059 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f9b9c-a2b2-4a2f-aaff-39ff2d17f976 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:19.113743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f9b9c-a2b2-4a2f-aaff-39ff2d17f976 None admin] RBAC: Adding query filter params (name=member) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:19.114049 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f9b9c-a2b2-4a2f-aaff-39ff2d17f976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:19.115462 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f9b9c-a2b2-4a2f-aaff-39ff2d17f976 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:19.117785 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd460c66-e8fb-497a-b382-b67d114f1474 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:19.118070 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd460c66-e8fb-497a-b382-b67d114f1474 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:19.118348 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd460c66-e8fb-497a-b382-b67d114f1474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:19.131517 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 222/438] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:06:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:19.137462 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f9b9c-a2b2-4a2f-aaff-39ff2d17f976 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:19.149743 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-fd460c66-e8fb-497a-b382-b67d114f1474 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:19.151957 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-fd460c66-e8fb-497a-b382-b67d114f1474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:19.156722 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:19.258435 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 217/439] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 20:06:19.259568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd460c66-e8fb-497a-b382-b67d114f1474 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:19.259750 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f9b9c-a2b2-4a2f-aaff-39ff2d17f976 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:19.291354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:19.306392 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e01072-d71b-4a40-b17f-6912bd7cae57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:19.307406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e01072-d71b-4a40-b17f-6912bd7cae57 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:19.307926 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e01072-d71b-4a40-b17f-6912bd7cae57 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:19.308402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e01072-d71b-4a40-b17f-6912bd7cae57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:19.395271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e01072-d71b-4a40-b17f-6912bd7cae57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:19.396788 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e01072-d71b-4a40-b17f-6912bd7cae57 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:19.412284 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd460c66-e8fb-497a-b382-b67d114f1474 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:19.458376 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fcac4-6a68-479f-a5d2-b87a9878c443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:19.459111 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fcac4-6a68-479f-a5d2-b87a9878c443 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:19.459397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fcac4-6a68-479f-a5d2-b87a9878c443 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:19.459706 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fcac4-6a68-479f-a5d2-b87a9878c443 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:19.472594 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:19.477031 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5fcac4-6a68-479f-a5d2-b87a9878c443 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:19.482341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-bb5fcac4-6a68-479f-a5d2-b87a9878c443 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 20:06:19.482341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:19.482341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:19.482341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:19.482341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:19.482341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:19.482341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:19.482341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:19.482341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:19.482341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:19.482341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:19.482341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:19.482341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:19.482341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:19.482341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:19.482341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:19.484979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:19.484979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:19.484979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:19.484979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:19.484979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:19.484979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:19.484979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:19.484979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:19.484979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:19.484979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:19.484979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:19.484979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:19.484979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:19.484979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:19.484979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:19.484979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:19.485768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:19.485768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:19.485768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:19.485768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:19.485768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:19.485768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:19.485768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:19.485768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:19.485768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:19.485768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:19.485768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 20:06:19.485768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:19.485768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 218/440] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Sep 6 20:06:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:19.490214 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fcac4-6a68-479f-a5d2-b87a9878c443 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:19.532759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 223/441] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:06:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:06:19.538393 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e01072-d71b-4a40-b17f-6912bd7cae57 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:19.567212 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:19.606205 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fcac4-6a68-479f-a5d2-b87a9878c443 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:19.652044 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e01072-d71b-4a40-b17f-6912bd7cae57 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:19.654930 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd43b16-36ba-483c-a3b3-5779f513d618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:19.655568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd43b16-36ba-483c-a3b3-5779f513d618 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:19.656378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd43b16-36ba-483c-a3b3-5779f513d618 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:19.656640 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd43b16-36ba-483c-a3b3-5779f513d618 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:19.657307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd43b16-36ba-483c-a3b3-5779f513d618 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:19.657604 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd43b16-36ba-483c-a3b3-5779f513d618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:19.658973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd43b16-36ba-483c-a3b3-5779f513d618 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:19.668141 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 219/442] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:06:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:06:19.669498 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd43b16-36ba-483c-a3b3-5779f513d618 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:19.697062 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684de0c-0068-4584-a22c-db22a4b1e58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:19.697062 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684de0c-0068-4584-a22c-db22a4b1e58e None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:19.697393 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684de0c-0068-4584-a22c-db22a4b1e58e None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:19.697607 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684de0c-0068-4584-a22c-db22a4b1e58e None admin] PATH_INFO: `/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:19.698747 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3684de0c-0068-4584-a22c-db22a4b1e58e None admin] RBAC: Authorizing `identity:get_project(project_id=f882e970082a40b2ad1a0f258ad7e3ba)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:19.700225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3684de0c-0068-4584-a22c-db22a4b1e58e None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:19.701869 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 224/443] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:06:19 2022] GET /identity/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:06:19.702627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684de0c-0068-4584-a22c-db22a4b1e58e None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:19.738956 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:19.781827 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd43b16-36ba-483c-a3b3-5779f513d618 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:19.816152 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe8bf9-3363-499a-b381-8b4a2e4ab282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:19.816782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe8bf9-3363-499a-b381-8b4a2e4ab282 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:19.817086 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe8bf9-3363-499a-b381-8b4a2e4ab282 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:19.817333 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe8bf9-3363-499a-b381-8b4a2e4ab282 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:19.818166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:19.825086 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684de0c-0068-4584-a22c-db22a4b1e58e None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:19.829720 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe8bf9-3363-499a-b381-8b4a2e4ab282 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:19.839856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-21fe8bf9-3363-499a-b381-8b4a2e4ab282 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:06:19.839856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:19.839856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:19.839856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:19.839856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:19.839856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:19.839856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:19.839856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:19.839856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:19.839856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:19.839856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:19.839856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:19.839856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:19.839856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:19.839856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:19.839856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:19.840828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:19.840828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:19.840828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:19.840828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:19.840828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:19.840828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:19.840828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:19.840828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:19.840828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:19.840828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:19.840828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:19.840828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:19.840828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:19.840828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:19.840828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:19.840828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:19.841648 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:19.841648 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:19.841648 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:19.841648 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:19.841648 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:19.841648 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:19.841648 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:19.841648 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:19.841648 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:19.841648 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:19.841648 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:06:19.841648 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:19.842277 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 220/444] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:06:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:19.843483 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe8bf9-3363-499a-b381-8b4a2e4ab282 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:19.867170 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced89fca-2696-4bcd-aacf-d601b666b33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:19.867856 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced89fca-2696-4bcd-aacf-d601b666b33c None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:19.868136 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced89fca-2696-4bcd-aacf-d601b666b33c None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:19.868410 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced89fca-2696-4bcd-aacf-d601b666b33c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:19.955699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced89fca-2696-4bcd-aacf-d601b666b33c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:19.957113 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced89fca-2696-4bcd-aacf-d601b666b33c None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:19.967055 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe8bf9-3363-499a-b381-8b4a2e4ab282 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:19.990786 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:20.004125 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c464a71-df09-489a-9b6e-46d810a22abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:20.004898 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c464a71-df09-489a-9b6e-46d810a22abb None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:20.005125 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c464a71-df09-489a-9b6e-46d810a22abb None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:20.005366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c464a71-df09-489a-9b6e-46d810a22abb None admin] PATH_INFO: `/v3/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:20.006523 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c464a71-df09-489a-9b6e-46d810a22abb None admin] RBAC: Authorizing `identity:get_group(group_id=e3c6f0ef212b4ef4a5007d1c2f4d048c)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:20.008015 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c464a71-df09-489a-9b6e-46d810a22abb None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:20.009590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 221/445] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Sep 6 20:06:19 2022] GET /identity/v3/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:20.009590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c464a71-df09-489a-9b6e-46d810a22abb None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:20.063859 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:20.071914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 225/446] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:06:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:06:20.072792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced89fca-2696-4bcd-aacf-d601b666b33c None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:20.127798 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c464a71-df09-489a-9b6e-46d810a22abb None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:20.167004 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a1735-2fa5-4019-88d3-664a51b92606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:20.167892 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a1735-2fa5-4019-88d3-664a51b92606 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:20.167979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a1735-2fa5-4019-88d3-664a51b92606 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:20.168183 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a1735-2fa5-4019-88d3-664a51b92606 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:20.168866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a1735-2fa5-4019-88d3-664a51b92606 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:20.169168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a1735-2fa5-4019-88d3-664a51b92606 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:20.170555 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a1735-2fa5-4019-88d3-664a51b92606 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:20.188210 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 222/447] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:06:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:20.188210 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a1735-2fa5-4019-88d3-664a51b92606 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:20.190150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced89fca-2696-4bcd-aacf-d601b666b33c None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:20.228889 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0118455-4032-43d9-a3df-376e3764eddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:20.229423 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0118455-4032-43d9-a3df-376e3764eddb None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:20.229908 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0118455-4032-43d9-a3df-376e3764eddb None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:20.230194 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0118455-4032-43d9-a3df-376e3764eddb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:20.230933 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0118455-4032-43d9-a3df-376e3764eddb None admin] RBAC: Adding query filter params (group.id=e3c6f0ef212b4ef4a5007d1c2f4d048c, role.id=d970607307684690803e8e97e2d39e8f, scope.project.id=f882e970082a40b2ad1a0f258ad7e3ba) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:20.231239 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0118455-4032-43d9-a3df-376e3764eddb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:20.232736 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0118455-4032-43d9-a3df-376e3764eddb None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:20.239710 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 226/448] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Sep 6 20:06:20 2022] GET /identity/v3/role_assignments?group.id=e3c6f0ef212b4ef4a5007d1c2f4d048c&scope.project.id=f882e970082a40b2ad1a0f258ad7e3ba&role.id=d970607307684690803e8e97e2d39e8f => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:20.240548 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0118455-4032-43d9-a3df-376e3764eddb None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:20.257856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:20.328130 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:20.332385 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a1735-2fa5-4019-88d3-664a51b92606 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:20.382169 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c201e-0d46-412c-9025-2f0679a37c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:20.383239 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c201e-0d46-412c-9025-2f0679a37c7d None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:20.383752 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c201e-0d46-412c-9025-2f0679a37c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:20.384238 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c201e-0d46-412c-9025-2f0679a37c7d None admin] PATH_INFO: `/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:20.386466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c201e-0d46-412c-9025-2f0679a37c7d None admin] RBAC: Authorizing `identity:get_project(project_id=f882e970082a40b2ad1a0f258ad7e3ba)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:20.387988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c201e-0d46-412c-9025-2f0679a37c7d None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:20.390087 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 223/449] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:06:20 2022] GET /identity/v3/projects/f882e970082a40b2ad1a0f258ad7e3ba => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:20.400031 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c201e-0d46-412c-9025-2f0679a37c7d None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:20.403270 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0118455-4032-43d9-a3df-376e3764eddb None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:20.448262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13821494-9f62-4d47-9753-6161d7f8b87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:20.449809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13821494-9f62-4d47-9753-6161d7f8b87b None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:20.450151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13821494-9f62-4d47-9753-6161d7f8b87b None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:20.450832 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13821494-9f62-4d47-9753-6161d7f8b87b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:20.537071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c201e-0d46-412c-9025-2f0679a37c7d None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:20.541657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13821494-9f62-4d47-9753-6161d7f8b87b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:20.543146 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13821494-9f62-4d47-9753-6161d7f8b87b None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:20.563745 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:20.587309 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e614f6-d522-4b32-ac6b-200c29e0f3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:20.588218 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e614f6-d522-4b32-ac6b-200c29e0f3d4 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:20.589316 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e614f6-d522-4b32-ac6b-200c29e0f3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:20.589316 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e614f6-d522-4b32-ac6b-200c29e0f3d4 None admin] PATH_INFO: `/v3/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:20.593005 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e614f6-d522-4b32-ac6b-200c29e0f3d4 None admin] RBAC: Authorizing `identity:get_group(group_id=e3c6f0ef212b4ef4a5007d1c2f4d048c)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:20.594593 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e614f6-d522-4b32-ac6b-200c29e0f3d4 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:20.600396 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 224/450] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Sep 6 20:06:20 2022] GET /identity/v3/groups/e3c6f0ef212b4ef4a5007d1c2f4d048c => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:20.605968 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e614f6-d522-4b32-ac6b-200c29e0f3d4 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:20.622903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:20.673477 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 227/451] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:06:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:06:20.679552 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13821494-9f62-4d47-9753-6161d7f8b87b None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:20.728399 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e614f6-d522-4b32-ac6b-200c29e0f3d4 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:20.763698 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c2333-3bde-4c4d-9e61-53463faab8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:20.764303 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c2333-3bde-4c4d-9e61-53463faab8f5 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:20.764579 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c2333-3bde-4c4d-9e61-53463faab8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:20.764855 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c2333-3bde-4c4d-9e61-53463faab8f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:20.766118 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c2333-3bde-4c4d-9e61-53463faab8f5 None admin] RBAC: Adding query filter params (group.id=e3c6f0ef212b4ef4a5007d1c2f4d048c, role.id=8ad4b0e0a5384306acd6d162f21dcd3d, scope.project.id=f882e970082a40b2ad1a0f258ad7e3ba) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:20.766429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c2333-3bde-4c4d-9e61-53463faab8f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:20.767916 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700c2333-3bde-4c4d-9e61-53463faab8f5 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:20.773907 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 225/452] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Sep 6 20:06:20 2022] GET /identity/v3/role_assignments?group.id=e3c6f0ef212b4ef4a5007d1c2f4d048c&scope.project.id=f882e970082a40b2ad1a0f258ad7e3ba&role.id=8ad4b0e0a5384306acd6d162f21dcd3d => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:06:20.787759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13821494-9f62-4d47-9753-6161d7f8b87b None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:20.832004 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f4cfe-e0e3-4119-8df2-5b4b3d3941ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:20.832679 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f4cfe-e0e3-4119-8df2-5b4b3d3941ad None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:20.832964 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f4cfe-e0e3-4119-8df2-5b4b3d3941ad None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:20.833238 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f4cfe-e0e3-4119-8df2-5b4b3d3941ad None admin] PATH_INFO: `/v3/projects/003d1519e9c64c4283d31426f50dd5d3` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:20.834521 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f4cfe-e0e3-4119-8df2-5b4b3d3941ad None admin] RBAC: Authorizing `identity:get_project(project_id=003d1519e9c64c4283d31426f50dd5d3)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:20.836050 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f4cfe-e0e3-4119-8df2-5b4b3d3941ad None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:20.837812 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 228/453] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:06:20 2022] GET /identity/v3/projects/003d1519e9c64c4283d31426f50dd5d3 => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:06:20.844704 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c2333-3bde-4c4d-9e61-53463faab8f5 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:20.905833 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:20.961068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c2333-3bde-4c4d-9e61-53463faab8f5 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:21.005890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2d032-03ef-4746-9ea4-b8cc6c1f4bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:21.006525 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2d032-03ef-4746-9ea4-b8cc6c1f4bfd None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:21.006801 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2d032-03ef-4746-9ea4-b8cc6c1f4bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:21.007072 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2d032-03ef-4746-9ea4-b8cc6c1f4bfd None admin] PATH_INFO: `/v3/groups/fc6935ec974543228382b093f4bf782c` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:21.008288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2d032-03ef-4746-9ea4-b8cc6c1f4bfd None admin] RBAC: Authorizing `identity:get_group(group_id=fc6935ec974543228382b093f4bf782c)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:21.009870 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2d032-03ef-4746-9ea4-b8cc6c1f4bfd None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:21.011523 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 226/454] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Sep 6 20:06:20 2022] GET /identity/v3/groups/fc6935ec974543228382b093f4bf782c => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:21.018395 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f4cfe-e0e3-4119-8df2-5b4b3d3941ad None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:21.047798 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:21.129949 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f4cfe-e0e3-4119-8df2-5b4b3d3941ad None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:21.176449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b2aec-21c2-40a5-829c-ba0321f64e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:21.177532 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b2aec-21c2-40a5-829c-ba0321f64e70 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:21.177532 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b2aec-21c2-40a5-829c-ba0321f64e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:21.177532 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b2aec-21c2-40a5-829c-ba0321f64e70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:21.178605 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b2aec-21c2-40a5-829c-ba0321f64e70 None admin] RBAC: Adding query filter params (group.id=fc6935ec974543228382b093f4bf782c, role.id=1e2ac44410664e6b8f42ab3c37e2643f, scope.project.id=003d1519e9c64c4283d31426f50dd5d3) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:21.178605 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b2aec-21c2-40a5-829c-ba0321f64e70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:21.179972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b2aec-21c2-40a5-829c-ba0321f64e70 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:21.186730 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 229/455] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Sep 6 20:06:21 2022] GET /identity/v3/role_assignments?group.id=fc6935ec974543228382b093f4bf782c&scope.project.id=003d1519e9c64c4283d31426f50dd5d3&role.id=1e2ac44410664e6b8f42ab3c37e2643f => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:23.768460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b95c6-adaa-4ea0-8e5f-eaa788d6b8ef None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:23.769532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b95c6-adaa-4ea0-8e5f-eaa788d6b8ef None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:23.770014 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b95c6-adaa-4ea0-8e5f-eaa788d6b8ef None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:23.772035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 227/456] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:23.777396 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a9e1c-670c-4a4e-a147-08c7607ce611 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:23.778309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a9e1c-670c-4a4e-a147-08c7607ce611 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:23.778784 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a9e1c-670c-4a4e-a147-08c7607ce611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:23.808502 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-625a9e1c-670c-4a4e-a147-08c7607ce611 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:23.810064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-625a9e1c-670c-4a4e-a147-08c7607ce611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:23.912530 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 230/457] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:24.121664 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03aabd-2bbf-4581-bdf8-282838e7dc96 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:24.122352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03aabd-2bbf-4581-bdf8-282838e7dc96 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:24.122838 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03aabd-2bbf-4581-bdf8-282838e7dc96 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:24.124727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 228/458] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:24.130292 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fc1bd-be6d-4423-9f3e-41d08141dae7 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:24.130825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fc1bd-be6d-4423-9f3e-41d08141dae7 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:24.131298 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fc1bd-be6d-4423-9f3e-41d08141dae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:24.154922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-7b0fc1bd-be6d-4423-9f3e-41d08141dae7 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:24.157109 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-7b0fc1bd-be6d-4423-9f3e-41d08141dae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:24.179207 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:24.243023 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03aabd-2bbf-4581-bdf8-282838e7dc96 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:24.271687 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 231/459] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:24.324642 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3da4f5-fd15-47ab-834b-3053f40d5954 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:24.324981 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3da4f5-fd15-47ab-834b-3053f40d5954 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:24.325186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3da4f5-fd15-47ab-834b-3053f40d5954 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:24.326524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 232/460] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:06:24.332575 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988773b8-ef01-40ba-b577-fe5b9a3cf3a5 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:24.332863 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988773b8-ef01-40ba-b577-fe5b9a3cf3a5 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:24.333140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988773b8-ef01-40ba-b577-fe5b9a3cf3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:24.366038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-988773b8-ef01-40ba-b577-fe5b9a3cf3a5 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:24.367511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-988773b8-ef01-40ba-b577-fe5b9a3cf3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:24.388721 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03aabd-2bbf-4581-bdf8-282838e7dc96 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:24.429111 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:24.455327 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232f188-80ce-4f25-a980-4214c3ec4d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:24.456100 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232f188-80ce-4f25-a980-4214c3ec4d2d None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:24.456695 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232f188-80ce-4f25-a980-4214c3ec4d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:24.457177 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232f188-80ce-4f25-a980-4214c3ec4d2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:24.483119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232f188-80ce-4f25-a980-4214c3ec4d2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:24.485174 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232f188-80ce-4f25-a980-4214c3ec4d2d None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:24.516190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-2232f188-80ce-4f25-a980-4214c3ec4d2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:24.516190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:24.516190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:24.516190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:24.516190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:24.516190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:24.516190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:24.516190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:24.516190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:24.516190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:24.516190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:24.516190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:24.516190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:24.516190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:24.516190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:24.516190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:24.517167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:24.517167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:24.517167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:24.517167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:24.517167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:24.517167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:24.517167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:24.517167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:24.517167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:24.517167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:24.517167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:24.517167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:24.517167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:24.517167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:24.517167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:24.517167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:24.517167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:24.518014 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:24.518014 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:24.518014 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:24.518014 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 229/461] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:06:24.523473 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 233/462] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 20:06:24.525177 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232f188-80ce-4f25-a980-4214c3ec4d2d None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:24.640554 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988773b8-ef01-40ba-b577-fe5b9a3cf3a5 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:24.682297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232f188-80ce-4f25-a980-4214c3ec4d2d None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:24.744597 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:24.754403 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988773b8-ef01-40ba-b577-fe5b9a3cf3a5 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:24.777635 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40187b9f-018b-4fbf-8ab7-2c5717d3e9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:24.778877 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40187b9f-018b-4fbf-8ab7-2c5717d3e9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:24.779294 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40187b9f-018b-4fbf-8ab7-2c5717d3e9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:24.779733 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40187b9f-018b-4fbf-8ab7-2c5717d3e9b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:24.780546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40187b9f-018b-4fbf-8ab7-2c5717d3e9b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:24.781538 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40187b9f-018b-4fbf-8ab7-2c5717d3e9b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:24.783095 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40187b9f-018b-4fbf-8ab7-2c5717d3e9b6 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:24.793899 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8f9ef-e72f-4183-899d-ab3cfbf448ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:24.795222 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8f9ef-e72f-4183-899d-ab3cfbf448ef None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:24.795735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8f9ef-e72f-4183-899d-ab3cfbf448ef None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:24.796299 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8f9ef-e72f-4183-899d-ab3cfbf448ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:24.808178 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8f9ef-e72f-4183-899d-ab3cfbf448ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:24.809897 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8f9ef-e72f-4183-899d-ab3cfbf448ef None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:24.813925 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 230/463] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:06:24.821179 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40187b9f-018b-4fbf-8ab7-2c5717d3e9b6 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:24.828326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-9ad8f9ef-e72f-4183-899d-ab3cfbf448ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:24.828326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:24.828326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:24.828326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:24.828326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:24.828326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:24.828326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:24.828326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:24.828326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:24.828326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:24.828326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:24.828326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:24.828326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:24.828326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:24.828326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:24.828326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:24.829248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:24.829248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:24.829248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:24.829248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:24.829248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:24.829248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:24.829248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:24.829248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:24.829248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:24.829248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:24.829248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:24.829248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:24.829248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:24.829248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:24.829248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:24.829248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:24.829248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:24.834111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:24.834111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:24.834111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:24.834111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 234/464] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:24.834111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8f9ef-e72f-4183-899d-ab3cfbf448ef None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:24.869325 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:24.946617 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40187b9f-018b-4fbf-8ab7-2c5717d3e9b6 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:24.963214 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8f9ef-e72f-4183-899d-ab3cfbf448ef None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:24.985769 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3227b0-fcad-42a0-be14-824438a14f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:24.986555 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3227b0-fcad-42a0-be14-824438a14f13 None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:24.986931 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3227b0-fcad-42a0-be14-824438a14f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:24.987300 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3227b0-fcad-42a0-be14-824438a14f13 None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:24.988072 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3227b0-fcad-42a0-be14-824438a14f13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:24.989660 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3227b0-fcad-42a0-be14-824438a14f13 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:25.001415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:25.007519 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a2142-8ea8-4d30-b79d-590ebbfcf0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:25.008163 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a2142-8ea8-4d30-b79d-590ebbfcf0c3 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:25.008446 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a2142-8ea8-4d30-b79d-590ebbfcf0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:25.008719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a2142-8ea8-4d30-b79d-590ebbfcf0c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:25.020521 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a2142-8ea8-4d30-b79d-590ebbfcf0c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:25.022052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a2142-8ea8-4d30-b79d-590ebbfcf0c3 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:25.038126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-436a2142-8ea8-4d30-b79d-590ebbfcf0c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:25.038126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:25.038126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:25.038126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:25.038126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:25.038126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:25.038126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:25.038126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:25.038126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:25.038126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:25.038126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:25.038126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:25.038126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:25.038126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:25.038126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:25.038126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:25.039111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:25.039111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:25.039111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:25.039111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:25.039111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:25.039111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:25.039111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:25.039111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:25.039111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:25.039111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:25.039111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:25.039111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:25.039111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:25.039111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:25.039111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:25.039111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:25.039111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:25.040450 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:25.040450 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:25.040450 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:25.040450 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 235/465] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:25.040450 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a2142-8ea8-4d30-b79d-590ebbfcf0c3 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:25.148088 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 231/466] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Sep 6 20:06:24 2022] POST /identity/v3/users => generated 246 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:06:25.148884 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a2142-8ea8-4d30-b79d-590ebbfcf0c3 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:25.149338 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3227b0-fcad-42a0-be14-824438a14f13 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:25.209960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d458bfc-3d5e-4f6a-ae6e-9dd5ca218c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:25.211017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d458bfc-3d5e-4f6a-ae6e-9dd5ca218c06 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:25.212081 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d458bfc-3d5e-4f6a-ae6e-9dd5ca218c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:25.212592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d458bfc-3d5e-4f6a-ae6e-9dd5ca218c06 None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:25.213921 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d458bfc-3d5e-4f6a-ae6e-9dd5ca218c06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:25.214760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d458bfc-3d5e-4f6a-ae6e-9dd5ca218c06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:25.219192 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d458bfc-3d5e-4f6a-ae6e-9dd5ca218c06 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:25.243610 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 236/467] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:25.245330 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a8652-3f4f-4ee5-b6f6-d40115ab661d None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:25.245792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a8652-3f4f-4ee5-b6f6-d40115ab661d None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:25.246273 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a8652-3f4f-4ee5-b6f6-d40115ab661d None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:25.252926 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 237/468] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:25.254179 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a8652-3f4f-4ee5-b6f6-d40115ab661d None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:25.282459 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:25.302815 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3227b0-fcad-42a0-be14-824438a14f13 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:25.325018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:25.355161 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cb193-32b0-4cf2-aff4-def977a67250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:25.355790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cb193-32b0-4cf2-aff4-def977a67250 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:25.356295 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cb193-32b0-4cf2-aff4-def977a67250 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:25.356422 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cb193-32b0-4cf2-aff4-def977a67250 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:25.357044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2cb193-32b0-4cf2-aff4-def977a67250 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:25.357742 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2cb193-32b0-4cf2-aff4-def977a67250 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:25.358975 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2cb193-32b0-4cf2-aff4-def977a67250 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:25.376345 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 232/469] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:25.378233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b22aef-df86-4c7e-931d-b1f8c6649352 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:25.378768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b22aef-df86-4c7e-931d-b1f8c6649352 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:25.379146 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b22aef-df86-4c7e-931d-b1f8c6649352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:25.402107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-79b22aef-df86-4c7e-931d-b1f8c6649352 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:25.403323 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-79b22aef-df86-4c7e-931d-b1f8c6649352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:25.418364 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a8652-3f4f-4ee5-b6f6-d40115ab661d None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:25.486059 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15916f7d-ff4a-424c-8e56-0e3a9ac116d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:25.487027 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15916f7d-ff4a-424c-8e56-0e3a9ac116d2 None admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:25.487406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15916f7d-ff4a-424c-8e56-0e3a9ac116d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:25.488227 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15916f7d-ff4a-424c-8e56-0e3a9ac116d2 None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:25.489306 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15916f7d-ff4a-424c-8e56-0e3a9ac116d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:25.491234 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15916f7d-ff4a-424c-8e56-0e3a9ac116d2 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:25.496643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 233/470] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:25.497654 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b22aef-df86-4c7e-931d-b1f8c6649352 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:25.582313 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 238/471] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Sep 6 20:06:25 2022] POST /identity/v3/users => generated 248 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:06:25.583678 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ff9fc-1ebc-4ed0-857a-ac61da05b628 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:25.583967 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ff9fc-1ebc-4ed0-857a-ac61da05b628 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:25.584243 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ff9fc-1ebc-4ed0-857a-ac61da05b628 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:25.585708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 239/472] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:25.591824 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d99dfa-2f35-4f60-8b25-04bb4a7ba0c9 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:25.592103 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d99dfa-2f35-4f60-8b25-04bb4a7ba0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:25.592381 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d99dfa-2f35-4f60-8b25-04bb4a7ba0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:25.596523 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:25.613989 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-f9d99dfa-2f35-4f60-8b25-04bb4a7ba0c9 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:25.615501 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f9d99dfa-2f35-4f60-8b25-04bb4a7ba0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:25.632361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b22aef-df86-4c7e-931d-b1f8c6649352 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:25.709618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9acae-ef5b-49a6-81a7-e71be3c79c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:25.710250 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9acae-ef5b-49a6-81a7-e71be3c79c75 None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:25.710522 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9acae-ef5b-49a6-81a7-e71be3c79c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:25.710789 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9acae-ef5b-49a6-81a7-e71be3c79c75 None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:25.711475 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9acae-ef5b-49a6-81a7-e71be3c79c75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:25.712997 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9acae-ef5b-49a6-81a7-e71be3c79c75 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:25.757842 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 240/473] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:25.825814 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 234/474] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Sep 6 20:06:25 2022] POST /identity/v3/users => generated 248 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:06:25.865168 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d99dfa-2f35-4f60-8b25-04bb4a7ba0c9 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:25.904315 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:25.991572 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d99dfa-2f35-4f60-8b25-04bb4a7ba0c9 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:26.031956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b11421-94c7-44db-978e-91a304e50478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:26.032521 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b11421-94c7-44db-978e-91a304e50478 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:26.032795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b11421-94c7-44db-978e-91a304e50478 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:26.033049 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b11421-94c7-44db-978e-91a304e50478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:26.045320 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b11421-94c7-44db-978e-91a304e50478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:26.047343 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b11421-94c7-44db-978e-91a304e50478 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:26.064584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-62b11421-94c7-44db-978e-91a304e50478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:26.064584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:26.064584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:26.064584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:26.064584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:26.064584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:26.064584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:26.064584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:26.064584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:26.064584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:26.064584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:26.064584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:26.064584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:26.064584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:26.064584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:26.064584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:26.065524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:26.065524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:26.065524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:26.065524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:26.065524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:26.065524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:26.065524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:26.065524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:26.065524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:26.065524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:26.065524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:26.065524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:26.065524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:26.065524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:26.065524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:26.065524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:26.065524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:26.066445 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:26.066445 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:26.066445 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:26.066445 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 241/475] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:26.071767 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9acae-ef5b-49a6-81a7-e71be3c79c75 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:26.071934 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b11421-94c7-44db-978e-91a304e50478 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:26.193499 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:26.221167 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b11421-94c7-44db-978e-91a304e50478 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:26.223934 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9acae-ef5b-49a6-81a7-e71be3c79c75 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:26.268545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753f7a8-98be-4a5e-a323-47fe4fbb4a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:26.269208 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753f7a8-98be-4a5e-a323-47fe4fbb4a02 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:26.269488 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753f7a8-98be-4a5e-a323-47fe4fbb4a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:26.269757 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753f7a8-98be-4a5e-a323-47fe4fbb4a02 None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:26.270410 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753f7a8-98be-4a5e-a323-47fe4fbb4a02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:26.270718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753f7a8-98be-4a5e-a323-47fe4fbb4a02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:26.272121 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753f7a8-98be-4a5e-a323-47fe4fbb4a02 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:26.279737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a804471-8531-4d16-99b7-cd5c7c65331d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:26.281584 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a804471-8531-4d16-99b7-cd5c7c65331d None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:26.281887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a804471-8531-4d16-99b7-cd5c7c65331d None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:26.282214 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a804471-8531-4d16-99b7-cd5c7c65331d None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:26.282839 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a804471-8531-4d16-99b7-cd5c7c65331d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:26.284831 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a804471-8531-4d16-99b7-cd5c7c65331d None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:26.288679 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:26.295729 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 242/476] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:26.301847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753f7a8-98be-4a5e-a323-47fe4fbb4a02 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:26.325976 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.sql.core [None req-1a804471-8531-4d16-99b7-cd5c7c65331d None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 06 20:06:26.325976 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 06 20:06:26.325976 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [parameters: {'id': 'a19890d37f1645698d60d9d0c6962bfa', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 06 20:06:26.325976 dv-cinder-847732-4-smb devstack@keystone.service[81846]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81846) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 06 20:06:26.362121 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-1a804471-8531-4d16-99b7-cd5c7c65331d None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 06 20:06:26.362121 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:26.362121 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 20:06:26.362121 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 20:06:26.362121 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 20:06:26.362121 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 20:06:26.362121 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 20:06:26.362121 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 20:06:26.362121 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 20:06:26.362121 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application conn.query(q) Sep 06 20:06:26.362121 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 20:06:26.362121 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 20:06:26.362121 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 20:06:26.362121 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application result.read() Sep 06 20:06:26.362121 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 20:06:26.363130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 20:06:26.363130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 20:06:26.363130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 20:06:26.363130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 20:06:26.363130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 20:06:26.363130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 20:06:26.363130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 20:06:26.363130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 06 20:06:26.363130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:26.363130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 06 20:06:26.363130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:26.363130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:26.363130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 06 20:06:26.363130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 06 20:06:26.363130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 06 20:06:26.363130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return ref.to_dict() Sep 06 20:06:26.363130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 20:06:26.363130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application next(self.gen) Sep 06 20:06:26.364288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 06 20:06:26.364288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application yield resource Sep 06 20:06:26.364288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 20:06:26.364288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application next(self.gen) Sep 06 20:06:26.364288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 06 20:06:26.364288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self.session.rollback() Sep 06 20:06:26.364288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 20:06:26.364288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self.force_reraise() Sep 06 20:06:26.364288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 20:06:26.364288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise self.value Sep 06 20:06:26.364288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 06 20:06:26.364288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 06 20:06:26.364288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 06 20:06:26.364288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application session.commit() Sep 06 20:06:26.364288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 06 20:06:26.364288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 06 20:06:26.364288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 06 20:06:26.365132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._prepare_impl() Sep 06 20:06:26.365132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 06 20:06:26.365132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self.session.flush() Sep 06 20:06:26.365132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 06 20:06:26.365132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._flush(objects) Sep 06 20:06:26.365132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 06 20:06:26.365132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 06 20:06:26.365132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 06 20:06:26.365132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application compat.raise_( Sep 06 20:06:26.365132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 20:06:26.365132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception Sep 06 20:06:26.365132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 06 20:06:26.365132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application flush_context.execute() Sep 06 20:06:26.365132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 06 20:06:26.365132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rec.execute(self) Sep 06 20:06:26.365132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 06 20:06:26.365132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 06 20:06:26.366025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 06 20:06:26.366025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 06 20:06:26.366025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 06 20:06:26.366025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 06 20:06:26.366025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 06 20:06:26.366025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 06 20:06:26.366025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 06 20:06:26.366025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 06 20:06:26.366025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 06 20:06:26.366025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 06 20:06:26.366025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 06 20:06:26.366025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 06 20:06:26.366025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 06 20:06:26.366025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 06 20:06:26.366025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 20:06:26.366025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception Sep 06 20:06:26.366832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 20:06:26.366832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 20:06:26.366832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 20:06:26.366832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 20:06:26.366832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 20:06:26.366832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 20:06:26.366832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 20:06:26.366832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application conn.query(q) Sep 06 20:06:26.366832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 20:06:26.366832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 20:06:26.366832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 20:06:26.366832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application result.read() Sep 06 20:06:26.366832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 20:06:26.366832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 20:06:26.366832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 20:06:26.366832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 20:06:26.367854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 20:06:26.367854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 20:06:26.367854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 20:06:26.367854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 20:06:26.367854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 06 20:06:26.367854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 06 20:06:26.367854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [parameters: {'id': 'a19890d37f1645698d60d9d0c6962bfa', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 06 20:06:26.367854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 06 20:06:26.367854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:26.367854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:06:26.367854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:26.367854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:26.367854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:26.367854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:26.367854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:26.367854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:26.368741 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:26.368741 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:26.368741 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:26.368741 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:26.368741 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:26.368741 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:26.368741 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 06 20:06:26.368741 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 06 20:06:26.368741 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:26.368741 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:26.368741 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 06 20:06:26.368741 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 06 20:06:26.368741 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 06 20:06:26.368741 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 06 20:06:26.368741 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 06 20:06:26.368741 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:26.373651 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 235/477] 10.222.0.77 () {60 vars in 1131 bytes} [Tue Sep 6 20:06:26 2022] POST /identity/v3/roles => generated 144 bytes in 302 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:26.380427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a804471-8531-4d16-99b7-cd5c7c65331d None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:26.495075 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753f7a8-98be-4a5e-a323-47fe4fbb4a02 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:26.580089 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb308d98-a5ec-4e37-8afa-a6eb5b83ef15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:26.580644 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb308d98-a5ec-4e37-8afa-a6eb5b83ef15 None admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:26.580952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb308d98-a5ec-4e37-8afa-a6eb5b83ef15 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:26.581256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb308d98-a5ec-4e37-8afa-a6eb5b83ef15 None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:26.582043 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb308d98-a5ec-4e37-8afa-a6eb5b83ef15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:26.583662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb308d98-a5ec-4e37-8afa-a6eb5b83ef15 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:26.619510 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a804471-8531-4d16-99b7-cd5c7c65331d None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:26.658152 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ef022-5fa6-4540-ad20-10358383a3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:26.659104 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ef022-5fa6-4540-ad20-10358383a3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:26.659412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ef022-5fa6-4540-ad20-10358383a3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:26.659718 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ef022-5fa6-4540-ad20-10358383a3d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:26.672769 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ef022-5fa6-4540-ad20-10358383a3d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:26.678387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-c37ef022-5fa6-4540-ad20-10358383a3d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 20:06:26.678387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:26.678387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:26.678387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:26.678387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:26.678387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:26.678387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:26.678387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:26.678387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:26.678387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:26.678387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:26.678387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:26.678387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:26.678387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:26.678387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:26.678387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:26.679264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:26.679264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:26.679264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:26.679264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:26.679264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:26.679264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:26.679264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:26.679264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:26.679264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:26.679264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:26.679264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:26.679264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:26.679264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:26.679264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:26.679264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:26.679264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:26.680388 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:26.680388 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:26.680388 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:26.680388 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:26.680388 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:26.680388 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:26.680388 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:26.680388 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:26.680388 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:26.680388 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:26.680388 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 20:06:26.680388 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:26.680388 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 236/478] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Sep 6 20:06:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:06:26.688077 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ef022-5fa6-4540-ad20-10358383a3d5 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:26.723815 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:26.729119 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 243/479] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Sep 6 20:06:26 2022] POST /identity/v3/users => generated 249 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:06:26.769050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:26.818524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ef022-5fa6-4540-ad20-10358383a3d5 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:26.856391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1e9b8-311c-49ae-b9d0-6fe6e3464eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:26.856995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1e9b8-311c-49ae-b9d0-6fe6e3464eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:26.857218 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1e9b8-311c-49ae-b9d0-6fe6e3464eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:26.857482 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1e9b8-311c-49ae-b9d0-6fe6e3464eb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:26.858237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1e9b8-311c-49ae-b9d0-6fe6e3464eb9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:26.858553 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1e9b8-311c-49ae-b9d0-6fe6e3464eb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:26.860637 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1e9b8-311c-49ae-b9d0-6fe6e3464eb9 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:26.870581 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 237/480] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:06:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:27.955830 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21249363-d924-46a9-8c95-64b09aa138fd None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:27.956342 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21249363-d924-46a9-8c95-64b09aa138fd None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:27.956442 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21249363-d924-46a9-8c95-64b09aa138fd None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:27.957941 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 244/481] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:27.967489 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48361830-82bb-458d-a8f4-6843e3ca5d22 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:27.968631 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48361830-82bb-458d-a8f4-6843e3ca5d22 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:27.968631 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48361830-82bb-458d-a8f4-6843e3ca5d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:28.000397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-48361830-82bb-458d-a8f4-6843e3ca5d22 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:28.001612 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-48361830-82bb-458d-a8f4-6843e3ca5d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:28.096502 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 238/482] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 20:06:28.435222 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b85b9-2c4a-4921-b433-7650e9d0752d None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:28.435576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b85b9-2c4a-4921-b433-7650e9d0752d None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:28.435750 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b85b9-2c4a-4921-b433-7650e9d0752d None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:28.437937 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 245/483] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:28.443014 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf516b87-f734-4925-9b28-3a519d2a3166 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:28.443305 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf516b87-f734-4925-9b28-3a519d2a3166 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:28.448554 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf516b87-f734-4925-9b28-3a519d2a3166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:28.481448 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803af26-adde-4000-8fa9-08b4de79123d None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:28.481786 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803af26-adde-4000-8fa9-08b4de79123d None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:28.481992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803af26-adde-4000-8fa9-08b4de79123d None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:28.483632 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 246/484] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:06:28.489070 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fec7f-d765-4c5b-83b0-a38363e69156 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:28.489389 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fec7f-d765-4c5b-83b0-a38363e69156 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:28.490002 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fec7f-d765-4c5b-83b0-a38363e69156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:28.516025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-bf516b87-f734-4925-9b28-3a519d2a3166 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:28.517244 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-bf516b87-f734-4925-9b28-3a519d2a3166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:28.525521 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-879fec7f-d765-4c5b-83b0-a38363e69156 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:28.526829 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-879fec7f-d765-4c5b-83b0-a38363e69156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:28.597779 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:28.617562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 247/485] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 20:06:28.618473 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fec7f-d765-4c5b-83b0-a38363e69156 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:28.626255 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 239/486] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:28.758343 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fec7f-d765-4c5b-83b0-a38363e69156 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:28.806353 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:28.814927 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52deeff-3cf0-456b-a953-625a8086cdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:28.815727 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52deeff-3cf0-456b-a953-625a8086cdd8 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:28.816129 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52deeff-3cf0-456b-a953-625a8086cdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:28.819682 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52deeff-3cf0-456b-a953-625a8086cdd8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:28.829707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52deeff-3cf0-456b-a953-625a8086cdd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:28.836637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-b52deeff-3cf0-456b-a953-625a8086cdd8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:28.836637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:28.836637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:28.836637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:28.836637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:28.836637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:28.836637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:28.836637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:28.836637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:28.836637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:28.836637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:28.836637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:28.836637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:28.836637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:28.836637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:28.836637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:28.837533 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:28.837533 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:28.837533 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:28.837533 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:28.837533 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:28.837533 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:28.837533 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:28.837533 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:28.837533 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:28.837533 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:28.837533 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:28.837533 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:28.837533 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:28.837533 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:28.837533 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:28.837533 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:28.838708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:28.838708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:28.838708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:28.838708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:28.838708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:28.838708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:28.838708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:28.838708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:28.838708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:28.838708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:28.838708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:28.838708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:28.838708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 248/487] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Sep 6 20:06:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:28.845032 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf516b87-f734-4925-9b28-3a519d2a3166 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:28.956600 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52deeff-3cf0-456b-a953-625a8086cdd8 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:28.998454 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf516b87-f734-4925-9b28-3a519d2a3166 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:29.044695 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdc99f-3771-43b6-87d3-60fd712a3a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:29.045315 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdc99f-3771-43b6-87d3-60fd712a3a05 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:29.045654 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdc99f-3771-43b6-87d3-60fd712a3a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:29.045934 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdc99f-3771-43b6-87d3-60fd712a3a05 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:29.047151 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdc99f-3771-43b6-87d3-60fd712a3a05 None admin] RBAC: Adding query filter params (name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:29.047477 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdc99f-3771-43b6-87d3-60fd712a3a05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:29.049362 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdc99f-3771-43b6-87d3-60fd712a3a05 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:29.063513 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 240/488] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Sep 6 20:06:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:29.065418 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdc99f-3771-43b6-87d3-60fd712a3a05 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:29.121281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:29.153685 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52deeff-3cf0-456b-a953-625a8086cdd8 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:29.194878 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55c206-0d5e-428a-bb71-d2605ca04204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:29.195547 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55c206-0d5e-428a-bb71-d2605ca04204 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:29.195827 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55c206-0d5e-428a-bb71-d2605ca04204 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:29.196095 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55c206-0d5e-428a-bb71-d2605ca04204 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:29.197718 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdc99f-3771-43b6-87d3-60fd712a3a05 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:29.209127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55c206-0d5e-428a-bb71-d2605ca04204 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:29.214522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-7f55c206-0d5e-428a-bb71-d2605ca04204 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:29.214522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:29.214522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:29.214522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:29.214522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:29.214522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:29.214522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:29.214522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:29.214522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:29.214522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:29.214522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:29.214522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:29.214522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:29.214522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:29.214522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:29.214522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:29.216699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:29.216699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:29.216699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:29.216699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:29.216699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:29.216699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:29.216699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:29.216699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:29.216699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:29.216699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:29.216699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:29.216699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:29.216699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:29.216699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:29.216699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:29.216699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:29.219140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:29.219140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:29.219140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:29.219140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:29.219140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:29.219140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:29.219140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:29.219140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:29.219140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:29.219140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:29.219140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:29.219140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:29.219140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 249/489] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Sep 6 20:06:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:29.219140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55c206-0d5e-428a-bb71-d2605ca04204 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:29.243205 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090baab8-1076-46c7-a4cc-1156046c2063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:29.244216 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090baab8-1076-46c7-a4cc-1156046c2063 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:29.245641 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090baab8-1076-46c7-a4cc-1156046c2063 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:29.246168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090baab8-1076-46c7-a4cc-1156046c2063 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:29.276306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090baab8-1076-46c7-a4cc-1156046c2063 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:29.284837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-090baab8-1076-46c7-a4cc-1156046c2063 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:29.284837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:29.284837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:29.284837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:29.284837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:29.284837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:29.284837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:29.284837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:29.284837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:29.284837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:29.284837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:29.284837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:29.284837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:29.284837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:29.284837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:29.284837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:29.286622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:29.286622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:29.286622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:29.286622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:29.286622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:29.286622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:29.286622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:29.286622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:29.286622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:29.286622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:29.286622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:29.286622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:29.286622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:29.286622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:29.286622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:29.286622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:29.288212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:29.288212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:29.288212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:29.288212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:29.288212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:29.288212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:29.288212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:29.288212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:29.288212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:29.288212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:29.288212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:29.288212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:29.288212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 241/490] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Sep 6 20:06:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:29.288212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090baab8-1076-46c7-a4cc-1156046c2063 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:29.295547 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:29.366827 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55c206-0d5e-428a-bb71-d2605ca04204 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:29.412841 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2c9ee-be5f-47fe-84f0-a1805604e025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:29.413723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2c9ee-be5f-47fe-84f0-a1805604e025 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:29.414205 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2c9ee-be5f-47fe-84f0-a1805604e025 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:29.414545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2c9ee-be5f-47fe-84f0-a1805604e025 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:29.430400 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2c9ee-be5f-47fe-84f0-a1805604e025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:29.433331 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2c9ee-be5f-47fe-84f0-a1805604e025 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:29.446300 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090baab8-1076-46c7-a4cc-1156046c2063 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:29.448921 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:29.457629 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-baa2c9ee-be5f-47fe-84f0-a1805604e025 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:29.457629 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:29.457629 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:29.457629 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:29.457629 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:29.457629 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:29.457629 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:29.457629 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:29.457629 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:29.457629 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:29.457629 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:29.457629 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:29.457629 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:29.457629 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:29.457629 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:29.457629 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:29.458807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:29.458807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:29.458807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:29.458807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:29.458807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:29.458807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:29.458807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:29.458807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:29.458807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:29.458807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:29.458807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:29.458807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:29.458807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:29.458807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:29.458807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:29.458807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:29.458807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:29.459883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:29.459883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:29.459883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:29.459883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 250/491] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:29.459883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2c9ee-be5f-47fe-84f0-a1805604e025 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:29.501444 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae59c8-a48f-4e9a-9842-ee4977b975a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:29.502600 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae59c8-a48f-4e9a-9842-ee4977b975a9 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:29.502885 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae59c8-a48f-4e9a-9842-ee4977b975a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:29.503145 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae59c8-a48f-4e9a-9842-ee4977b975a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:29.503830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae59c8-a48f-4e9a-9842-ee4977b975a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:29.504130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae59c8-a48f-4e9a-9842-ee4977b975a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:29.505617 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae59c8-a48f-4e9a-9842-ee4977b975a9 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:29.516912 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 242/492] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Sep 6 20:06:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:29.517664 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae59c8-a48f-4e9a-9842-ee4977b975a9 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:29.612860 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:29.617022 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2c9ee-be5f-47fe-84f0-a1805604e025 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:29.662268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11368f45-0519-451d-9db7-67562c37d941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:29.662998 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11368f45-0519-451d-9db7-67562c37d941 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:29.663210 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11368f45-0519-451d-9db7-67562c37d941 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:29.663460 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11368f45-0519-451d-9db7-67562c37d941 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:29.664162 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11368f45-0519-451d-9db7-67562c37d941 None admin] RBAC: Adding query filter params (name=service) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:29.664465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11368f45-0519-451d-9db7-67562c37d941 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:29.665931 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11368f45-0519-451d-9db7-67562c37d941 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:29.670693 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae59c8-a48f-4e9a-9842-ee4977b975a9 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:29.682931 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 251/493] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Sep 6 20:06:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:29.684221 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11368f45-0519-451d-9db7-67562c37d941 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:29.721515 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b631d-debd-41a4-b48b-eaeb98a69684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:29.722516 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b631d-debd-41a4-b48b-eaeb98a69684 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:29.723005 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b631d-debd-41a4-b48b-eaeb98a69684 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:29.723784 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b631d-debd-41a4-b48b-eaeb98a69684 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:29.725641 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b631d-debd-41a4-b48b-eaeb98a69684 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:29.726178 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b631d-debd-41a4-b48b-eaeb98a69684 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:29.727942 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b631d-debd-41a4-b48b-eaeb98a69684 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:29.747051 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 243/494] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:29.748020 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b631d-debd-41a4-b48b-eaeb98a69684 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:29.775764 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:29.811645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11368f45-0519-451d-9db7-67562c37d941 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:29.852702 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548b84e-7cf2-4d7c-973d-b064ba068c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:29.853300 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b631d-debd-41a4-b48b-eaeb98a69684 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:29.853415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548b84e-7cf2-4d7c-973d-b064ba068c75 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:29.853598 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548b84e-7cf2-4d7c-973d-b064ba068c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:29.853870 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548b84e-7cf2-4d7c-973d-b064ba068c75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:29.864703 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548b84e-7cf2-4d7c-973d-b064ba068c75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:29.866226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548b84e-7cf2-4d7c-973d-b064ba068c75 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:29.880708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-a548b84e-7cf2-4d7c-973d-b064ba068c75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:29.880708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:29.880708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:29.880708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:29.880708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:29.880708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:29.880708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:29.880708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:29.880708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:29.880708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:29.880708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:29.880708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:29.880708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:29.880708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:29.880708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:29.880708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:29.881622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:29.881622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:29.881622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:29.881622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:29.881622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:29.881622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:29.881622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:29.881622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:29.881622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:29.881622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:29.881622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:29.881622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:29.881622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:29.881622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:29.881622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:29.881622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:29.881622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:29.882430 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:29.882430 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:29.882430 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:29.882430 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 252/495] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:29.882648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548b84e-7cf2-4d7c-973d-b064ba068c75 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:29.892957 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b3f1e-72c6-47f5-8d99-90d999f93eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:29.893591 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b3f1e-72c6-47f5-8d99-90d999f93eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:29.893871 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b3f1e-72c6-47f5-8d99-90d999f93eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:29.894141 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b3f1e-72c6-47f5-8d99-90d999f93eb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:29.898802 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:29.904443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b3f1e-72c6-47f5-8d99-90d999f93eb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:29.906497 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b3f1e-72c6-47f5-8d99-90d999f93eb2 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:29.921532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-134b3f1e-72c6-47f5-8d99-90d999f93eb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:29.921532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:29.921532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:29.921532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:29.921532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:29.921532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:29.921532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:29.921532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:29.921532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:29.921532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:29.921532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:29.921532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:29.921532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:29.921532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:29.921532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:29.921532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:29.922629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:29.922629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:29.922629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:29.922629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:29.922629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:29.922629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:29.922629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:29.922629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:29.922629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:29.922629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:29.922629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:29.922629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:29.922629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:29.922629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:29.922629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:29.922629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:29.922629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:29.923527 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:29.923527 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:29.923527 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:29.923527 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 244/496] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:29.923947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b81fa-a72c-4b03-a6ca-607cb18aafd7 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:29.924192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b81fa-a72c-4b03-a6ca-607cb18aafd7 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:29.924468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b81fa-a72c-4b03-a6ca-607cb18aafd7 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:29.925743 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 245/497] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:29.926748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5416742-77f4-4229-a001-330f12bf57a5 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:29.927019 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5416742-77f4-4229-a001-330f12bf57a5 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:29.927287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5416742-77f4-4229-a001-330f12bf57a5 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:29.928481 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 246/498] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:29.929184 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5416742-77f4-4229-a001-330f12bf57a5 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:29.995614 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548b84e-7cf2-4d7c-973d-b064ba068c75 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:30.014356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:30.031683 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62e593-6bb7-42d9-b246-5f820b03efb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:30.032340 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62e593-6bb7-42d9-b246-5f820b03efb0 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:30.032609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62e593-6bb7-42d9-b246-5f820b03efb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:30.032876 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62e593-6bb7-42d9-b246-5f820b03efb0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:30.039700 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5416742-77f4-4229-a001-330f12bf57a5 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:30.040953 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62e593-6bb7-42d9-b246-5f820b03efb0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:30.042399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62e593-6bb7-42d9-b246-5f820b03efb0 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:30.055546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-cc62e593-6bb7-42d9-b246-5f820b03efb0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 20:06:30.055546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:30.055546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:30.055546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:30.055546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:30.055546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:30.055546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:30.055546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:30.055546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:30.055546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:30.055546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:30.055546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:30.055546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:06:30.055546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:06:30.055546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:06:30.055546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:06:30.056577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:30.056577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:30.056577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:06:30.056577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:30.056577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:06:30.056577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:30.056577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:30.056577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:30.056577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:30.056577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:30.056577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:30.056577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:30.056577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:30.056577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:30.056577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:30.056577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:30.056577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:30.056577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:30.057481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:30.057481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:30.057481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:06:30.057481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:06:30.057481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:06:30.057481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:06:30.057481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:06:30.057481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:06:30.057481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 20:06:30.057481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:30.059583 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 253/499] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Sep 6 20:06:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:30.060614 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62e593-6bb7-42d9-b246-5f820b03efb0 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:30.080353 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de6c28-8ef8-4db9-83c8-57b9f8ae6e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:30.081093 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de6c28-8ef8-4db9-83c8-57b9f8ae6e8b None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:30.081434 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de6c28-8ef8-4db9-83c8-57b9f8ae6e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:30.081805 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de6c28-8ef8-4db9-83c8-57b9f8ae6e8b None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:30.082551 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de6c28-8ef8-4db9-83c8-57b9f8ae6e8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:30.083036 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de6c28-8ef8-4db9-83c8-57b9f8ae6e8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:30.084777 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de6c28-8ef8-4db9-83c8-57b9f8ae6e8b None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:30.097894 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 247/500] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:30.099176 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d2218-a3cb-4fc1-b72a-31783e3fe651 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:30.099483 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d2218-a3cb-4fc1-b72a-31783e3fe651 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:30.099770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d2218-a3cb-4fc1-b72a-31783e3fe651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:30.118393 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-9c5d2218-a3cb-4fc1-b72a-31783e3fe651 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:30.120402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-9c5d2218-a3cb-4fc1-b72a-31783e3fe651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:30.152863 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:30.179156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62e593-6bb7-42d9-b246-5f820b03efb0 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:30.200279 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 248/501] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:30.201772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca1499-93d3-4c76-b374-ad60b1a4dfc3 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:30.202065 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca1499-93d3-4c76-b374-ad60b1a4dfc3 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:30.202338 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca1499-93d3-4c76-b374-ad60b1a4dfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:30.217538 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0397a-5d1a-4a46-80d0-5250f4e20c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:30.218152 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0397a-5d1a-4a46-80d0-5250f4e20c41 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:30.218432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0397a-5d1a-4a46-80d0-5250f4e20c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:30.218710 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0397a-5d1a-4a46-80d0-5250f4e20c41 None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:30.219347 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0397a-5d1a-4a46-80d0-5250f4e20c41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:30.219682 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0397a-5d1a-4a46-80d0-5250f4e20c41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:30.221084 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0397a-5d1a-4a46-80d0-5250f4e20c41 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:30.231003 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-99ca1499-93d3-4c76-b374-ad60b1a4dfc3 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:30.232248 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-99ca1499-93d3-4c76-b374-ad60b1a4dfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:30.234018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 254/502] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:30.234692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0397a-5d1a-4a46-80d0-5250f4e20c41 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:30.310974 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:30.324242 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 249/503] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:30.325437 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca1499-93d3-4c76-b374-ad60b1a4dfc3 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:30.383321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0397a-5d1a-4a46-80d0-5250f4e20c41 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:30.453238 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374f9d8-fadb-49ff-b2c0-dce817a1c6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:30.454066 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374f9d8-fadb-49ff-b2c0-dce817a1c6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:30.454471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374f9d8-fadb-49ff-b2c0-dce817a1c6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:30.454842 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374f9d8-fadb-49ff-b2c0-dce817a1c6a1 None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:30.456216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374f9d8-fadb-49ff-b2c0-dce817a1c6a1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:30.456693 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374f9d8-fadb-49ff-b2c0-dce817a1c6a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:30.459019 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374f9d8-fadb-49ff-b2c0-dce817a1c6a1 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:30.462472 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:30.488880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca1499-93d3-4c76-b374-ad60b1a4dfc3 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:30.511389 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 255/504] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Sep 6 20:06:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:30.512224 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374f9d8-fadb-49ff-b2c0-dce817a1c6a1 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:30.533721 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93e98f-75fc-41ef-9ed4-5c0c612ec7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:30.534352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93e98f-75fc-41ef-9ed4-5c0c612ec7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:30.534680 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93e98f-75fc-41ef-9ed4-5c0c612ec7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:30.535562 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93e98f-75fc-41ef-9ed4-5c0c612ec7d2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:30.544385 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93e98f-75fc-41ef-9ed4-5c0c612ec7d2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:30.547164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93e98f-75fc-41ef-9ed4-5c0c612ec7d2 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:30.560468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-ee93e98f-75fc-41ef-9ed4-5c0c612ec7d2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 20:06:30.560468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:30.560468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:30.560468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:30.560468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:30.560468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:30.560468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:30.560468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:30.560468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:30.560468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:30.560468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:30.560468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:30.560468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:06:30.560468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:06:30.560468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:06:30.560468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:06:30.562998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:30.562998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:30.562998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:06:30.562998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:30.562998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:06:30.562998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:30.562998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:30.562998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:30.562998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:30.562998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:30.562998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:30.562998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:30.562998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:30.562998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:30.562998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:30.562998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:30.562998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:30.562998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:30.564504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:30.564504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:30.564504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:06:30.564504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:06:30.564504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:06:30.564504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:06:30.564504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:06:30.564504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:06:30.564504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 20:06:30.564504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:30.564504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 250/505] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:06:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:30.564504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93e98f-75fc-41ef-9ed4-5c0c612ec7d2 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:30.632216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374f9d8-fadb-49ff-b2c0-dce817a1c6a1 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:30.632968 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:30.667406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7afed0-621b-452a-b1e8-9637ce0f99e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:30.667984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7afed0-621b-452a-b1e8-9637ce0f99e6 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:30.668257 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7afed0-621b-452a-b1e8-9637ce0f99e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:30.668525 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7afed0-621b-452a-b1e8-9637ce0f99e6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:30.679207 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7afed0-621b-452a-b1e8-9637ce0f99e6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:30.680799 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93e98f-75fc-41ef-9ed4-5c0c612ec7d2 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:30.681968 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7afed0-621b-452a-b1e8-9637ce0f99e6 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:30.695771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-3d7afed0-621b-452a-b1e8-9637ce0f99e6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 06 20:06:30.695771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:30.695771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:30.695771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:30.695771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:30.695771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:30.695771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:30.695771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:30.695771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:30.695771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:30.695771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:30.695771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:30.695771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:06:30.695771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:06:30.695771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:06:30.695771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:06:30.696803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:30.696803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:30.696803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:06:30.696803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:30.696803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:06:30.696803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:30.696803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:30.696803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:30.696803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:30.696803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:30.696803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:30.696803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:30.696803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:30.696803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:30.696803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:30.696803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:30.696803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:30.696803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:30.698101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:30.698101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:30.698101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:06:30.698101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:06:30.698101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:06:30.698101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:06:30.698101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:06:30.698101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:06:30.698101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 06 20:06:30.698101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:30.698101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 256/506] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:06:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:30.698101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7afed0-621b-452a-b1e8-9637ce0f99e6 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:30.733035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3cb98-fdf6-4fbb-b5ac-c44f8869ac31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:30.734710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3cb98-fdf6-4fbb-b5ac-c44f8869ac31 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:30.735013 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3cb98-fdf6-4fbb-b5ac-c44f8869ac31 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:30.735351 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3cb98-fdf6-4fbb-b5ac-c44f8869ac31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:30.748821 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3cb98-fdf6-4fbb-b5ac-c44f8869ac31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:30.750856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3cb98-fdf6-4fbb-b5ac-c44f8869ac31 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:30.766620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-77c3cb98-fdf6-4fbb-b5ac-c44f8869ac31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:30.766620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:30.766620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:30.766620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:30.766620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:30.766620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:30.766620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:30.766620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:30.766620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:30.766620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:30.766620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:30.766620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:30.766620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:30.766620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:30.766620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:30.766620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:30.767682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:30.767682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:30.767682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:30.767682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:30.767682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:30.767682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:30.767682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:30.767682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:30.767682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:30.767682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:30.767682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:30.767682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:30.767682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:30.767682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:30.767682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:30.767682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:30.767682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:30.769476 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:30.769476 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:30.769476 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:30.769476 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 251/507] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:30.769476 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3cb98-fdf6-4fbb-b5ac-c44f8869ac31 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:30.772265 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:30.825970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7afed0-621b-452a-b1e8-9637ce0f99e6 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:30.863204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947dea61-4505-4d48-b892-695b63cf5eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:30.863844 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dea61-4505-4d48-b892-695b63cf5eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:30.864120 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dea61-4505-4d48-b892-695b63cf5eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:30.864387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dea61-4505-4d48-b892-695b63cf5eb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:30.890568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3cb98-fdf6-4fbb-b5ac-c44f8869ac31 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:30.900031 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:30.927626 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e99f8d-2dd3-4f8f-a670-7c5835ee794e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:30.928152 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e99f8d-2dd3-4f8f-a670-7c5835ee794e None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:30.928436 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e99f8d-2dd3-4f8f-a670-7c5835ee794e None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:30.928709 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e99f8d-2dd3-4f8f-a670-7c5835ee794e None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:30.929456 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e99f8d-2dd3-4f8f-a670-7c5835ee794e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:30.929763 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e99f8d-2dd3-4f8f-a670-7c5835ee794e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:30.931309 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e99f8d-2dd3-4f8f-a670-7c5835ee794e None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:30.939097 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947dea61-4505-4d48-b892-695b63cf5eb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:30.940706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947dea61-4505-4d48-b892-695b63cf5eb1 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:30.975582 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 252/508] 10.222.0.77 () {56 vars in 1137 bytes} [Tue Sep 6 20:06:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:30.975582 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e99f8d-2dd3-4f8f-a670-7c5835ee794e None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:31.004112 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:31.061140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 257/509] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:06:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:06:31.063028 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947dea61-4505-4d48-b892-695b63cf5eb1 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:31.099554 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e99f8d-2dd3-4f8f-a670-7c5835ee794e None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:31.141440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e5a3e-8bd8-4287-9c39-4bcef7909fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:31.142362 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e5a3e-8bd8-4287-9c39-4bcef7909fdb None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:31.142753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e5a3e-8bd8-4287-9c39-4bcef7909fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:31.143152 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e5a3e-8bd8-4287-9c39-4bcef7909fdb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:31.154827 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e5a3e-8bd8-4287-9c39-4bcef7909fdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:31.160391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-961e5a3e-8bd8-4287-9c39-4bcef7909fdb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:31.160391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:31.160391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:31.160391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:31.160391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:31.160391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:31.160391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:31.160391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:31.160391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:31.160391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:31.160391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:31.160391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:31.160391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:31.160391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:31.160391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:31.160391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:31.161356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:31.161356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:31.161356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:31.161356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:31.161356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:31.161356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:31.161356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:31.161356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:31.161356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:31.161356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:31.161356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:31.161356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:31.161356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:31.161356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:31.161356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:31.161356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:31.162153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:31.162153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:31.162153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:31.162153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:31.162153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:31.162153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:31.162153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:31.162153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:31.162153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:31.162153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:31.162153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:31.162153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:31.162153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 253/510] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Sep 6 20:06:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:31.162822 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e5a3e-8bd8-4287-9c39-4bcef7909fdb None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:31.188666 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947dea61-4505-4d48-b892-695b63cf5eb1 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:31.191700 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:31.224001 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bb340-415a-4550-8172-a8fffd2db8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:31.224610 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bb340-415a-4550-8172-a8fffd2db8ad None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:31.224883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bb340-415a-4550-8172-a8fffd2db8ad None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:31.225149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bb340-415a-4550-8172-a8fffd2db8ad None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:31.225876 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bb340-415a-4550-8172-a8fffd2db8ad None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:31.226190 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bb340-415a-4550-8172-a8fffd2db8ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:31.227679 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bb340-415a-4550-8172-a8fffd2db8ad None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:31.245652 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 258/511] 10.222.0.77 () {56 vars in 1137 bytes} [Tue Sep 6 20:06:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:31.247500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bb340-415a-4550-8172-a8fffd2db8ad None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:31.260214 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:31.269741 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e5a3e-8bd8-4287-9c39-4bcef7909fdb None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:31.305625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed0ffa-13ed-4b65-ab0a-c25af2fffec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:31.306225 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed0ffa-13ed-4b65-ab0a-c25af2fffec0 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:31.306500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed0ffa-13ed-4b65-ab0a-c25af2fffec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:31.306767 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed0ffa-13ed-4b65-ab0a-c25af2fffec0 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:31.307403 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed0ffa-13ed-4b65-ab0a-c25af2fffec0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:31.307773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed0ffa-13ed-4b65-ab0a-c25af2fffec0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:31.309122 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed0ffa-13ed-4b65-ab0a-c25af2fffec0 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:31.320969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 254/512] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:31.321806 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed0ffa-13ed-4b65-ab0a-c25af2fffec0 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:31.354496 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bb340-415a-4550-8172-a8fffd2db8ad None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:31.394675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce6968-23ab-4dc5-b531-a7daa7814f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:31.395301 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce6968-23ab-4dc5-b531-a7daa7814f82 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:31.395612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce6968-23ab-4dc5-b531-a7daa7814f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:31.395888 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce6968-23ab-4dc5-b531-a7daa7814f82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:31.422299 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:31.446060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed0ffa-13ed-4b65-ab0a-c25af2fffec0 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:31.473325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce6968-23ab-4dc5-b531-a7daa7814f82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:31.474815 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce6968-23ab-4dc5-b531-a7daa7814f82 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:31.475594 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa9f20-277b-4050-98a0-73b86507faa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:31.476230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa9f20-277b-4050-98a0-73b86507faa2 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:31.476512 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa9f20-277b-4050-98a0-73b86507faa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:31.476785 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa9f20-277b-4050-98a0-73b86507faa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:31.486115 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:31.488028 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa9f20-277b-4050-98a0-73b86507faa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:31.489532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa9f20-277b-4050-98a0-73b86507faa2 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:31.506643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-c4aa9f20-277b-4050-98a0-73b86507faa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:31.506643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:31.506643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:31.506643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:31.506643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:31.506643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:31.506643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:31.506643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:31.506643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:31.506643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:31.506643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:31.506643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:31.506643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:31.506643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:31.506643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:31.506643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:31.507666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:31.507666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:31.507666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:31.507666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:31.507666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:31.507666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:31.507666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:31.507666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:31.507666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:31.507666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:31.507666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:31.507666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:31.507666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:31.507666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:31.507666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:31.507666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:31.507666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:31.508517 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:31.508517 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:31.508517 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:31.508517 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 255/513] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:31.508756 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa9f20-277b-4050-98a0-73b86507faa2 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:31.581961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 259/514] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:06:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:06:31.582816 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce6968-23ab-4dc5-b531-a7daa7814f82 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:31.614999 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa9f20-277b-4050-98a0-73b86507faa2 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:31.650941 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d33c1-1272-4664-9cd6-5927c75d1930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:31.651568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d33c1-1272-4664-9cd6-5927c75d1930 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:31.651847 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d33c1-1272-4664-9cd6-5927c75d1930 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:31.652121 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d33c1-1272-4664-9cd6-5927c75d1930 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:31.652779 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d33c1-1272-4664-9cd6-5927c75d1930 None admin] RBAC: Adding query filter params (name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:31.653082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d33c1-1272-4664-9cd6-5927c75d1930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:31.654454 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d33c1-1272-4664-9cd6-5927c75d1930 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:31.659682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:31.663282 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 256/515] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Sep 6 20:06:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:31.664390 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d33c1-1272-4664-9cd6-5927c75d1930 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:31.699310 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce6968-23ab-4dc5-b531-a7daa7814f82 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:31.711086 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:31.736757 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbe33a-2fe3-46c6-b9f7-ad2dc435489c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:31.737549 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbe33a-2fe3-46c6-b9f7-ad2dc435489c None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:31.737894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbe33a-2fe3-46c6-b9f7-ad2dc435489c None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:31.738171 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbe33a-2fe3-46c6-b9f7-ad2dc435489c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:31.770682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d33c1-1272-4664-9cd6-5927c75d1930 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:31.806840 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67c7eb-ae04-441a-b79b-46c2270a2ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:31.807610 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67c7eb-ae04-441a-b79b-46c2270a2ace None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:31.807959 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67c7eb-ae04-441a-b79b-46c2270a2ace None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:31.808387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67c7eb-ae04-441a-b79b-46c2270a2ace None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:31.809126 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67c7eb-ae04-441a-b79b-46c2270a2ace None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:31.810557 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67c7eb-ae04-441a-b79b-46c2270a2ace None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:31.823607 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbe33a-2fe3-46c6-b9f7-ad2dc435489c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:31.825163 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbe33a-2fe3-46c6-b9f7-ad2dc435489c None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:31.903416 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 257/516] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Sep 6 20:06:31 2022] POST /identity/v3/users => generated 247 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:06:31.904374 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67c7eb-ae04-441a-b79b-46c2270a2ace None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:31.933808 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 260/517] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:06:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:06:31.933808 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbe33a-2fe3-46c6-b9f7-ad2dc435489c None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:31.952064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:31.991359 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:32.049415 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67c7eb-ae04-441a-b79b-46c2270a2ace None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:32.066775 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbe33a-2fe3-46c6-b9f7-ad2dc435489c None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:32.096615 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10222429-e81f-42e5-abd8-750d50abf382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:32.097236 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10222429-e81f-42e5-abd8-750d50abf382 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:32.097516 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10222429-e81f-42e5-abd8-750d50abf382 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:32.097790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10222429-e81f-42e5-abd8-750d50abf382 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:32.098425 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10222429-e81f-42e5-abd8-750d50abf382 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:32.098730 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10222429-e81f-42e5-abd8-750d50abf382 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:32.100148 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10222429-e81f-42e5-abd8-750d50abf382 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:32.114602 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 258/518] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:32.114789 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bc99d-dbf5-4854-9ff5-821a5aa64523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:32.115159 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10222429-e81f-42e5-abd8-750d50abf382 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:32.115431 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bc99d-dbf5-4854-9ff5-821a5aa64523 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:32.115728 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bc99d-dbf5-4854-9ff5-821a5aa64523 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:32.116001 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bc99d-dbf5-4854-9ff5-821a5aa64523 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:32.131845 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bc99d-dbf5-4854-9ff5-821a5aa64523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:32.133333 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bc99d-dbf5-4854-9ff5-821a5aa64523 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:32.153645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-f62bc99d-dbf5-4854-9ff5-821a5aa64523 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:32.153645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:32.153645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:32.153645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:32.153645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:32.153645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:32.153645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:32.153645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:32.153645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:32.153645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:32.153645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:32.153645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:32.153645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:32.153645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:32.153645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:32.153645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:32.154637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:32.154637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:32.154637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:32.154637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:32.154637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:32.154637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:32.154637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:32.154637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:32.154637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:32.154637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:32.154637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:32.154637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:32.154637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:32.154637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:32.154637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:32.154637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:32.154637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:32.156045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:32.156045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:32.156045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:32.156045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 261/519] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:32.157536 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bc99d-dbf5-4854-9ff5-821a5aa64523 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:32.224488 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:32.241192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10222429-e81f-42e5-abd8-750d50abf382 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:32.260437 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:32.267527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bc99d-dbf5-4854-9ff5-821a5aa64523 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:32.283308 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be32514-76d0-42e3-9189-c573f9cd0329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:32.283989 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be32514-76d0-42e3-9189-c573f9cd0329 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:32.284271 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be32514-76d0-42e3-9189-c573f9cd0329 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:32.284545 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be32514-76d0-42e3-9189-c573f9cd0329 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:32.295874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be32514-76d0-42e3-9189-c573f9cd0329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:32.297585 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be32514-76d0-42e3-9189-c573f9cd0329 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:32.307166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ef612-68da-4172-84d8-fcff8f2e67ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:32.307836 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ef612-68da-4172-84d8-fcff8f2e67ac None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:32.308111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ef612-68da-4172-84d8-fcff8f2e67ac None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:32.308380 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ef612-68da-4172-84d8-fcff8f2e67ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:32.317783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-1be32514-76d0-42e3-9189-c573f9cd0329 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:32.317783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:32.317783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:32.317783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:32.317783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:32.317783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:32.317783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:32.317783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:32.317783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:32.317783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:32.317783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:32.317783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:32.317783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:32.317783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:32.317783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:32.317783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:32.318887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:32.318887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:32.318887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:32.318887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:32.318887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:32.318887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:32.318887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:32.318887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:32.318887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:32.318887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:32.318887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:32.318887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:32.318887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:32.318887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:32.318887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:32.318887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:32.318887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:32.320206 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:32.320206 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:32.320206 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:32.320206 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 259/520] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:32.320758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be32514-76d0-42e3-9189-c573f9cd0329 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:32.324288 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ef612-68da-4172-84d8-fcff8f2e67ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:32.325762 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ef612-68da-4172-84d8-fcff8f2e67ac None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:32.345065 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-af0ef612-68da-4172-84d8-fcff8f2e67ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:32.345065 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:32.345065 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:32.345065 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:32.345065 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:32.345065 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:32.345065 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:32.345065 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:32.345065 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:32.345065 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:32.345065 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:32.345065 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:32.345065 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:32.345065 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:32.345065 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:32.345065 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:32.346141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:32.346141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:32.346141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:32.346141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:32.346141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:32.346141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:32.346141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:32.346141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:32.346141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:32.346141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:32.346141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:32.346141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:32.346141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:32.346141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:32.346141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:32.346141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:32.346141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:32.346954 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:32.346954 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:32.346954 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:32.346954 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 262/521] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:32.347910 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ef612-68da-4172-84d8-fcff8f2e67ac None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:32.442628 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be32514-76d0-42e3-9189-c573f9cd0329 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:32.471794 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ef612-68da-4172-84d8-fcff8f2e67ac None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:32.483173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37097c10-1783-4a58-8085-0a7be11c5340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:32.483769 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37097c10-1783-4a58-8085-0a7be11c5340 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:32.484048 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37097c10-1783-4a58-8085-0a7be11c5340 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:32.484319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37097c10-1783-4a58-8085-0a7be11c5340 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:32.488427 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:32.491953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37097c10-1783-4a58-8085-0a7be11c5340 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:32.493400 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37097c10-1783-4a58-8085-0a7be11c5340 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:32.507226 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-37097c10-1783-4a58-8085-0a7be11c5340 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:32.507226 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:32.507226 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:32.507226 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:32.507226 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:32.507226 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:32.507226 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:32.507226 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:32.507226 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:32.507226 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:32.507226 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:32.507226 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:32.507226 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:06:32.507226 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:06:32.507226 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:06:32.508460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:06:32.508460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:32.508460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:32.508460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:32.508460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:32.508460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:32.508460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:32.508460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:32.508460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:32.508460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:32.508460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:32.508460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:32.508460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:32.508460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:32.508460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:32.508460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:32.508460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:32.509345 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:06:32.509345 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:06:32.509345 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:06:32.509345 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:06:32.509345 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:06:32.509345 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:06:32.509345 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:32.509345 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:32.509345 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 260/522] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:06:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:32.509345 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37097c10-1783-4a58-8085-0a7be11c5340 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:32.516842 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f61e8e-f9a0-45ff-999b-f16afd14e739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:32.517689 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f61e8e-f9a0-45ff-999b-f16afd14e739 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:32.517966 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f61e8e-f9a0-45ff-999b-f16afd14e739 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:32.518240 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f61e8e-f9a0-45ff-999b-f16afd14e739 None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:32.518905 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f61e8e-f9a0-45ff-999b-f16afd14e739 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:32.519218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f61e8e-f9a0-45ff-999b-f16afd14e739 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:32.521307 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f61e8e-f9a0-45ff-999b-f16afd14e739 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:32.538850 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 263/523] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:32.538850 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f61e8e-f9a0-45ff-999b-f16afd14e739 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:32.554447 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:32.635078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37097c10-1783-4a58-8085-0a7be11c5340 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:32.644456 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f61e8e-f9a0-45ff-999b-f16afd14e739 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:32.672719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84c493-8d72-4363-bea8-d8c87a26bd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:32.673568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84c493-8d72-4363-bea8-d8c87a26bd7a None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:32.673840 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84c493-8d72-4363-bea8-d8c87a26bd7a None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:32.674117 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84c493-8d72-4363-bea8-d8c87a26bd7a None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:32.674758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84c493-8d72-4363-bea8-d8c87a26bd7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:32.675063 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84c493-8d72-4363-bea8-d8c87a26bd7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:32.676644 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84c493-8d72-4363-bea8-d8c87a26bd7a None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:32.681661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acc621-475d-4c22-aae1-5aa83d6fd2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:32.682268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acc621-475d-4c22-aae1-5aa83d6fd2f4 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:32.682556 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acc621-475d-4c22-aae1-5aa83d6fd2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:32.682804 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acc621-475d-4c22-aae1-5aa83d6fd2f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:32.683462 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68acc621-475d-4c22-aae1-5aa83d6fd2f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:32.683760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68acc621-475d-4c22-aae1-5aa83d6fd2f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:32.685119 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68acc621-475d-4c22-aae1-5aa83d6fd2f4 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:32.689847 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 261/524] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:32.690938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84c493-8d72-4363-bea8-d8c87a26bd7a None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:32.700731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 264/525] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:32.701587 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acc621-475d-4c22-aae1-5aa83d6fd2f4 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:32.744074 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:32.800262 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:32.816378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acc621-475d-4c22-aae1-5aa83d6fd2f4 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:32.816668 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84c493-8d72-4363-bea8-d8c87a26bd7a None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:32.855780 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5393ec5-613d-4f40-9ad4-b92911469ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:32.856304 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e860796-3737-4347-83db-70d38c4d0004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:32.856490 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5393ec5-613d-4f40-9ad4-b92911469ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:32.856766 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5393ec5-613d-4f40-9ad4-b92911469ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:32.856927 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e860796-3737-4347-83db-70d38c4d0004 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:32.857104 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5393ec5-613d-4f40-9ad4-b92911469ff3 None admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:32.857205 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e860796-3737-4347-83db-70d38c4d0004 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:32.857445 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e860796-3737-4347-83db-70d38c4d0004 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:32.857816 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5393ec5-613d-4f40-9ad4-b92911469ff3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:32.858127 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5393ec5-613d-4f40-9ad4-b92911469ff3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:32.860230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5393ec5-613d-4f40-9ad4-b92911469ff3 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:32.866727 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e860796-3737-4347-83db-70d38c4d0004 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:32.868266 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e860796-3737-4347-83db-70d38c4d0004 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:32.885402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 262/526] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:06:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:32.885402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5393ec5-613d-4f40-9ad4-b92911469ff3 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:32.885672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-6e860796-3737-4347-83db-70d38c4d0004 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:32.885672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:32.885672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:32.885672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:32.885672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:32.885672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:32.885672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:32.885672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:32.885672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:32.885672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:32.885672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:32.885672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:32.885672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:06:32.885672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:06:32.885672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:06:32.886452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:06:32.886452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:32.886452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:32.886452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:32.886452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:32.886452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:32.886452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:32.886452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:32.886452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:32.886452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:32.886452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:32.886452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:32.886452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:32.886452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:32.886452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:32.886452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:32.886452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:32.887282 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:06:32.887282 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:06:32.887282 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:06:32.887282 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:06:32.887282 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:06:32.887282 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:06:32.887282 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:32.887282 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:32.887282 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 265/527] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:06:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:32.887282 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e860796-3737-4347-83db-70d38c4d0004 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:33.000259 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:33.004438 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5393ec5-613d-4f40-9ad4-b92911469ff3 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:33.007631 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e860796-3737-4347-83db-70d38c4d0004 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:33.042754 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80581a99-6fb4-4204-b33e-d2b9e8736d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:33.043338 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572a71b-f3fd-49d2-8914-8a147777ce0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:33.043483 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80581a99-6fb4-4204-b33e-d2b9e8736d87 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:33.043707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80581a99-6fb4-4204-b33e-d2b9e8736d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:33.043979 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80581a99-6fb4-4204-b33e-d2b9e8736d87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:33.044103 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572a71b-f3fd-49d2-8914-8a147777ce0e None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:33.044259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572a71b-f3fd-49d2-8914-8a147777ce0e None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:33.044534 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572a71b-f3fd-49d2-8914-8a147777ce0e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:33.051751 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80581a99-6fb4-4204-b33e-d2b9e8736d87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:33.052830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572a71b-f3fd-49d2-8914-8a147777ce0e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:33.053318 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80581a99-6fb4-4204-b33e-d2b9e8736d87 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:33.054281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572a71b-f3fd-49d2-8914-8a147777ce0e None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:33.065874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-80581a99-6fb4-4204-b33e-d2b9e8736d87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:33.065874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:33.065874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:33.065874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:33.065874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:33.065874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:33.065874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:33.065874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:33.065874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:33.065874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:33.065874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:33.065874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:33.065874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:06:33.065874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:06:33.065874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:06:33.066724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:06:33.066724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:33.066724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:33.066724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:33.066724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:33.066724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:33.066724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:33.066724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:33.066724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:33.066724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:33.066724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:33.066724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:33.066724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:33.066724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:33.066724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:33.066724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:33.066724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:33.068551 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:06:33.068551 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:06:33.068551 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:06:33.068551 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:06:33.068551 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:06:33.068551 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:06:33.068551 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:33.068551 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:33.068951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-5572a71b-f3fd-49d2-8914-8a147777ce0e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 20:06:33.068951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:33.068951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:33.068951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:33.068951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:33.068951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:33.068951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:33.068951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:33.068951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:33.068951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:33.068951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:33.068951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:33.068951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:06:33.068951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:06:33.068951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:06:33.068951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:06:33.069830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:33.069830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:33.069830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:06:33.069830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:33.069830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:06:33.069830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:33.069830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:33.069830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:33.069830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:33.069830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:33.069830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:33.069830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:33.069830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:33.069830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:33.069830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:33.069830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:33.069830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:33.069830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:33.070732 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:33.070732 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:33.070732 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:06:33.070732 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:06:33.070732 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:06:33.070732 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:06:33.070732 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:06:33.070732 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:06:33.070732 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 20:06:33.070732 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:33.071233 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 266/528] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:06:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:33.071233 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80581a99-6fb4-4204-b33e-d2b9e8736d87 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:33.072522 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 263/529] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Sep 6 20:06:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:33.077502 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572a71b-f3fd-49d2-8914-8a147777ce0e None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:33.089969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:33.183732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80581a99-6fb4-4204-b33e-d2b9e8736d87 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:33.190811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572a71b-f3fd-49d2-8914-8a147777ce0e None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:33.227359 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a31327-43da-4a86-8df1-e97edac7ba62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:33.227615 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ac08c-3d0b-44a2-94d4-6c541b2e0cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:33.228004 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ac08c-3d0b-44a2-94d4-6c541b2e0cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:33.228282 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ac08c-3d0b-44a2-94d4-6c541b2e0cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:33.228407 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a31327-43da-4a86-8df1-e97edac7ba62 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:33.228554 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ac08c-3d0b-44a2-94d4-6c541b2e0cc8 None admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:33.228851 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a31327-43da-4a86-8df1-e97edac7ba62 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:33.229239 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a31327-43da-4a86-8df1-e97edac7ba62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:33.229333 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ac08c-3d0b-44a2-94d4-6c541b2e0cc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:33.229546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ac08c-3d0b-44a2-94d4-6c541b2e0cc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:33.230226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a31327-43da-4a86-8df1-e97edac7ba62 None admin] RBAC: Adding query filter params (role.id=140b49dfcc2b489ca0504d2e7abfdbdb, scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343, user.id=b09ce16da49b4af38491ad4eb6287d70) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:33.230631 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a31327-43da-4a86-8df1-e97edac7ba62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:33.230989 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ac08c-3d0b-44a2-94d4-6c541b2e0cc8 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:33.232275 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a31327-43da-4a86-8df1-e97edac7ba62 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:33.238524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 267/530] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:06:33 2022] GET /identity/v3/role_assignments?user.id=b09ce16da49b4af38491ad4eb6287d70&scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343&role.id=140b49dfcc2b489ca0504d2e7abfdbdb => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:33.244465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a31327-43da-4a86-8df1-e97edac7ba62 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:33.254010 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 264/531] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:06:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:33.254010 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ac08c-3d0b-44a2-94d4-6c541b2e0cc8 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:33.276093 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:33.342596 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:33.385272 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ac08c-3d0b-44a2-94d4-6c541b2e0cc8 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:33.404374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a31327-43da-4a86-8df1-e97edac7ba62 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:33.434422 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e477640-6766-42b6-a587-82513b285358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:33.435208 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e477640-6766-42b6-a587-82513b285358 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:33.435626 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e477640-6766-42b6-a587-82513b285358 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:33.435977 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e477640-6766-42b6-a587-82513b285358 None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:33.437587 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e477640-6766-42b6-a587-82513b285358 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:33.437892 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e477640-6766-42b6-a587-82513b285358 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:33.439478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e477640-6766-42b6-a587-82513b285358 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:33.454888 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390191cc-e51a-49da-8315-da2bda011511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:33.455981 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390191cc-e51a-49da-8315-da2bda011511 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:33.456270 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390191cc-e51a-49da-8315-da2bda011511 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:33.456546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390191cc-e51a-49da-8315-da2bda011511 None admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:33.457395 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390191cc-e51a-49da-8315-da2bda011511 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:33.458811 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390191cc-e51a-49da-8315-da2bda011511 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:33.460522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390191cc-e51a-49da-8315-da2bda011511 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:33.468778 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 265/532] 10.222.0.77 () {56 vars in 1139 bytes} [Tue Sep 6 20:06:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:33.470721 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e477640-6766-42b6-a587-82513b285358 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:33.481249 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 268/533] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:06:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:33.482089 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390191cc-e51a-49da-8315-da2bda011511 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:33.568353 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:33.599470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390191cc-e51a-49da-8315-da2bda011511 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:33.611291 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e477640-6766-42b6-a587-82513b285358 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:33.638064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4e32e-6ee4-40aa-a171-3527b715b691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:33.639190 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4e32e-6ee4-40aa-a171-3527b715b691 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:33.639696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4e32e-6ee4-40aa-a171-3527b715b691 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:33.640170 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4e32e-6ee4-40aa-a171-3527b715b691 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:33.641687 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:33.650796 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393df80-4531-4ae1-9872-86d23ddbdba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:33.651545 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393df80-4531-4ae1-9872-86d23ddbdba9 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:33.652754 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393df80-4531-4ae1-9872-86d23ddbdba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:33.652754 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393df80-4531-4ae1-9872-86d23ddbdba9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:33.652935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393df80-4531-4ae1-9872-86d23ddbdba9 None admin] RBAC: Adding query filter params (role.id=140b49dfcc2b489ca0504d2e7abfdbdb, scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343, user.id=c6d2bb1c23484010bcc9238f9a9203a4) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:33.653150 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393df80-4531-4ae1-9872-86d23ddbdba9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:33.654692 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393df80-4531-4ae1-9872-86d23ddbdba9 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:33.661634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 266/534] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:06:33 2022] GET /identity/v3/role_assignments?user.id=c6d2bb1c23484010bcc9238f9a9203a4&scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343&role.id=140b49dfcc2b489ca0504d2e7abfdbdb => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:33.662644 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393df80-4531-4ae1-9872-86d23ddbdba9 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:33.723701 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4e32e-6ee4-40aa-a171-3527b715b691 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:33.725429 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4e32e-6ee4-40aa-a171-3527b715b691 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:33.783186 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393df80-4531-4ae1-9872-86d23ddbdba9 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:33.817798 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:33.823352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f9c64-78cd-4f01-a3e0-bafd24602a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:33.824096 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f9c64-78cd-4f01-a3e0-bafd24602a04 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:33.824454 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f9c64-78cd-4f01-a3e0-bafd24602a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:33.824812 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f9c64-78cd-4f01-a3e0-bafd24602a04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:33.825612 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f9c64-78cd-4f01-a3e0-bafd24602a04 None admin] RBAC: Adding query filter params (role.id=140b49dfcc2b489ca0504d2e7abfdbdb, scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343, user.id=871f208a13ba435491022b9ea9b735e6) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:33.825990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f9c64-78cd-4f01-a3e0-bafd24602a04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:33.828281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f9c64-78cd-4f01-a3e0-bafd24602a04 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:33.835072 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 267/535] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:06:33 2022] GET /identity/v3/role_assignments?user.id=871f208a13ba435491022b9ea9b735e6&scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343&role.id=140b49dfcc2b489ca0504d2e7abfdbdb => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:33.847222 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 269/536] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:06:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:06:33.856085 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f9c64-78cd-4f01-a3e0-bafd24602a04 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:33.922927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:33.998419 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f9c64-78cd-4f01-a3e0-bafd24602a04 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:34.047801 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15592d-8ec6-4133-b209-c28882217f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:34.048517 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15592d-8ec6-4133-b209-c28882217f69 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:34.048813 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15592d-8ec6-4133-b209-c28882217f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:34.049118 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15592d-8ec6-4133-b209-c28882217f69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:34.064389 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15592d-8ec6-4133-b209-c28882217f69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:34.065981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15592d-8ec6-4133-b209-c28882217f69 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:34.085467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-6e15592d-8ec6-4133-b209-c28882217f69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:34.085467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:34.085467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:34.085467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:34.085467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:34.085467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:34.085467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:34.085467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:34.085467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:34.085467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:34.085467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:34.085467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:34.085467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:34.085467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:34.085467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:34.085467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:34.086372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:34.086372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:34.086372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:34.086372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:34.086372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:34.086372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:34.086372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:34.086372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:34.086372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:34.086372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:34.086372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:34.086372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:34.086372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:34.086372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:34.086372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:34.086372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:34.086372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:34.087193 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:34.087193 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:34.087193 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:34.087193 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 268/537] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:34.092552 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4e32e-6ee4-40aa-a171-3527b715b691 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:34.239738 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4e32e-6ee4-40aa-a171-3527b715b691 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:34.278034 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbc87a-d7de-4c8b-b706-455038ba5066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:34.278751 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbc87a-d7de-4c8b-b706-455038ba5066 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:34.279032 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbc87a-d7de-4c8b-b706-455038ba5066 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:34.279301 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbc87a-d7de-4c8b-b706-455038ba5066 None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:34.279974 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbc87a-d7de-4c8b-b706-455038ba5066 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:34.280277 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbc87a-d7de-4c8b-b706-455038ba5066 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:34.282246 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbc87a-d7de-4c8b-b706-455038ba5066 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:34.296380 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 270/538] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:06:34.302474 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15592d-8ec6-4133-b209-c28882217f69 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:34.414599 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec7b80-0068-4aa8-bc1c-2174c9253a9e None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:34.414790 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec7b80-0068-4aa8-bc1c-2174c9253a9e None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:34.415056 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec7b80-0068-4aa8-bc1c-2174c9253a9e None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:34.416979 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 271/539] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:34.422550 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af3965-54c2-4163-995b-58a703f9cdda None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:34.422830 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af3965-54c2-4163-995b-58a703f9cdda None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:34.423104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af3965-54c2-4163-995b-58a703f9cdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:34.462879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15592d-8ec6-4133-b209-c28882217f69 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:34.470744 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-c7af3965-54c2-4163-995b-58a703f9cdda None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:34.471989 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c7af3965-54c2-4163-995b-58a703f9cdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:34.475137 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:34.529217 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a532b-495f-446e-819a-d29f77f8f42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:34.529865 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a532b-495f-446e-819a-d29f77f8f42b None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:34.530140 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a532b-495f-446e-819a-d29f77f8f42b None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:34.530409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a532b-495f-446e-819a-d29f77f8f42b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:34.535783 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:34.542989 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a532b-495f-446e-819a-d29f77f8f42b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:34.544459 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a532b-495f-446e-819a-d29f77f8f42b None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:34.556279 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-ad1a532b-495f-446e-819a-d29f77f8f42b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:34.556279 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:34.556279 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:34.556279 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:34.556279 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:34.556279 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:34.556279 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:34.556279 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:34.556279 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:34.556279 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:34.556279 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:34.556279 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:34.556279 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:06:34.556279 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:06:34.556279 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:06:34.557168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:06:34.557168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:34.557168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:34.557168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:34.557168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:34.557168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:34.557168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:34.557168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:34.557168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:34.557168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:34.557168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:34.557168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:34.557168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:34.557168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:34.557168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:34.557168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:34.557168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:34.558281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:06:34.558281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:06:34.558281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:06:34.558281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:06:34.558281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:06:34.558281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:06:34.558281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:34.558281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:34.558281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 269/540] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:06:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:34.565773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a532b-495f-446e-819a-d29f77f8f42b None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:34.596859 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 272/541] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 20:06:34.717670 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a532b-495f-446e-819a-d29f77f8f42b None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:34.766839 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1b261-0aa1-4ce9-b3f8-e9800a1903ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:34.767848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1b261-0aa1-4ce9-b3f8-e9800a1903ff None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:34.768329 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1b261-0aa1-4ce9-b3f8-e9800a1903ff None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:34.768794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1b261-0aa1-4ce9-b3f8-e9800a1903ff None admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:34.769746 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1b261-0aa1-4ce9-b3f8-e9800a1903ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:34.770274 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1b261-0aa1-4ce9-b3f8-e9800a1903ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:34.772032 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1b261-0aa1-4ce9-b3f8-e9800a1903ff None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:34.791097 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 270/542] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:06:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:34.797671 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af3965-54c2-4163-995b-58a703f9cdda None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:34.937879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1b261-0aa1-4ce9-b3f8-e9800a1903ff None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:34.944493 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af3965-54c2-4163-995b-58a703f9cdda None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:35.001897 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:35.017065 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af5688-ccf9-42e2-8672-a6869b0d1e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:35.019211 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af5688-ccf9-42e2-8672-a6869b0d1e83 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:35.019211 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af5688-ccf9-42e2-8672-a6869b0d1e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:35.019211 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af5688-ccf9-42e2-8672-a6869b0d1e83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:35.019811 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af5688-ccf9-42e2-8672-a6869b0d1e83 None admin] RBAC: Adding query filter params (role.id=140b49dfcc2b489ca0504d2e7abfdbdb, scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343, user.id=5a876d70d9634bf59af5f138e856f75f) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:35.020338 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af5688-ccf9-42e2-8672-a6869b0d1e83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:35.022063 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af5688-ccf9-42e2-8672-a6869b0d1e83 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:35.034426 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 273/543] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:06:34 2022] GET /identity/v3/role_assignments?user.id=5a876d70d9634bf59af5f138e856f75f&scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343&role.id=140b49dfcc2b489ca0504d2e7abfdbdb => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:35.088700 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1b261-0aa1-4ce9-b3f8-e9800a1903ff None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:35.148644 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a477024-a668-4726-a870-662fd9d4e3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:35.149350 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a477024-a668-4726-a870-662fd9d4e3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:35.149629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a477024-a668-4726-a870-662fd9d4e3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:35.149904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a477024-a668-4726-a870-662fd9d4e3d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:35.168361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a477024-a668-4726-a870-662fd9d4e3d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:35.174204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-5a477024-a668-4726-a870-662fd9d4e3d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:35.174204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:35.174204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:35.174204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:35.174204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:35.174204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:35.174204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:35.174204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:35.174204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:35.174204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:35.174204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:35.174204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:35.174204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:35.174204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:35.174204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:35.174204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:35.175969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:35.175969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:35.175969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:35.175969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:35.175969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:35.175969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:35.175969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:35.175969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:35.175969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:35.175969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:35.175969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:35.175969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:35.175969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:35.175969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:35.175969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:35.175969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:35.178182 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:35.178182 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:35.178182 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:35.178182 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:35.178182 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:35.178182 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:35.178182 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:35.178182 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:35.178182 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:35.178182 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:35.178182 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:35.178182 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:35.178182 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 271/544] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Sep 6 20:06:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:06:35.184000 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af5688-ccf9-42e2-8672-a6869b0d1e83 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:35.244122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:35.331749 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af5688-ccf9-42e2-8672-a6869b0d1e83 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:35.371976 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586c49b-5936-412a-a2db-90d9794e0fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:35.372856 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586c49b-5936-412a-a2db-90d9794e0fed None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:35.373285 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586c49b-5936-412a-a2db-90d9794e0fed None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:35.373718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586c49b-5936-412a-a2db-90d9794e0fed None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:35.374581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586c49b-5936-412a-a2db-90d9794e0fed None admin] RBAC: Adding query filter params (name=service) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:35.375037 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586c49b-5936-412a-a2db-90d9794e0fed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:35.376640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586c49b-5936-412a-a2db-90d9794e0fed None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:35.388552 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 274/545] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Sep 6 20:06:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:35.394412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a477024-a668-4726-a870-662fd9d4e3d3 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:35.534753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:35.554284 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a477024-a668-4726-a870-662fd9d4e3d3 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:35.607050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89b564-88f9-40b0-907c-6687aa442127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:35.607667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89b564-88f9-40b0-907c-6687aa442127 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:35.607948 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89b564-88f9-40b0-907c-6687aa442127 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:35.608222 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89b564-88f9-40b0-907c-6687aa442127 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:35.624243 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89b564-88f9-40b0-907c-6687aa442127 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:35.625722 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89b564-88f9-40b0-907c-6687aa442127 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:35.647639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-0e89b564-88f9-40b0-907c-6687aa442127 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:35.647639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:35.647639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:35.647639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:35.647639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:35.647639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:35.647639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:35.647639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:35.647639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:35.647639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:35.647639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:35.647639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:35.647639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:35.647639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:35.647639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:35.647639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:35.648740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:35.648740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:35.648740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:35.648740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:35.648740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:35.648740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:35.648740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:35.648740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:35.648740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:35.648740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:35.648740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:35.648740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:35.648740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:35.648740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:35.648740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:35.648740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:35.648740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:35.650102 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:35.650102 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:35.650102 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:35.650102 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 272/546] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:35.656928 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586c49b-5936-412a-a2db-90d9794e0fed None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:35.917952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:35.949810 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586c49b-5936-412a-a2db-90d9794e0fed None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:36.062039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc66355-7e5a-44d4-9df9-dbe735a29313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:36.062708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc66355-7e5a-44d4-9df9-dbe735a29313 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:36.062984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc66355-7e5a-44d4-9df9-dbe735a29313 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:36.063267 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc66355-7e5a-44d4-9df9-dbe735a29313 None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:36.063950 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc66355-7e5a-44d4-9df9-dbe735a29313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:36.064252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc66355-7e5a-44d4-9df9-dbe735a29313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:36.065809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc66355-7e5a-44d4-9df9-dbe735a29313 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:36.101879 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 275/547] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:36.107116 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89b564-88f9-40b0-907c-6687aa442127 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:36.157687 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac322e28-4576-4920-9e84-1bf76baac3af None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:36.158026 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac322e28-4576-4920-9e84-1bf76baac3af None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:36.158244 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac322e28-4576-4920-9e84-1bf76baac3af None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:36.163527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 276/548] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:06:36.165129 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078ca83-391d-4f75-927e-13b97520bafb None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:36.165419 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078ca83-391d-4f75-927e-13b97520bafb None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:36.165691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078ca83-391d-4f75-927e-13b97520bafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:36.185506 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-a078ca83-391d-4f75-927e-13b97520bafb None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:36.186644 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-a078ca83-391d-4f75-927e-13b97520bafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:36.339476 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89b564-88f9-40b0-907c-6687aa442127 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:36.410058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50236d1-ca57-4002-b95f-2201ed36bd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:36.412632 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50236d1-ca57-4002-b95f-2201ed36bd4b None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:36.412632 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50236d1-ca57-4002-b95f-2201ed36bd4b None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:36.412632 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50236d1-ca57-4002-b95f-2201ed36bd4b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:36.412898 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 277/549] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 20:06:36.420781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50236d1-ca57-4002-b95f-2201ed36bd4b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:36.422929 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50236d1-ca57-4002-b95f-2201ed36bd4b None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:36.436272 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-b50236d1-ca57-4002-b95f-2201ed36bd4b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 20:06:36.436272 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:36.436272 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:36.436272 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:36.436272 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:36.436272 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:36.436272 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:36.436272 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:36.436272 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:36.436272 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:36.436272 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:36.436272 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:36.436272 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:06:36.436272 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:06:36.436272 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:06:36.436272 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:06:36.437841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:36.437841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:36.437841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:06:36.437841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:36.437841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:06:36.437841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:36.437841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:36.437841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:36.437841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:36.437841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:36.437841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:36.437841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:36.437841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:36.437841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:36.437841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:36.437841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:36.437841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:36.437841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:36.438843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:36.438843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:36.438843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:06:36.438843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:06:36.438843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:06:36.438843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:06:36.438843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:06:36.438843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:06:36.438843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 20:06:36.438843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:36.438843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:36.446272 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 273/550] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:06:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:36.446469 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078ca83-391d-4f75-927e-13b97520bafb None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:36.542839 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f67cb-016a-401b-a2e2-072440c38cfe None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:36.543494 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f67cb-016a-401b-a2e2-072440c38cfe None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:36.544068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f67cb-016a-401b-a2e2-072440c38cfe None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:36.545856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 274/551] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:06:36.552745 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f004c-7f90-470f-8cdd-e365a29ee9dd None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:36.553335 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f004c-7f90-470f-8cdd-e365a29ee9dd None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:36.553815 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f004c-7f90-470f-8cdd-e365a29ee9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:36.584899 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:36.613631 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-6d5f004c-7f90-470f-8cdd-e365a29ee9dd None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:36.615226 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-6d5f004c-7f90-470f-8cdd-e365a29ee9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:36.627279 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078ca83-391d-4f75-927e-13b97520bafb None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:36.678861 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36396e72-5225-4617-bccb-9653a04b43a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:36.679503 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36396e72-5225-4617-bccb-9653a04b43a8 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:36.679782 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36396e72-5225-4617-bccb-9653a04b43a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:36.680049 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36396e72-5225-4617-bccb-9653a04b43a8 None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:36.680779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36396e72-5225-4617-bccb-9653a04b43a8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:36.681077 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36396e72-5225-4617-bccb-9653a04b43a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:36.682500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36396e72-5225-4617-bccb-9653a04b43a8 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:36.726634 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 278/552] 10.222.0.77 () {56 vars in 1135 bytes} [Tue Sep 6 20:06:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:36.727885 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f7dbf-e0f0-487d-897e-0168dc7eb1e9 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:36.728171 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f7dbf-e0f0-487d-897e-0168dc7eb1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:36.728444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f7dbf-e0f0-487d-897e-0168dc7eb1e9 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:36.729961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 279/553] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:36.736118 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8f8e2-3feb-4725-9b12-c72107c76558 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:36.736118 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8f8e2-3feb-4725-9b12-c72107c76558 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:36.736372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8f8e2-3feb-4725-9b12-c72107c76558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:36.750578 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 275/554] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:36.758017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-8fb8f8e2-3feb-4725-9b12-c72107c76558 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:36.759232 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-8fb8f8e2-3feb-4725-9b12-c72107c76558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:36.760318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f004c-7f90-470f-8cdd-e365a29ee9dd None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:36.851549 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 280/555] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:36.852508 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8f8e2-3feb-4725-9b12-c72107c76558 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:36.869658 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f004c-7f90-470f-8cdd-e365a29ee9dd None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:36.898761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:36.907872 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31986b-f953-4572-823d-17b4dfa9b97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:36.914588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31986b-f953-4572-823d-17b4dfa9b97b None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:36.914588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31986b-f953-4572-823d-17b4dfa9b97b None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:36.914588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31986b-f953-4572-823d-17b4dfa9b97b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:37.020978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31986b-f953-4572-823d-17b4dfa9b97b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:37.022702 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31986b-f953-4572-823d-17b4dfa9b97b None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:37.038038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:37.103334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8f8e2-3feb-4725-9b12-c72107c76558 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:37.134966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 276/556] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:06:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:06:37.140454 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18079259-56dd-42c2-8834-e4bbcd0ceb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:37.141364 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18079259-56dd-42c2-8834-e4bbcd0ceb39 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:37.141489 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31986b-f953-4572-823d-17b4dfa9b97b None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:37.141892 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18079259-56dd-42c2-8834-e4bbcd0ceb39 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:37.142310 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18079259-56dd-42c2-8834-e4bbcd0ceb39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:37.154084 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18079259-56dd-42c2-8834-e4bbcd0ceb39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:37.159611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-18079259-56dd-42c2-8834-e4bbcd0ceb39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:37.159611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:37.159611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:37.159611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:37.159611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:37.159611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:37.159611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:37.159611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:37.159611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:37.159611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:37.159611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:37.159611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:37.159611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:37.159611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:37.159611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:37.159611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:37.160518 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:37.160518 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:37.160518 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:37.160518 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:37.160518 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:37.160518 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:37.160518 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:37.160518 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:37.160518 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:37.160518 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:37.160518 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:37.160518 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:37.160518 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:37.160518 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:37.160518 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:37.160518 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:37.161952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:37.161952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:37.161952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:37.161952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:37.161952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:37.161952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:37.161952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:37.161952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:37.161952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:37.161952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:37.161952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:37.161952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:37.161952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 281/557] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Sep 6 20:06:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:37.161952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18079259-56dd-42c2-8834-e4bbcd0ceb39 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:37.179008 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:37.260173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31986b-f953-4572-823d-17b4dfa9b97b None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:37.277559 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18079259-56dd-42c2-8834-e4bbcd0ceb39 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:37.301901 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56604a08-d1ca-43d2-9e05-4575746326a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:37.302535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56604a08-d1ca-43d2-9e05-4575746326a5 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:37.303233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56604a08-d1ca-43d2-9e05-4575746326a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:37.303233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56604a08-d1ca-43d2-9e05-4575746326a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:37.311369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:37.314611 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56604a08-d1ca-43d2-9e05-4575746326a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:37.316845 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482564f-21b8-42c5-bd2f-09a0caf8a908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:37.317552 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482564f-21b8-42c5-bd2f-09a0caf8a908 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:37.317893 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482564f-21b8-42c5-bd2f-09a0caf8a908 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:37.318226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482564f-21b8-42c5-bd2f-09a0caf8a908 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:37.319504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-56604a08-d1ca-43d2-9e05-4575746326a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:37.319504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:37.319504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:37.319504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:37.319504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:37.319504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:37.319504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:37.319504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:37.319504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:37.319504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:37.319504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:37.319504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:37.319504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:37.319504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:37.319504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:37.319504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:37.326951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:37.326951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:37.326951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:37.326951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:37.326951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:37.326951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:37.326951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:37.326951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:37.326951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:37.326951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:37.326951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:37.326951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:37.326951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:37.326951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:37.326951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:37.326951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:37.328315 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:37.328315 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:37.328315 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:37.328315 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:37.328315 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:37.328315 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:37.328315 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:37.328315 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:37.328315 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:37.328315 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:37.328315 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:37.328315 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:37.328315 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 277/558] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Sep 6 20:06:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:37.328315 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56604a08-d1ca-43d2-9e05-4575746326a5 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:37.334767 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482564f-21b8-42c5-bd2f-09a0caf8a908 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:37.336719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482564f-21b8-42c5-bd2f-09a0caf8a908 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:37.353155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-2482564f-21b8-42c5-bd2f-09a0caf8a908 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:37.353155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:37.353155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:37.353155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:37.353155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:37.353155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:37.353155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:37.353155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:37.353155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:37.353155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:37.353155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:37.353155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:37.353155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:37.353155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:37.353155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:37.353155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:37.354191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:37.354191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:37.354191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:37.354191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:37.354191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:37.354191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:37.354191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:37.354191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:37.354191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:37.354191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:37.354191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:37.354191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:37.354191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:37.354191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:37.354191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:37.354191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:37.354191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:37.355067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:37.355067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:37.355067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:37.355067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 282/559] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:37.355067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482564f-21b8-42c5-bd2f-09a0caf8a908 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:37.437297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:37.452143 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56604a08-d1ca-43d2-9e05-4575746326a5 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:37.491384 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905a95f-21fc-4a5d-b749-3a6724d25f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:37.492040 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905a95f-21fc-4a5d-b749-3a6724d25f4a None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:37.492317 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905a95f-21fc-4a5d-b749-3a6724d25f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:37.492589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905a95f-21fc-4a5d-b749-3a6724d25f4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:37.504382 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905a95f-21fc-4a5d-b749-3a6724d25f4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:37.510114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-6905a95f-21fc-4a5d-b749-3a6724d25f4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:37.510114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:37.510114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:37.510114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:37.510114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:37.510114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:37.510114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:37.510114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:37.510114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:37.510114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:37.510114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:37.510114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:37.510114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:37.510114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:37.510114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:37.510114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:37.511060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:37.511060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:37.511060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:37.511060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:37.511060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:37.511060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:37.511060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:37.511060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:37.511060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:37.511060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:37.511060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:37.511060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:37.511060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:37.511060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:37.511060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:37.511060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:37.512035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:37.512035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:37.512035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:37.512035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:37.512035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:37.512035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:37.512035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:37.512035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:37.512035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:37.512035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:37.512035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:37.512035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:37.512035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 278/560] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Sep 6 20:06:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:37.512792 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905a95f-21fc-4a5d-b749-3a6724d25f4a None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:37.521695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482564f-21b8-42c5-bd2f-09a0caf8a908 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:37.558890 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1620f53-35a4-470d-a6c1-665ef30e6c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:37.559549 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1620f53-35a4-470d-a6c1-665ef30e6c65 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:37.559833 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1620f53-35a4-470d-a6c1-665ef30e6c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:37.560107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1620f53-35a4-470d-a6c1-665ef30e6c65 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:37.560772 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1620f53-35a4-470d-a6c1-665ef30e6c65 None admin] RBAC: Adding query filter params (name=service) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:37.561076 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1620f53-35a4-470d-a6c1-665ef30e6c65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:37.562999 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1620f53-35a4-470d-a6c1-665ef30e6c65 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:37.573334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 283/561] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Sep 6 20:06:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:37.579022 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1620f53-35a4-470d-a6c1-665ef30e6c65 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:37.627985 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:37.636136 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905a95f-21fc-4a5d-b749-3a6724d25f4a None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:37.672623 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3d6bf-26e7-4bf0-a4ca-a6a447c8a906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:37.673221 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3d6bf-26e7-4bf0-a4ca-a6a447c8a906 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:37.673496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3d6bf-26e7-4bf0-a4ca-a6a447c8a906 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:37.673764 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3d6bf-26e7-4bf0-a4ca-a6a447c8a906 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:37.674425 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3d6bf-26e7-4bf0-a4ca-a6a447c8a906 None admin] RBAC: Adding query filter params (name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:37.674721 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3d6bf-26e7-4bf0-a4ca-a6a447c8a906 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:37.676105 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3d6bf-26e7-4bf0-a4ca-a6a447c8a906 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:37.684508 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 279/562] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Sep 6 20:06:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:37.685366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3d6bf-26e7-4bf0-a4ca-a6a447c8a906 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:37.700259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:37.702013 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1620f53-35a4-470d-a6c1-665ef30e6c65 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:37.750132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804d8e3-a56c-4409-900a-ee1c22db55ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:37.750755 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804d8e3-a56c-4409-900a-ee1c22db55ca None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:37.751038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804d8e3-a56c-4409-900a-ee1c22db55ca None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:37.751315 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804d8e3-a56c-4409-900a-ee1c22db55ca None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:37.752226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804d8e3-a56c-4409-900a-ee1c22db55ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:37.752565 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804d8e3-a56c-4409-900a-ee1c22db55ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:37.753923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804d8e3-a56c-4409-900a-ee1c22db55ca None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:37.773877 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 284/563] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:37.773877 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804d8e3-a56c-4409-900a-ee1c22db55ca None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:37.821999 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3d6bf-26e7-4bf0-a4ca-a6a447c8a906 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:37.861907 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61ec3b-8d6a-4aa9-9ab4-935afb44c2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:37.862515 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61ec3b-8d6a-4aa9-9ab4-935afb44c2ce None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:37.862792 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61ec3b-8d6a-4aa9-9ab4-935afb44c2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:37.863070 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61ec3b-8d6a-4aa9-9ab4-935afb44c2ce None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:37.863755 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61ec3b-8d6a-4aa9-9ab4-935afb44c2ce None admin] RBAC: Adding query filter params (name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:37.864060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61ec3b-8d6a-4aa9-9ab4-935afb44c2ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:37.865455 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61ec3b-8d6a-4aa9-9ab4-935afb44c2ce None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:37.874061 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 280/564] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Sep 6 20:06:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:37.874883 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61ec3b-8d6a-4aa9-9ab4-935afb44c2ce None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:37.892771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804d8e3-a56c-4409-900a-ee1c22db55ca None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:37.900289 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:37.927155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7b1cb-6d42-48ac-b68f-2d860280578e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:37.927816 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7b1cb-6d42-48ac-b68f-2d860280578e None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:37.928100 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7b1cb-6d42-48ac-b68f-2d860280578e None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:37.928369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7b1cb-6d42-48ac-b68f-2d860280578e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:37.939805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7b1cb-6d42-48ac-b68f-2d860280578e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:37.941286 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7b1cb-6d42-48ac-b68f-2d860280578e None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:37.946742 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:37.956228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-2ec7b1cb-6d42-48ac-b68f-2d860280578e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:37.956228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:37.956228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:37.956228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:37.956228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:37.956228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:37.956228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:37.956228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:37.956228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:37.956228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:37.956228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:37.956228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:37.956228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:37.956228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:37.956228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:37.956228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:37.957456 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:37.957456 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:37.957456 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:37.957456 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:37.957456 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:37.957456 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:37.957456 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:37.957456 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:37.957456 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:37.957456 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:37.957456 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:37.957456 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:37.957456 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:37.957456 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:37.957456 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:37.957456 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:37.957456 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:37.958318 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:37.958318 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:37.958318 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:37.958318 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 285/565] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:37.958318 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7b1cb-6d42-48ac-b68f-2d860280578e None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:37.982743 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61ec3b-8d6a-4aa9-9ab4-935afb44c2ce None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:38.018458 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3dfa04-55b7-4f97-9a16-73307801d01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:38.019084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dfa04-55b7-4f97-9a16-73307801d01d None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:38.019360 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dfa04-55b7-4f97-9a16-73307801d01d None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:38.019655 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dfa04-55b7-4f97-9a16-73307801d01d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:38.030686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3dfa04-55b7-4f97-9a16-73307801d01d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:38.032163 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3dfa04-55b7-4f97-9a16-73307801d01d None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:38.047187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-8d3dfa04-55b7-4f97-9a16-73307801d01d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:38.047187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:38.047187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:38.047187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:38.047187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:38.047187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:38.047187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:38.047187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:38.047187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:38.047187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:38.047187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:38.047187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:38.047187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:38.047187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:38.047187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:38.047187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:38.048404 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:38.048404 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:38.048404 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:38.048404 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:38.048404 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:38.048404 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:38.048404 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:38.048404 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:38.048404 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:38.048404 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:38.048404 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:38.048404 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:38.048404 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:38.048404 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:38.048404 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:38.048404 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:38.048404 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:38.049268 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:38.049268 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:38.049268 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:38.049268 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 281/566] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:38.049499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43025327-72b1-435d-89b0-35b19d626c32 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:38.049766 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43025327-72b1-435d-89b0-35b19d626c32 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:38.050035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43025327-72b1-435d-89b0-35b19d626c32 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:38.055355 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 282/567] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:38.055355 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43025327-72b1-435d-89b0-35b19d626c32 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:38.063914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7b1cb-6d42-48ac-b68f-2d860280578e None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:38.100719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3e65a-bcb5-4be7-bd44-91e3c00ee0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:38.101185 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3e65a-bcb5-4be7-bd44-91e3c00ee0ac None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:38.101467 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3e65a-bcb5-4be7-bd44-91e3c00ee0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:38.101745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3e65a-bcb5-4be7-bd44-91e3c00ee0ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:38.109024 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3e65a-bcb5-4be7-bd44-91e3c00ee0ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:38.110554 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3e65a-bcb5-4be7-bd44-91e3c00ee0ac None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:38.121894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-92f3e65a-bcb5-4be7-bd44-91e3c00ee0ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:38.121894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:38.121894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:38.121894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:38.121894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:38.121894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:38.121894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:38.121894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:38.121894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:38.121894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:38.121894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:38.121894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:38.121894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:06:38.121894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:06:38.121894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:06:38.123017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:06:38.123017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:38.123017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:38.123017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:38.123017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:38.123017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:38.123017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:38.123017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:38.123017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:38.123017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:38.123017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:38.123017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:38.123017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:38.123017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:38.123017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:38.123017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:38.123017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:38.124023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:06:38.124023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:06:38.124023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:06:38.124023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:06:38.124023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:06:38.124023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:06:38.124023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:38.124023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:38.124023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 286/568] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:06:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:38.125100 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3e65a-bcb5-4be7-bd44-91e3c00ee0ac None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:38.144297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:38.158546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43025327-72b1-435d-89b0-35b19d626c32 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:38.183755 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:38.194746 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a2b8d-a712-4238-be50-ce6c1d8f2e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:38.195369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a2b8d-a712-4238-be50-ce6c1d8f2e39 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:38.195722 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a2b8d-a712-4238-be50-ce6c1d8f2e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:38.196001 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a2b8d-a712-4238-be50-ce6c1d8f2e39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:38.206312 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a2b8d-a712-4238-be50-ce6c1d8f2e39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:38.207775 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a2b8d-a712-4238-be50-ce6c1d8f2e39 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:38.223973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-370a2b8d-a712-4238-be50-ce6c1d8f2e39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:38.223973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:38.223973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:38.223973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:38.223973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:38.223973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:38.223973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:38.223973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:38.223973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:38.223973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:38.223973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:38.223973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:38.223973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:38.223973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:38.223973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:38.223973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:38.224987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:38.224987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:38.224987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:38.224987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:38.224987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:38.224987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:38.224987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:38.224987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:38.224987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:38.224987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:38.224987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:38.224987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:38.224987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:38.224987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:38.224987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:38.224987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:38.224987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:38.225856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:38.225856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:38.225856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:38.225856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 283/569] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:38.227124 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a2b8d-a712-4238-be50-ce6c1d8f2e39 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:38.227221 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3e65a-bcb5-4be7-bd44-91e3c00ee0ac None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:38.264913 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d1912-4145-4986-8335-5553f11014ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:38.265519 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d1912-4145-4986-8335-5553f11014ba None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:38.265802 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d1912-4145-4986-8335-5553f11014ba None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:38.266075 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d1912-4145-4986-8335-5553f11014ba None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:38.266730 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d1912-4145-4986-8335-5553f11014ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:38.267022 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d1912-4145-4986-8335-5553f11014ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:38.268430 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d1912-4145-4986-8335-5553f11014ba None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:38.279931 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 287/570] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:38.281537 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c27e00-e84d-48a6-8bbd-7ac286e5fb80 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:38.281824 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c27e00-e84d-48a6-8bbd-7ac286e5fb80 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:38.282100 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c27e00-e84d-48a6-8bbd-7ac286e5fb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:38.300873 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-79c27e00-e84d-48a6-8bbd-7ac286e5fb80 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:38.302089 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-79c27e00-e84d-48a6-8bbd-7ac286e5fb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:38.334923 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a2b8d-a712-4238-be50-ce6c1d8f2e39 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:38.369473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0684e3-c4e5-4491-a4f7-1ef2293b0348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:38.369980 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0684e3-c4e5-4491-a4f7-1ef2293b0348 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:38.370258 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0684e3-c4e5-4491-a4f7-1ef2293b0348 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:38.370525 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0684e3-c4e5-4491-a4f7-1ef2293b0348 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:38.370868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 288/571] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:38.377938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0684e3-c4e5-4491-a4f7-1ef2293b0348 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:38.377938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0684e3-c4e5-4491-a4f7-1ef2293b0348 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:38.378232 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c27e00-e84d-48a6-8bbd-7ac286e5fb80 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:38.378335 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0684e3-c4e5-4491-a4f7-1ef2293b0348 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:38.389813 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 284/572] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:38.389813 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0684e3-c4e5-4491-a4f7-1ef2293b0348 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:38.390648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:38.433248 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:38.525486 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c27e00-e84d-48a6-8bbd-7ac286e5fb80 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:38.531221 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0684e3-c4e5-4491-a4f7-1ef2293b0348 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:38.561035 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03ea92-a0d5-4f22-9202-7453c999961f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:38.561664 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03ea92-a0d5-4f22-9202-7453c999961f None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:38.561942 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03ea92-a0d5-4f22-9202-7453c999961f None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:38.562208 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03ea92-a0d5-4f22-9202-7453c999961f None admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:38.562890 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03ea92-a0d5-4f22-9202-7453c999961f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:38.563189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03ea92-a0d5-4f22-9202-7453c999961f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:38.564680 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03ea92-a0d5-4f22-9202-7453c999961f None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:38.568831 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32ed17-e35e-44d6-8e19-f203134d9007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:38.569449 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32ed17-e35e-44d6-8e19-f203134d9007 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:38.569721 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32ed17-e35e-44d6-8e19-f203134d9007 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:38.570003 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32ed17-e35e-44d6-8e19-f203134d9007 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:38.570629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32ed17-e35e-44d6-8e19-f203134d9007 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:38.570932 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32ed17-e35e-44d6-8e19-f203134d9007 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:38.572831 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32ed17-e35e-44d6-8e19-f203134d9007 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:38.576345 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 289/573] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:06:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:38.580491 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03ea92-a0d5-4f22-9202-7453c999961f None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:38.586784 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 285/574] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:38.587923 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32ed17-e35e-44d6-8e19-f203134d9007 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:38.655196 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:38.690017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03ea92-a0d5-4f22-9202-7453c999961f None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:38.692334 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:38.698368 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32ed17-e35e-44d6-8e19-f203134d9007 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:38.726209 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760fd3ae-def6-478c-90ad-9054ce1c9fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:38.727169 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fd3ae-def6-478c-90ad-9054ce1c9fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:38.727482 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fd3ae-def6-478c-90ad-9054ce1c9fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:38.727756 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fd3ae-def6-478c-90ad-9054ce1c9fc1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:38.734314 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83525241-7865-4495-8694-3e0b8cf7a3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:38.734937 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83525241-7865-4495-8694-3e0b8cf7a3fa None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:38.735210 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83525241-7865-4495-8694-3e0b8cf7a3fa None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:38.735493 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83525241-7865-4495-8694-3e0b8cf7a3fa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:38.735589 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760fd3ae-def6-478c-90ad-9054ce1c9fc1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:38.736993 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760fd3ae-def6-478c-90ad-9054ce1c9fc1 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:38.742628 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83525241-7865-4495-8694-3e0b8cf7a3fa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:38.744153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83525241-7865-4495-8694-3e0b8cf7a3fa None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:38.748500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-760fd3ae-def6-478c-90ad-9054ce1c9fc1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 20:06:38.748500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:38.748500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:38.748500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:38.748500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:38.748500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:38.748500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:38.748500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:38.748500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:38.748500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:38.748500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:38.748500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:38.748500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:06:38.748500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:06:38.748500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:06:38.748500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:06:38.749625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:38.749625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:38.749625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:06:38.749625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:38.749625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:06:38.749625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:38.749625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:38.749625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:38.749625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:38.749625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:38.749625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:38.749625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:38.749625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:38.749625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:38.749625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:38.749625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:38.749625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:38.749625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:38.750549 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:38.750549 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:38.750549 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:06:38.750549 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:06:38.750549 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:06:38.750549 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:06:38.750549 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:06:38.750549 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:06:38.750549 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 20:06:38.750549 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:38.750549 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 290/575] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Sep 6 20:06:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:38.751130 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760fd3ae-def6-478c-90ad-9054ce1c9fc1 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:38.762264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-83525241-7865-4495-8694-3e0b8cf7a3fa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 20:06:38.762264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:38.762264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:38.762264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:38.762264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:38.762264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:38.762264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:38.762264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:38.762264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:38.762264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:38.762264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:38.762264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:38.762264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:06:38.762264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:06:38.762264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:06:38.762264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:06:38.763466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:38.763466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:38.763466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:06:38.763466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:38.763466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:06:38.763466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:38.763466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:38.763466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:38.763466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:38.763466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:38.763466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:38.763466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:38.763466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:38.763466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:38.763466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:38.763466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:38.763466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:38.763466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:38.765352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:38.765352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:38.765352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:06:38.765352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:06:38.765352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:06:38.765352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:06:38.765352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:06:38.765352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:06:38.765352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 20:06:38.765352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:38.765352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 286/576] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:06:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:38.767051 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83525241-7865-4495-8694-3e0b8cf7a3fa None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:38.859891 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760fd3ae-def6-478c-90ad-9054ce1c9fc1 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:38.885183 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83525241-7865-4495-8694-3e0b8cf7a3fa None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:38.889476 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:38.898481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace91b57-2bd3-495d-84b1-0422fc73f023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:38.903025 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace91b57-2bd3-495d-84b1-0422fc73f023 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:38.903025 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace91b57-2bd3-495d-84b1-0422fc73f023 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:38.903025 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace91b57-2bd3-495d-84b1-0422fc73f023 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:38.903025 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace91b57-2bd3-495d-84b1-0422fc73f023 None admin] RBAC: Adding query filter params (role.id=140b49dfcc2b489ca0504d2e7abfdbdb, scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343, user.id=5a6c4f91a59548fd979e7232a2afd6ec) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:38.903025 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace91b57-2bd3-495d-84b1-0422fc73f023 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:38.903025 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace91b57-2bd3-495d-84b1-0422fc73f023 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:38.908284 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 291/577] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:06:38 2022] GET /identity/v3/role_assignments?user.id=5a6c4f91a59548fd979e7232a2afd6ec&scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343&role.id=140b49dfcc2b489ca0504d2e7abfdbdb => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:38.908993 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace91b57-2bd3-495d-84b1-0422fc73f023 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:38.925131 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d771421-feeb-4f88-8178-8a97595093eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:38.925797 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d771421-feeb-4f88-8178-8a97595093eb None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:38.926076 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d771421-feeb-4f88-8178-8a97595093eb None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:38.926358 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d771421-feeb-4f88-8178-8a97595093eb None admin] PATH_INFO: `/v3/users/glance` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:38.935143 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d771421-feeb-4f88-8178-8a97595093eb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:38.937193 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d771421-feeb-4f88-8178-8a97595093eb None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:38.949848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-5d771421-feeb-4f88-8178-8a97595093eb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 06 20:06:38.949848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:38.949848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:38.949848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:38.949848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:38.949848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:38.949848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:38.949848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:38.949848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:38.949848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:38.949848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:38.949848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:38.949848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:06:38.949848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:06:38.949848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:06:38.949848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:06:38.950867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:38.950867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:38.950867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:06:38.950867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:38.950867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:06:38.950867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:38.950867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:38.950867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:38.950867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:38.950867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:38.950867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:38.950867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:38.950867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:38.950867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:38.950867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:38.950867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:38.950867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:38.950867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:38.951843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:38.951843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:38.951843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:06:38.951843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:06:38.951843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:06:38.951843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:06:38.951843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:06:38.951843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:06:38.951843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 06 20:06:38.951843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:38.951843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 287/578] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:06:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:38.951843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d771421-feeb-4f88-8178-8a97595093eb None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:38.974602 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:39.051887 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace91b57-2bd3-495d-84b1-0422fc73f023 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:39.080037 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d771421-feeb-4f88-8178-8a97595093eb None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:39.089360 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bf302-1605-4de2-accc-22de112348e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:39.089734 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bf302-1605-4de2-accc-22de112348e4 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:39.090552 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bf302-1605-4de2-accc-22de112348e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:39.090552 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bf302-1605-4de2-accc-22de112348e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:39.108681 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662bf302-1605-4de2-accc-22de112348e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:39.119129 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-662bf302-1605-4de2-accc-22de112348e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:39.119129 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:39.119129 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:39.119129 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:39.119129 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:39.119129 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:39.119129 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:39.119129 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:39.119129 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:39.119129 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:39.119129 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:39.119129 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:39.119129 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:39.119129 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:39.119129 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:39.119129 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:39.120298 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:39.120298 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:39.120298 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:39.120298 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:39.120298 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:39.120298 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:39.120298 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:39.120298 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:39.120298 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:39.120298 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:39.120298 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:39.120298 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:39.120298 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:39.120298 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:39.120298 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:39.120298 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:39.121314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:39.121314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:39.121314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:39.121314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:39.121314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:39.121314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:39.121314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:39.121314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:39.121314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:39.121314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:39.121314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:39.121314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:39.122865 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771016f-b529-4aa0-afd8-83662b9e84ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:39.123567 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771016f-b529-4aa0-afd8-83662b9e84ce None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:39.127642 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771016f-b529-4aa0-afd8-83662b9e84ce None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:39.128003 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 292/579] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Sep 6 20:06:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:39.128172 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771016f-b529-4aa0-afd8-83662b9e84ce None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:39.128172 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771016f-b529-4aa0-afd8-83662b9e84ce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:39.128465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bf302-1605-4de2-accc-22de112348e4 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:39.128619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771016f-b529-4aa0-afd8-83662b9e84ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:39.129055 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771016f-b529-4aa0-afd8-83662b9e84ce None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:39.151906 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 288/580] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Sep 6 20:06:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:39.151906 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771016f-b529-4aa0-afd8-83662b9e84ce None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:39.211528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:39.238374 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:39.260262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bf302-1605-4de2-accc-22de112348e4 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:39.266169 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771016f-b529-4aa0-afd8-83662b9e84ce None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:39.300952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b351ac-c1e8-4bee-8b8c-75b942dd1669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:39.302374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b351ac-c1e8-4bee-8b8c-75b942dd1669 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:39.302806 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b351ac-c1e8-4bee-8b8c-75b942dd1669 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:39.303149 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455d5e9-1bfc-4e6b-bb12-d94147e6c8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:39.303456 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b351ac-c1e8-4bee-8b8c-75b942dd1669 None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:39.303793 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455d5e9-1bfc-4e6b-bb12-d94147e6c8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:39.304068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455d5e9-1bfc-4e6b-bb12-d94147e6c8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:39.304338 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455d5e9-1bfc-4e6b-bb12-d94147e6c8b2 None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:39.304806 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b351ac-c1e8-4bee-8b8c-75b942dd1669 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:39.305055 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455d5e9-1bfc-4e6b-bb12-d94147e6c8b2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:39.305357 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455d5e9-1bfc-4e6b-bb12-d94147e6c8b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:39.305573 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b351ac-c1e8-4bee-8b8c-75b942dd1669 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:39.306782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455d5e9-1bfc-4e6b-bb12-d94147e6c8b2 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:39.307353 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b351ac-c1e8-4bee-8b8c-75b942dd1669 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:39.325026 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 289/581] 10.222.0.77 () {56 vars in 1137 bytes} [Tue Sep 6 20:06:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:39.325857 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455d5e9-1bfc-4e6b-bb12-d94147e6c8b2 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:39.338749 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 293/582] 10.222.0.77 () {56 vars in 1137 bytes} [Tue Sep 6 20:06:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:39.339992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b351ac-c1e8-4bee-8b8c-75b942dd1669 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:39.450467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455d5e9-1bfc-4e6b-bb12-d94147e6c8b2 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:39.454883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b351ac-c1e8-4bee-8b8c-75b942dd1669 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:39.468922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:39.486391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:39.491758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943668f-a70e-4250-aad3-fa93f80bed5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:39.492374 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943668f-a70e-4250-aad3-fa93f80bed5a None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:39.492656 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943668f-a70e-4250-aad3-fa93f80bed5a None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:39.492930 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943668f-a70e-4250-aad3-fa93f80bed5a None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:39.493596 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943668f-a70e-4250-aad3-fa93f80bed5a None admin] RBAC: Adding query filter params (name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:39.493897 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943668f-a70e-4250-aad3-fa93f80bed5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:39.495371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943668f-a70e-4250-aad3-fa93f80bed5a None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:39.500844 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4cfd4-ce60-4cb2-9e04-6d742b59cd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:39.501505 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4cfd4-ce60-4cb2-9e04-6d742b59cd91 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:39.501796 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4cfd4-ce60-4cb2-9e04-6d742b59cd91 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:39.502321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4cfd4-ce60-4cb2-9e04-6d742b59cd91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:39.505870 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 290/583] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Sep 6 20:06:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:39.506946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943668f-a70e-4250-aad3-fa93f80bed5a None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:39.515808 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4cfd4-ce60-4cb2-9e04-6d742b59cd91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:39.517300 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4cfd4-ce60-4cb2-9e04-6d742b59cd91 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:39.533723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-80f4cfd4-ce60-4cb2-9e04-6d742b59cd91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:39.533723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:39.533723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:39.533723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:39.533723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:39.533723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:39.533723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:39.533723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:39.533723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:39.533723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:39.533723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:39.533723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:39.533723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:39.533723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:39.533723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:39.533723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:39.535432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:39.535432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:39.535432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:39.535432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:39.535432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:39.535432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:39.535432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:39.535432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:39.535432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:39.535432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:39.535432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:39.535432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:39.535432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:39.535432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:39.535432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:39.535432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:39.535432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:39.537719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:39.537719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:39.537719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:39.539621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 294/584] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:39.540667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4cfd4-ce60-4cb2-9e04-6d742b59cd91 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:39.635988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943668f-a70e-4250-aad3-fa93f80bed5a None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:39.659646 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4cfd4-ce60-4cb2-9e04-6d742b59cd91 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:39.677372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9dc2c-d1ae-40af-9ae8-64213247acb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:39.678172 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9dc2c-d1ae-40af-9ae8-64213247acb1 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:39.678551 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9dc2c-d1ae-40af-9ae8-64213247acb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:39.678981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9dc2c-d1ae-40af-9ae8-64213247acb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:39.690980 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9dc2c-d1ae-40af-9ae8-64213247acb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:39.692437 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9dc2c-d1ae-40af-9ae8-64213247acb1 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:39.700923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52ee09-0ef5-4900-bed5-38003c3d211f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:39.701561 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52ee09-0ef5-4900-bed5-38003c3d211f None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:39.702151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52ee09-0ef5-4900-bed5-38003c3d211f None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:39.702151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52ee09-0ef5-4900-bed5-38003c3d211f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:39.708443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-19f9dc2c-d1ae-40af-9ae8-64213247acb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:39.708443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:39.708443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:39.708443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:39.708443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:39.708443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:39.708443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:39.708443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:39.708443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:39.708443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:39.708443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:39.708443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:39.708443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:39.708443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:39.708443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:39.708443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:39.709409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:39.709409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:39.709409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:39.709409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:39.709409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:39.709409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:39.709409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:39.709409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:39.709409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:39.709409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:39.709409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:39.709409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:39.709409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:39.709409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:39.709409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:39.709409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:39.709409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:39.710290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:39.710290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:39.710290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:39.710290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 291/585] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:39.710508 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9dc2c-d1ae-40af-9ae8-64213247acb1 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:39.718762 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52ee09-0ef5-4900-bed5-38003c3d211f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:39.720515 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52ee09-0ef5-4900-bed5-38003c3d211f None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:39.735918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-1a52ee09-0ef5-4900-bed5-38003c3d211f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:39.735918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:39.735918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:39.735918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:39.735918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:39.735918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:39.735918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:39.735918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:39.735918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:39.735918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:39.735918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:39.735918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:39.735918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:39.735918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:39.735918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:39.735918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:39.736903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:39.736903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:39.736903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:39.736903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:39.736903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:39.736903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:39.736903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:39.736903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:39.736903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:39.736903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:39.736903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:39.736903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:39.736903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:39.736903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:39.736903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:39.736903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:39.736903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:39.737853 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:39.737853 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:39.737853 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:39.741636 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 295/586] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:39.742680 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52ee09-0ef5-4900-bed5-38003c3d211f None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:39.759751 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:39.768282 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:39.833744 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9dc2c-d1ae-40af-9ae8-64213247acb1 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:39.857233 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52ee09-0ef5-4900-bed5-38003c3d211f None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:39.874473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4164bfc-c264-4dab-b03d-37169571f9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:39.875143 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4164bfc-c264-4dab-b03d-37169571f9e0 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:39.875432 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4164bfc-c264-4dab-b03d-37169571f9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:39.875684 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4164bfc-c264-4dab-b03d-37169571f9e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:39.887455 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4164bfc-c264-4dab-b03d-37169571f9e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:39.888928 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4164bfc-c264-4dab-b03d-37169571f9e0 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:39.898071 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17b428-da2e-4d63-a9a5-7de9387028e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:39.898687 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17b428-da2e-4d63-a9a5-7de9387028e6 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:39.898967 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17b428-da2e-4d63-a9a5-7de9387028e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:39.899241 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17b428-da2e-4d63-a9a5-7de9387028e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:39.899915 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17b428-da2e-4d63-a9a5-7de9387028e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:39.900218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17b428-da2e-4d63-a9a5-7de9387028e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:39.901581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17b428-da2e-4d63-a9a5-7de9387028e6 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:39.904595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-a4164bfc-c264-4dab-b03d-37169571f9e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:39.904595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:39.904595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:39.904595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:39.904595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:39.904595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:39.904595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:39.904595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:39.904595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:39.904595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:39.904595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:39.904595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:39.904595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:39.904595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:39.904595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:39.904595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:39.906048 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:39.906048 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:39.906048 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:39.906048 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:39.906048 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:39.906048 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:39.906048 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:39.906048 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:39.906048 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:39.906048 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:39.906048 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:39.906048 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:39.906048 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:39.906048 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:39.906048 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:39.906048 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:39.906048 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:39.906968 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:39.906968 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:39.906968 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:39.906968 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 292/587] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:39.907669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4164bfc-c264-4dab-b03d-37169571f9e0 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:39.918867 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 296/588] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:39.919585 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17b428-da2e-4d63-a9a5-7de9387028e6 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:40.009875 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:40.017244 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:40.021127 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4164bfc-c264-4dab-b03d-37169571f9e0 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:40.040590 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17b428-da2e-4d63-a9a5-7de9387028e6 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:40.058596 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167959aa-14d4-4a8d-b63d-7bd4754130c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:40.059184 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167959aa-14d4-4a8d-b63d-7bd4754130c2 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:40.059460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167959aa-14d4-4a8d-b63d-7bd4754130c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:40.059815 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167959aa-14d4-4a8d-b63d-7bd4754130c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:40.060463 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167959aa-14d4-4a8d-b63d-7bd4754130c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:40.060769 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167959aa-14d4-4a8d-b63d-7bd4754130c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:40.062203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167959aa-14d4-4a8d-b63d-7bd4754130c2 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:40.073948 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 293/589] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:40.074790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167959aa-14d4-4a8d-b63d-7bd4754130c2 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:40.085631 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7f708-4a37-4dff-b8fd-6114ce8c6d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:40.086546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7f708-4a37-4dff-b8fd-6114ce8c6d91 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:40.086835 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7f708-4a37-4dff-b8fd-6114ce8c6d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:40.087112 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7f708-4a37-4dff-b8fd-6114ce8c6d91 None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:40.087805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7f708-4a37-4dff-b8fd-6114ce8c6d91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:40.088204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7f708-4a37-4dff-b8fd-6114ce8c6d91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:40.089886 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7f708-4a37-4dff-b8fd-6114ce8c6d91 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:40.104867 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 297/590] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:40.105740 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7f708-4a37-4dff-b8fd-6114ce8c6d91 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:40.198518 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167959aa-14d4-4a8d-b63d-7bd4754130c2 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:40.215599 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7f708-4a37-4dff-b8fd-6114ce8c6d91 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:40.238440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d18fd-2f1b-4e97-8f67-4f66f32fac27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:40.239398 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d18fd-2f1b-4e97-8f67-4f66f32fac27 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:40.239948 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d18fd-2f1b-4e97-8f67-4f66f32fac27 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:40.240533 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d18fd-2f1b-4e97-8f67-4f66f32fac27 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:40.241184 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d18fd-2f1b-4e97-8f67-4f66f32fac27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:40.241491 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d18fd-2f1b-4e97-8f67-4f66f32fac27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:40.242900 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d18fd-2f1b-4e97-8f67-4f66f32fac27 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:40.251465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142a8a9-6d97-4045-a51e-e633cfdb9753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:40.252374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142a8a9-6d97-4045-a51e-e633cfdb9753 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:40.252643 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142a8a9-6d97-4045-a51e-e633cfdb9753 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:40.252897 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142a8a9-6d97-4045-a51e-e633cfdb9753 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:40.254869 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:40.257155 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 294/591] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:40.258257 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d18fd-2f1b-4e97-8f67-4f66f32fac27 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:40.260188 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142a8a9-6d97-4045-a51e-e633cfdb9753 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:40.261588 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142a8a9-6d97-4045-a51e-e633cfdb9753 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:40.274412 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-9142a8a9-6d97-4045-a51e-e633cfdb9753 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:40.274412 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:40.274412 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:40.274412 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:40.274412 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:40.274412 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:40.274412 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:40.274412 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:40.274412 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:40.274412 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:40.274412 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:40.274412 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:40.274412 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:06:40.274412 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:06:40.274412 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:06:40.275370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:06:40.275370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:40.275370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:40.275370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:40.275370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:40.275370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:40.275370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:40.275370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:40.275370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:40.275370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:40.275370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:40.275370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:40.275370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:40.275370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:40.275370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:40.275370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:40.275370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:40.276317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:06:40.276317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:06:40.276317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:06:40.276317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:06:40.276317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:06:40.276317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:06:40.276317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:40.276317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:40.276317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 298/592] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:06:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:40.276317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142a8a9-6d97-4045-a51e-e633cfdb9753 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:40.288992 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:40.380506 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d18fd-2f1b-4e97-8f67-4f66f32fac27 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:40.406506 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142a8a9-6d97-4045-a51e-e633cfdb9753 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:40.433781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a954a1-fa56-42e6-bfdd-ee0d44b2b12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:40.434904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a954a1-fa56-42e6-bfdd-ee0d44b2b12b None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:40.435403 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a954a1-fa56-42e6-bfdd-ee0d44b2b12b None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:40.435997 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a954a1-fa56-42e6-bfdd-ee0d44b2b12b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:40.447563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468badb-e5da-46fd-9604-ae41440e0c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:40.449750 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a954a1-fa56-42e6-bfdd-ee0d44b2b12b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:40.449870 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468badb-e5da-46fd-9604-ae41440e0c8f None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:40.449870 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468badb-e5da-46fd-9604-ae41440e0c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:40.449870 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468badb-e5da-46fd-9604-ae41440e0c8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:40.450924 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a954a1-fa56-42e6-bfdd-ee0d44b2b12b None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:40.458069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468badb-e5da-46fd-9604-ae41440e0c8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:40.459537 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468badb-e5da-46fd-9604-ae41440e0c8f None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:40.465534 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-41a954a1-fa56-42e6-bfdd-ee0d44b2b12b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:40.465534 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:40.465534 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:40.465534 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:40.465534 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:40.465534 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:40.465534 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:40.465534 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:40.465534 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:40.465534 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:40.465534 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:40.465534 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:40.465534 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:06:40.465534 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:06:40.465534 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:06:40.466438 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:06:40.466438 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:40.466438 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:40.466438 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:40.466438 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:40.466438 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:40.466438 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:40.466438 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:40.466438 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:40.466438 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:40.466438 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:40.466438 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:40.466438 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:40.466438 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:40.466438 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:40.466438 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:40.466438 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:40.467330 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:06:40.467330 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:06:40.467330 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:06:40.467330 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:06:40.467330 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:06:40.467330 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:06:40.467330 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:40.467330 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:40.467330 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 295/593] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:06:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:40.468873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a954a1-fa56-42e6-bfdd-ee0d44b2b12b None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:40.476847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-1468badb-e5da-46fd-9604-ae41440e0c8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:40.476847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:40.476847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:40.476847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:40.476847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:40.476847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:40.476847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:40.476847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:40.476847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:40.476847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:40.476847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:40.476847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:40.476847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:06:40.476847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:06:40.476847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:06:40.477801 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:06:40.477801 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:40.477801 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:40.477801 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:40.477801 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:40.477801 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:40.477801 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:40.477801 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:40.477801 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:40.477801 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:40.477801 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:40.477801 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:40.477801 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:40.477801 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:40.477801 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:40.477801 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:40.477801 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:40.479640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:06:40.479640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:06:40.479640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:06:40.479640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:06:40.479640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:06:40.479640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:06:40.479640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:40.479640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:40.479640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 299/594] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:06:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:40.479640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468badb-e5da-46fd-9604-ae41440e0c8f None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:40.541299 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:40.560774 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:40.585803 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a954a1-fa56-42e6-bfdd-ee0d44b2b12b None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:40.591118 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468badb-e5da-46fd-9604-ae41440e0c8f None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:40.622529 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afdd57c-c09c-4397-be0c-d9baaf4f9bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:40.623174 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdd57c-c09c-4397-be0c-d9baaf4f9bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:40.623468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdd57c-c09c-4397-be0c-d9baaf4f9bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:40.623752 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdd57c-c09c-4397-be0c-d9baaf4f9bf0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:40.628983 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963570a3-2578-4450-8294-a3c3db2420b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:40.629599 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963570a3-2578-4450-8294-a3c3db2420b5 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:40.629877 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963570a3-2578-4450-8294-a3c3db2420b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:40.630149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963570a3-2578-4450-8294-a3c3db2420b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:40.630845 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963570a3-2578-4450-8294-a3c3db2420b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:40.631152 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963570a3-2578-4450-8294-a3c3db2420b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:40.632636 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963570a3-2578-4450-8294-a3c3db2420b5 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:40.632760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afdd57c-c09c-4397-be0c-d9baaf4f9bf0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:40.634319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afdd57c-c09c-4397-be0c-d9baaf4f9bf0 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:40.651237 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 300/595] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:06:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:40.651429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-1afdd57c-c09c-4397-be0c-d9baaf4f9bf0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 20:06:40.651429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:40.651429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:40.651429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:40.651429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:40.651429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:40.651429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:40.651429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:40.651429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:40.651429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:40.651429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:40.651429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:40.651429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:06:40.651429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:06:40.651429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:06:40.651429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:06:40.653084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:40.653084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:40.653084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:06:40.653084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:40.653084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:06:40.653084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:40.653084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:40.653084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:40.653084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:40.653084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:40.653084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:40.653084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:40.653084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:40.653084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:40.653084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:40.653084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:40.653084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:40.653084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:40.654035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:40.654035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:40.654035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:06:40.654035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:06:40.654035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:06:40.654035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:06:40.654035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:06:40.654035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:06:40.654035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 20:06:40.654035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:40.654643 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963570a3-2578-4450-8294-a3c3db2420b5 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:40.654724 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 296/596] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Sep 6 20:06:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:40.654724 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afdd57c-c09c-4397-be0c-d9baaf4f9bf0 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:40.767206 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963570a3-2578-4450-8294-a3c3db2420b5 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:40.774435 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afdd57c-c09c-4397-be0c-d9baaf4f9bf0 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:40.785038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:40.813126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf10609-5001-4b24-ad0b-488219d024ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:40.814359 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf10609-5001-4b24-ad0b-488219d024ab None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:40.814645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf10609-5001-4b24-ad0b-488219d024ab None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:40.814917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf10609-5001-4b24-ad0b-488219d024ab None admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:40.815654 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf10609-5001-4b24-ad0b-488219d024ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:40.815966 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf10609-5001-4b24-ad0b-488219d024ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:40.817612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf10609-5001-4b24-ad0b-488219d024ab None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:40.820603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4285b-db43-41ae-8f51-e332c1b84477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:40.821223 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4285b-db43-41ae-8f51-e332c1b84477 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:40.821499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4285b-db43-41ae-8f51-e332c1b84477 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:40.821820 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4285b-db43-41ae-8f51-e332c1b84477 None admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:40.822453 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4285b-db43-41ae-8f51-e332c1b84477 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:40.822751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4285b-db43-41ae-8f51-e332c1b84477 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:40.824293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4285b-db43-41ae-8f51-e332c1b84477 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:40.838514 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 301/597] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:06:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:40.838514 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf10609-5001-4b24-ad0b-488219d024ab None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:40.838820 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:40.845658 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 297/598] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:06:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:40.845658 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4285b-db43-41ae-8f51-e332c1b84477 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:40.957823 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4285b-db43-41ae-8f51-e332c1b84477 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:40.968425 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf10609-5001-4b24-ad0b-488219d024ab None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:41.006900 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658306d4-3f7d-41bf-85d8-90bdcafaadb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:41.007628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658306d4-3f7d-41bf-85d8-90bdcafaadb2 None admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:41.007919 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658306d4-3f7d-41bf-85d8-90bdcafaadb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:41.008191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658306d4-3f7d-41bf-85d8-90bdcafaadb2 None admin] PATH_INFO: `/v3/projects/1b4323c35aef456b90ba9f1b7eb2b343/users/b09ce16da49b4af38491ad4eb6287d70/roles/140b49dfcc2b489ca0504d2e7abfdbdb` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:41.008929 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b0c15-9a0e-4b15-9353-2a49216143da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:41.009865 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b0c15-9a0e-4b15-9353-2a49216143da None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:41.010395 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b0c15-9a0e-4b15-9353-2a49216143da None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:41.011144 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b0c15-9a0e-4b15-9353-2a49216143da None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:41.013252 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b0c15-9a0e-4b15-9353-2a49216143da None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:41.013862 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b0c15-9a0e-4b15-9353-2a49216143da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:41.015616 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b0c15-9a0e-4b15-9353-2a49216143da None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:41.027659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658306d4-3f7d-41bf-85d8-90bdcafaadb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b4323c35aef456b90ba9f1b7eb2b343, user_id=b09ce16da49b4af38491ad4eb6287d70, role_id=140b49dfcc2b489ca0504d2e7abfdbdb)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:41.029560 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658306d4-3f7d-41bf-85d8-90bdcafaadb2 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:41.035985 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 298/599] 10.222.0.77 () {56 vars in 1139 bytes} [Tue Sep 6 20:06:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:41.036590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b0c15-9a0e-4b15-9353-2a49216143da None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:41.096273 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:41.104808 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 302/600] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Sep 6 20:06:40 2022] PUT /identity/v3/projects/1b4323c35aef456b90ba9f1b7eb2b343/users/b09ce16da49b4af38491ad4eb6287d70/roles/140b49dfcc2b489ca0504d2e7abfdbdb => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:06:41.116473 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658306d4-3f7d-41bf-85d8-90bdcafaadb2 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:41.150577 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b0c15-9a0e-4b15-9353-2a49216143da None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:41.151255 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:41.191924 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ba5d7-e612-4a09-8ce7-8bfba12a8442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:41.192886 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ba5d7-e612-4a09-8ce7-8bfba12a8442 None admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:41.193175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ba5d7-e612-4a09-8ce7-8bfba12a8442 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:41.193452 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ba5d7-e612-4a09-8ce7-8bfba12a8442 None admin] PATH_INFO: `/v3/projects/1b4323c35aef456b90ba9f1b7eb2b343/users/871f208a13ba435491022b9ea9b735e6/roles/140b49dfcc2b489ca0504d2e7abfdbdb` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:41.210536 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ba5d7-e612-4a09-8ce7-8bfba12a8442 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b4323c35aef456b90ba9f1b7eb2b343, user_id=871f208a13ba435491022b9ea9b735e6, role_id=140b49dfcc2b489ca0504d2e7abfdbdb)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:41.212027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ba5d7-e612-4a09-8ce7-8bfba12a8442 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:41.239295 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658306d4-3f7d-41bf-85d8-90bdcafaadb2 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:41.283520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa882a-b4c4-44d6-b290-1fa7f3b2fc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:41.284113 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa882a-b4c4-44d6-b290-1fa7f3b2fc24 None admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:41.284390 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa882a-b4c4-44d6-b290-1fa7f3b2fc24 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:41.284661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa882a-b4c4-44d6-b290-1fa7f3b2fc24 None admin] PATH_INFO: `/v3/projects/1b4323c35aef456b90ba9f1b7eb2b343/users/c6d2bb1c23484010bcc9238f9a9203a4/roles/140b49dfcc2b489ca0504d2e7abfdbdb` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:41.301138 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 299/601] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Sep 6 20:06:41 2022] PUT /identity/v3/projects/1b4323c35aef456b90ba9f1b7eb2b343/users/871f208a13ba435491022b9ea9b735e6/roles/140b49dfcc2b489ca0504d2e7abfdbdb => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:06:41.302901 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ba5d7-e612-4a09-8ce7-8bfba12a8442 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:41.303037 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa882a-b4c4-44d6-b290-1fa7f3b2fc24 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b4323c35aef456b90ba9f1b7eb2b343, user_id=c6d2bb1c23484010bcc9238f9a9203a4, role_id=140b49dfcc2b489ca0504d2e7abfdbdb)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:41.304519 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa882a-b4c4-44d6-b290-1fa7f3b2fc24 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:41.391840 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 303/602] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Sep 6 20:06:41 2022] PUT /identity/v3/projects/1b4323c35aef456b90ba9f1b7eb2b343/users/c6d2bb1c23484010bcc9238f9a9203a4/roles/140b49dfcc2b489ca0504d2e7abfdbdb => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:06:41.393244 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c0b80-989c-4d3e-a9ef-edd9126ac3e3 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:41.393599 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c0b80-989c-4d3e-a9ef-edd9126ac3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:41.393877 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c0b80-989c-4d3e-a9ef-edd9126ac3e3 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:41.395750 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 304/603] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:41.401570 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632e16f-a397-4d3e-a997-0319a47a259f None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:41.401910 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632e16f-a397-4d3e-a997-0319a47a259f None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:41.402243 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632e16f-a397-4d3e-a997-0319a47a259f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:41.444802 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-e632e16f-a397-4d3e-a997-0319a47a259f None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:41.445440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ba5d7-e612-4a09-8ce7-8bfba12a8442 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:41.446128 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-e632e16f-a397-4d3e-a997-0319a47a259f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:41.454000 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:41.493073 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01999cba-54e0-4e61-bdfb-f6e4fcb04e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:41.494199 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01999cba-54e0-4e61-bdfb-f6e4fcb04e0c None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:41.494712 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01999cba-54e0-4e61-bdfb-f6e4fcb04e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:41.495215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01999cba-54e0-4e61-bdfb-f6e4fcb04e0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:41.520625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01999cba-54e0-4e61-bdfb-f6e4fcb04e0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:41.525111 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01999cba-54e0-4e61-bdfb-f6e4fcb04e0c None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:41.547341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-01999cba-54e0-4e61-bdfb-f6e4fcb04e0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:41.547341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:41.547341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:41.547341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:41.547341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:41.547341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:41.547341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:41.547341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:41.547341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:41.547341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:41.547341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:41.547341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:41.547341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:41.547341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:41.547341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:41.547341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:41.548361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:41.548361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:41.548361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:41.548361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:41.548361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:41.548361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:41.548361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:41.548361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:41.548361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:41.548361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:41.548361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:41.548361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:41.548361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:41.548361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:41.548361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:41.548361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:41.548361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:41.549253 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:41.549253 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:41.549253 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:41.553027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 300/604] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:41.564847 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01999cba-54e0-4e61-bdfb-f6e4fcb04e0c None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:41.582795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 305/605] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:41.720299 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01999cba-54e0-4e61-bdfb-f6e4fcb04e0c None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:41.760172 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c394fc2-383b-4708-b51a-0c515d7a9260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:41.760806 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c394fc2-383b-4708-b51a-0c515d7a9260 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:41.761086 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c394fc2-383b-4708-b51a-0c515d7a9260 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:41.761360 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c394fc2-383b-4708-b51a-0c515d7a9260 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:41.762024 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c394fc2-383b-4708-b51a-0c515d7a9260 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:41.762332 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c394fc2-383b-4708-b51a-0c515d7a9260 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:41.763805 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c394fc2-383b-4708-b51a-0c515d7a9260 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:41.779142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 301/606] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:06:41.785938 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632e16f-a397-4d3e-a997-0319a47a259f None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:41.790948 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:41.890712 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c394fc2-383b-4708-b51a-0c515d7a9260 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:41.922416 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:41.937374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632e16f-a397-4d3e-a997-0319a47a259f None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:42.018422 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c868a7-148d-4469-8740-0a9e300bad04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:42.018994 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c868a7-148d-4469-8740-0a9e300bad04 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:42.019272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c868a7-148d-4469-8740-0a9e300bad04 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:42.019569 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c868a7-148d-4469-8740-0a9e300bad04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:42.039267 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c868a7-148d-4469-8740-0a9e300bad04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:42.040764 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c868a7-148d-4469-8740-0a9e300bad04 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:42.070470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-d3c868a7-148d-4469-8740-0a9e300bad04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:42.070470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:42.070470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:42.070470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:42.070470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:42.070470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:42.070470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:42.070470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:42.070470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:42.070470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:42.070470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:42.070470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:42.070470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:06:42.070470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:06:42.070470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:06:42.071534 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:06:42.071534 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:42.071534 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:42.071534 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:42.071534 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:42.071534 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:42.071534 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:42.071534 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:42.071534 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:42.071534 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:42.071534 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:42.071534 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:42.071534 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:42.071534 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:42.071534 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:42.071534 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:42.071534 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:42.072434 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:06:42.072434 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:06:42.072434 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:06:42.072434 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:06:42.072434 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:06:42.072434 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:06:42.072434 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:42.072434 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:42.072434 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 306/607] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:06:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:42.078555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c868a7-148d-4469-8740-0a9e300bad04 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:42.085081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c394fc2-383b-4708-b51a-0c515d7a9260 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:42.160386 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965469f2-0c8d-4e53-bdf0-10a5f66880d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:42.161038 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965469f2-0c8d-4e53-bdf0-10a5f66880d1 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:42.161319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965469f2-0c8d-4e53-bdf0-10a5f66880d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:42.161591 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965469f2-0c8d-4e53-bdf0-10a5f66880d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:42.176979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965469f2-0c8d-4e53-bdf0-10a5f66880d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:42.182550 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-965469f2-0c8d-4e53-bdf0-10a5f66880d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:42.182550 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:42.182550 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:42.182550 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:42.182550 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:42.182550 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:42.182550 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:42.182550 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:42.182550 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:42.182550 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:42.182550 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:42.182550 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:42.182550 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:42.182550 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:42.182550 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:42.182550 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:42.183994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:42.183994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:42.183994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:42.183994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:42.183994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:42.183994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:42.183994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:42.183994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:42.183994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:42.183994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:42.183994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:42.183994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:42.183994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:42.183994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:42.183994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:42.183994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:42.184890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:42.184890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:42.184890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:42.184890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:42.184890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:42.184890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:42.184890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:42.184890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:42.184890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:42.184890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:42.184890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:42.184890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:42.184890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 302/608] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Sep 6 20:06:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:06:42.193020 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965469f2-0c8d-4e53-bdf0-10a5f66880d1 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:42.228915 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:42.244262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c868a7-148d-4469-8740-0a9e300bad04 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:42.305220 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484d2ef-3a73-4bd8-a536-77ad972d17ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:42.305839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484d2ef-3a73-4bd8-a536-77ad972d17ce None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:42.306172 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484d2ef-3a73-4bd8-a536-77ad972d17ce None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:42.306458 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484d2ef-3a73-4bd8-a536-77ad972d17ce None admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:42.307165 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484d2ef-3a73-4bd8-a536-77ad972d17ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:42.307509 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484d2ef-3a73-4bd8-a536-77ad972d17ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:42.308964 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484d2ef-3a73-4bd8-a536-77ad972d17ce None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:42.322216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 307/609] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:06:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:42.328648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484d2ef-3a73-4bd8-a536-77ad972d17ce None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:42.356067 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:42.378538 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965469f2-0c8d-4e53-bdf0-10a5f66880d1 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:42.419126 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662124c5-a668-469a-bef0-5e01f6d07865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:42.419892 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662124c5-a668-469a-bef0-5e01f6d07865 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:42.420237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662124c5-a668-469a-bef0-5e01f6d07865 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:42.420578 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662124c5-a668-469a-bef0-5e01f6d07865 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:42.421870 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662124c5-a668-469a-bef0-5e01f6d07865 None admin] RBAC: Adding query filter params (name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:42.422318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662124c5-a668-469a-bef0-5e01f6d07865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:42.423835 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662124c5-a668-469a-bef0-5e01f6d07865 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:42.434468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 303/610] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Sep 6 20:06:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:42.444546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662124c5-a668-469a-bef0-5e01f6d07865 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:42.543110 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484d2ef-3a73-4bd8-a536-77ad972d17ce None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:42.615836 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662124c5-a668-469a-bef0-5e01f6d07865 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:42.621923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:42.644439 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06fd58-d1f0-47dd-9185-f3a966909c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:42.645274 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06fd58-d1f0-47dd-9185-f3a966909c2b None admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:42.645556 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06fd58-d1f0-47dd-9185-f3a966909c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:42.645829 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06fd58-d1f0-47dd-9185-f3a966909c2b None admin] PATH_INFO: `/v3/projects/1b4323c35aef456b90ba9f1b7eb2b343/users/5a876d70d9634bf59af5f138e856f75f/roles/140b49dfcc2b489ca0504d2e7abfdbdb` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:42.680955 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06fd58-d1f0-47dd-9185-f3a966909c2b None admin] RBAC: Authorizing `identity:create_grant(project_id=1b4323c35aef456b90ba9f1b7eb2b343, user_id=5a876d70d9634bf59af5f138e856f75f, role_id=140b49dfcc2b489ca0504d2e7abfdbdb)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:42.682425 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06fd58-d1f0-47dd-9185-f3a966909c2b None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:42.694177 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345aa868-de9e-43ff-b1e3-55911bbe8f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:42.694826 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345aa868-de9e-43ff-b1e3-55911bbe8f4e None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:42.695108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345aa868-de9e-43ff-b1e3-55911bbe8f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:42.695429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345aa868-de9e-43ff-b1e3-55911bbe8f4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:42.707632 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345aa868-de9e-43ff-b1e3-55911bbe8f4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:42.709117 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345aa868-de9e-43ff-b1e3-55911bbe8f4e None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:42.712492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:42.726318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-345aa868-de9e-43ff-b1e3-55911bbe8f4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:42.726318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:42.726318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:42.726318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:42.726318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:42.726318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:42.726318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:42.726318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:42.726318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:42.726318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:42.726318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:42.726318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:42.726318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:42.726318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:42.726318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:42.726318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:42.727727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:42.727727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:42.727727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:42.727727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:42.727727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:42.727727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:42.727727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:42.727727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:42.727727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:42.727727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:42.727727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:42.727727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:42.727727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:42.727727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:42.727727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:42.727727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:42.727727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:42.728611 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:42.728611 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:42.728611 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:42.728611 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 304/611] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:42.734155 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345aa868-de9e-43ff-b1e3-55911bbe8f4e None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:42.765180 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 308/612] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Sep 6 20:06:42 2022] PUT /identity/v3/projects/1b4323c35aef456b90ba9f1b7eb2b343/users/5a876d70d9634bf59af5f138e856f75f/roles/140b49dfcc2b489ca0504d2e7abfdbdb => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:06:42.894102 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345aa868-de9e-43ff-b1e3-55911bbe8f4e None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:42.948805 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef454390-8a1f-4825-b9c5-5709241c1c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:42.949503 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef454390-8a1f-4825-b9c5-5709241c1c0d None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:42.949792 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef454390-8a1f-4825-b9c5-5709241c1c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:42.950068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef454390-8a1f-4825-b9c5-5709241c1c0d None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:42.950719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef454390-8a1f-4825-b9c5-5709241c1c0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:42.951025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef454390-8a1f-4825-b9c5-5709241c1c0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:42.952492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef454390-8a1f-4825-b9c5-5709241c1c0d None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:42.974357 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 305/613] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:42.979627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06fd58-d1f0-47dd-9185-f3a966909c2b None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:43.097828 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06fd58-d1f0-47dd-9185-f3a966909c2b None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:43.155242 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e377f-683b-4272-8a22-2f83f68a9fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:43.156824 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e377f-683b-4272-8a22-2f83f68a9fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:43.157331 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e377f-683b-4272-8a22-2f83f68a9fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:43.157804 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e377f-683b-4272-8a22-2f83f68a9fc0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:43.169217 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e377f-683b-4272-8a22-2f83f68a9fc0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:43.170996 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e377f-683b-4272-8a22-2f83f68a9fc0 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:43.184018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-0a1e377f-683b-4272-8a22-2f83f68a9fc0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 20:06:43.184018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:43.184018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:43.184018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:43.184018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:43.184018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:43.184018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:43.184018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:43.184018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:43.184018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:43.184018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:43.184018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:43.184018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:06:43.184018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:06:43.184018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:06:43.184018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:06:43.185127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:43.185127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:43.185127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:06:43.185127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:43.185127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:06:43.185127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:43.185127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:43.185127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:43.185127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:43.185127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:43.185127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:43.185127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:43.185127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:43.185127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:43.185127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:43.185127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:43.185127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:43.185127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:43.186053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:43.186053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:43.186053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:06:43.186053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:06:43.186053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:06:43.186053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:06:43.186053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:06:43.186053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:06:43.186053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 20:06:43.186053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:43.192451 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 309/614] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:06:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:43.198408 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef454390-8a1f-4825-b9c5-5709241c1c0d None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:43.289571 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:43.368346 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef454390-8a1f-4825-b9c5-5709241c1c0d None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:43.419783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d578f1-b50d-4043-86fb-e7c28b22c8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:43.420460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d578f1-b50d-4043-86fb-e7c28b22c8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:43.420709 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d578f1-b50d-4043-86fb-e7c28b22c8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:43.421020 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d578f1-b50d-4043-86fb-e7c28b22c8b8 None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:43.421819 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d578f1-b50d-4043-86fb-e7c28b22c8b8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:43.422131 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d578f1-b50d-4043-86fb-e7c28b22c8b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:43.423623 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d578f1-b50d-4043-86fb-e7c28b22c8b8 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:43.450821 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 306/615] 10.222.0.77 () {56 vars in 1135 bytes} [Tue Sep 6 20:06:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:43.457158 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e377f-683b-4272-8a22-2f83f68a9fc0 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:43.532198 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:43.615662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e377f-683b-4272-8a22-2f83f68a9fc0 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:43.677672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070684e3-1049-4f05-b6fb-77ac2b82f934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:43.678981 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070684e3-1049-4f05-b6fb-77ac2b82f934 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:43.679525 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070684e3-1049-4f05-b6fb-77ac2b82f934 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:43.679974 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070684e3-1049-4f05-b6fb-77ac2b82f934 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:43.695190 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070684e3-1049-4f05-b6fb-77ac2b82f934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:43.697002 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070684e3-1049-4f05-b6fb-77ac2b82f934 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:43.716387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-070684e3-1049-4f05-b6fb-77ac2b82f934 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:43.716387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:43.716387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:43.716387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:43.716387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:43.716387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:43.716387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:43.716387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:43.716387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:43.716387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:43.716387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:43.716387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:43.716387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:43.716387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:43.716387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:43.716387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:43.717352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:43.717352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:43.717352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:43.717352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:43.717352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:43.717352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:43.717352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:43.717352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:43.717352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:43.717352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:43.717352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:43.717352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:43.717352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:43.717352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:43.717352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:43.717352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:43.717352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:43.718423 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:43.718423 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:43.718423 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:43.720354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 310/616] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:43.727474 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d578f1-b50d-4043-86fb-e7c28b22c8b8 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:43.899273 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d578f1-b50d-4043-86fb-e7c28b22c8b8 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:43.918854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:43.958348 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5ea28-ea2b-48e4-ac07-cefe40b348e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:43.958889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5ea28-ea2b-48e4-ac07-cefe40b348e9 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:43.959167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5ea28-ea2b-48e4-ac07-cefe40b348e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:43.959482 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5ea28-ea2b-48e4-ac07-cefe40b348e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:43.960107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5ea28-ea2b-48e4-ac07-cefe40b348e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:43.960408 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5ea28-ea2b-48e4-ac07-cefe40b348e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:43.961771 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5ea28-ea2b-48e4-ac07-cefe40b348e9 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:43.975328 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 307/617] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:43.985148 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070684e3-1049-4f05-b6fb-77ac2b82f934 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:44.021034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c971c46-d463-434a-8b3b-e08d2ff3ad68 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:44.021374 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c971c46-d463-434a-8b3b-e08d2ff3ad68 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:44.021749 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c971c46-d463-434a-8b3b-e08d2ff3ad68 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:44.023492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 308/618] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:44.043079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326be164-7aaf-42d1-9f39-01a2ae519467 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:44.043625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326be164-7aaf-42d1-9f39-01a2ae519467 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:44.044008 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326be164-7aaf-42d1-9f39-01a2ae519467 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:44.045872 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 309/619] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:06:44.047783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1023cd-d199-4538-8578-2a5a832ae25e None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:44.048212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1023cd-d199-4538-8578-2a5a832ae25e None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:44.048587 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1023cd-d199-4538-8578-2a5a832ae25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:44.072890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-ba1023cd-d199-4538-8578-2a5a832ae25e None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:44.074669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ba1023cd-d199-4538-8578-2a5a832ae25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:44.113971 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:44.132849 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070684e3-1049-4f05-b6fb-77ac2b82f934 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:44.159902 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 310/620] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:44.159902 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff192ba3-6184-4416-9c54-b9ea2704851c None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:44.159902 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff192ba3-6184-4416-9c54-b9ea2704851c None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:44.159902 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff192ba3-6184-4416-9c54-b9ea2704851c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:44.178011 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-ff192ba3-6184-4416-9c54-b9ea2704851c None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:44.179637 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ff192ba3-6184-4416-9c54-b9ea2704851c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:44.189890 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced93886-0400-4c37-ba77-282d16514de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:44.190932 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced93886-0400-4c37-ba77-282d16514de3 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:44.191399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced93886-0400-4c37-ba77-282d16514de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:44.191901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced93886-0400-4c37-ba77-282d16514de3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:44.203855 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced93886-0400-4c37-ba77-282d16514de3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:44.212466 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced93886-0400-4c37-ba77-282d16514de3 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:44.241327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-ced93886-0400-4c37-ba77-282d16514de3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:44.241327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:44.241327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:44.241327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:44.241327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:44.241327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:44.241327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:44.241327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:44.241327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:44.241327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:44.241327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:44.241327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:44.241327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:06:44.241327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:06:44.241327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:06:44.242444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:06:44.242444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:44.242444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:44.242444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:44.242444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:44.242444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:44.242444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:44.242444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:44.242444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:44.242444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:44.242444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:44.242444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:44.242444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:44.242444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:44.242444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:44.242444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:44.242444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:44.243985 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:06:44.243985 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:06:44.243985 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:06:44.243985 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:06:44.243985 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:06:44.243985 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:06:44.243985 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:44.243985 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:44.243985 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 311/621] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:06:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:44.252790 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced93886-0400-4c37-ba77-282d16514de3 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:44.262554 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 311/622] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:44.370711 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057a67f-d5c6-46a6-a220-01a4f14f251e None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:44.371161 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057a67f-d5c6-46a6-a220-01a4f14f251e None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:44.371852 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057a67f-d5c6-46a6-a220-01a4f14f251e None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:44.373514 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 312/623] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:06:44.380247 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531084c-5bb2-45b6-86c3-75aadae79108 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:44.380661 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531084c-5bb2-45b6-86c3-75aadae79108 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:44.381037 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531084c-5bb2-45b6-86c3-75aadae79108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:44.399911 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced93886-0400-4c37-ba77-282d16514de3 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:44.413638 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-1531084c-5bb2-45b6-86c3-75aadae79108 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:44.414936 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-1531084c-5bb2-45b6-86c3-75aadae79108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:44.445839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474176d-00cb-4c19-b542-cad735a84101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:44.446725 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474176d-00cb-4c19-b542-cad735a84101 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:44.447155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474176d-00cb-4c19-b542-cad735a84101 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:44.447637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474176d-00cb-4c19-b542-cad735a84101 None admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:44.448599 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474176d-00cb-4c19-b542-cad735a84101 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:44.449101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474176d-00cb-4c19-b542-cad735a84101 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:44.450817 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474176d-00cb-4c19-b542-cad735a84101 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:44.451690 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:44.478994 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 312/624] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:06:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:44.483979 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474176d-00cb-4c19-b542-cad735a84101 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:44.504696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:44.507985 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 313/625] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 20:06:44.596718 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531084c-5bb2-45b6-86c3-75aadae79108 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:44.616701 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474176d-00cb-4c19-b542-cad735a84101 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:44.669306 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9554c-e347-4b10-bcb4-0a9ea3a96690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:44.669981 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9554c-e347-4b10-bcb4-0a9ea3a96690 None admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:44.670265 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9554c-e347-4b10-bcb4-0a9ea3a96690 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:44.670543 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9554c-e347-4b10-bcb4-0a9ea3a96690 None admin] PATH_INFO: `/v3/projects/1b4323c35aef456b90ba9f1b7eb2b343/users/5a6c4f91a59548fd979e7232a2afd6ec/roles/140b49dfcc2b489ca0504d2e7abfdbdb` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:44.687641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea9554c-e347-4b10-bcb4-0a9ea3a96690 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b4323c35aef456b90ba9f1b7eb2b343, user_id=5a6c4f91a59548fd979e7232a2afd6ec, role_id=140b49dfcc2b489ca0504d2e7abfdbdb)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:44.689096 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea9554c-e347-4b10-bcb4-0a9ea3a96690 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:44.760950 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531084c-5bb2-45b6-86c3-75aadae79108 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:44.769995 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 313/626] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Sep 6 20:06:44 2022] PUT /identity/v3/projects/1b4323c35aef456b90ba9f1b7eb2b343/users/5a6c4f91a59548fd979e7232a2afd6ec/roles/140b49dfcc2b489ca0504d2e7abfdbdb => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:06:44.771821 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9554c-e347-4b10-bcb4-0a9ea3a96690 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:44.824055 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56859f8-fb93-4b72-a205-d0da238eeadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:44.832558 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56859f8-fb93-4b72-a205-d0da238eeadf None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:44.833397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56859f8-fb93-4b72-a205-d0da238eeadf None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:44.833844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56859f8-fb93-4b72-a205-d0da238eeadf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:44.851060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56859f8-fb93-4b72-a205-d0da238eeadf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:44.858164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-a56859f8-fb93-4b72-a205-d0da238eeadf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:44.858164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:44.858164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:44.858164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:44.858164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:44.858164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:44.858164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:44.858164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:44.858164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:44.858164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:44.858164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:44.858164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:44.858164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:44.858164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:44.858164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:44.858164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:44.859887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:44.859887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:44.859887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:44.859887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:44.859887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:44.859887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:44.859887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:44.859887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:44.859887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:44.859887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:44.859887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:44.859887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:44.859887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:44.859887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:44.859887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:44.859887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:44.860823 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:44.860823 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:44.860823 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:44.860823 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:44.860823 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:44.860823 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:44.860823 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:44.860823 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:44.860823 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:44.860823 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:44.860823 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:44.860823 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:44.863935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 314/627] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Sep 6 20:06:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:06:44.865346 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56859f8-fb93-4b72-a205-d0da238eeadf None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:44.883271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:44.903568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:44.940130 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9554c-e347-4b10-bcb4-0a9ea3a96690 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:44.991591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28159e-2333-4141-9897-71744e106111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:44.992586 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28159e-2333-4141-9897-71744e106111 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:44.992871 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28159e-2333-4141-9897-71744e106111 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:44.994205 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28159e-2333-4141-9897-71744e106111 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:45.009615 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28159e-2333-4141-9897-71744e106111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:45.017349 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-fa28159e-2333-4141-9897-71744e106111 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:45.017349 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:45.017349 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:45.017349 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:45.017349 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:45.017349 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:45.017349 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:45.017349 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:45.017349 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:45.017349 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:45.017349 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:45.017349 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:45.017349 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:45.017349 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:45.017349 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:45.017349 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:45.018327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:45.018327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:45.018327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:45.018327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:45.018327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:45.018327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:45.018327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:45.018327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:45.018327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:45.018327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:45.018327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:45.018327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:45.018327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:45.018327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:45.018327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:45.018327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:45.019154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:45.019154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:45.019154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:45.019154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:45.019154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:45.019154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:45.019154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:45.019154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:45.019154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:45.019154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:45.019154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:45.019154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:45.019154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 314/628] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Sep 6 20:06:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:45.020471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28159e-2333-4141-9897-71744e106111 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:45.037497 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56859f8-fb93-4b72-a205-d0da238eeadf None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:45.093820 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1c0fb-d34f-4367-bdf8-8d51ac305bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:45.094485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1c0fb-d34f-4367-bdf8-8d51ac305bdf None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:45.094764 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1c0fb-d34f-4367-bdf8-8d51ac305bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:45.095033 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1c0fb-d34f-4367-bdf8-8d51ac305bdf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:45.110563 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1c0fb-d34f-4367-bdf8-8d51ac305bdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:45.116958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-5bb1c0fb-d34f-4367-bdf8-8d51ac305bdf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:45.116958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:45.116958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:45.116958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:45.116958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:45.116958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:45.116958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:45.116958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:45.116958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:45.116958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:45.116958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:45.116958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:45.116958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:45.116958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:45.116958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:45.116958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:45.117987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:45.117987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:45.117987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:45.117987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:45.117987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:45.117987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:45.117987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:45.117987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:45.117987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:45.117987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:45.117987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:45.117987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:45.117987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:45.117987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:45.117987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:45.117987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:45.118937 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:45.118937 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:45.118937 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:45.118937 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:45.118937 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:45.118937 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:45.118937 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:45.118937 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:45.118937 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:45.118937 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:45.118937 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:45.118937 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:45.118937 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 315/629] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Sep 6 20:06:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:45.120343 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1c0fb-d34f-4367-bdf8-8d51ac305bdf None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:45.148885 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28159e-2333-4141-9897-71744e106111 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:45.166939 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:45.186244 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4361d8-0d71-4dbe-8eab-a5ba270f7d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:45.187408 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4361d8-0d71-4dbe-8eab-a5ba270f7d5e None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:45.187742 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4361d8-0d71-4dbe-8eab-a5ba270f7d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:45.188040 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4361d8-0d71-4dbe-8eab-a5ba270f7d5e None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:45.188781 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4361d8-0d71-4dbe-8eab-a5ba270f7d5e None admin] RBAC: Adding query filter params (name=service) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:45.189091 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4361d8-0d71-4dbe-8eab-a5ba270f7d5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:45.190598 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4361d8-0d71-4dbe-8eab-a5ba270f7d5e None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:45.201099 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 315/630] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Sep 6 20:06:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:45.202065 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4361d8-0d71-4dbe-8eab-a5ba270f7d5e None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:45.216165 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:45.237157 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1c0fb-d34f-4367-bdf8-8d51ac305bdf None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:45.276892 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce5071-99ed-41a3-9530-1bbbc8787df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:45.277421 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce5071-99ed-41a3-9530-1bbbc8787df1 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:45.277699 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce5071-99ed-41a3-9530-1bbbc8787df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:45.277960 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce5071-99ed-41a3-9530-1bbbc8787df1 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:45.278640 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce5071-99ed-41a3-9530-1bbbc8787df1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:45.278943 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce5071-99ed-41a3-9530-1bbbc8787df1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:45.280407 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce5071-99ed-41a3-9530-1bbbc8787df1 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:45.289606 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 316/631] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Sep 6 20:06:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:45.290486 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce5071-99ed-41a3-9530-1bbbc8787df1 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:45.326582 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4361d8-0d71-4dbe-8eab-a5ba270f7d5e None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:45.366097 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dc604-dd55-4455-babc-b6c52e43c85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:45.366711 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dc604-dd55-4455-babc-b6c52e43c85c None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:45.366987 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dc604-dd55-4455-babc-b6c52e43c85c None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:45.367325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dc604-dd55-4455-babc-b6c52e43c85c None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:45.368079 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67dc604-dd55-4455-babc-b6c52e43c85c None admin] RBAC: Adding query filter params (name=service) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:45.368379 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67dc604-dd55-4455-babc-b6c52e43c85c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:45.369781 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67dc604-dd55-4455-babc-b6c52e43c85c None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:45.386453 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 316/632] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Sep 6 20:06:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:45.386453 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dc604-dd55-4455-babc-b6c52e43c85c None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:45.450376 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce5071-99ed-41a3-9530-1bbbc8787df1 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:45.459999 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:45.504234 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f518c6-98e1-43e5-95b7-7f1047529881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:45.505196 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f518c6-98e1-43e5-95b7-7f1047529881 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:45.505757 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f518c6-98e1-43e5-95b7-7f1047529881 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:45.506332 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f518c6-98e1-43e5-95b7-7f1047529881 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:45.521489 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f518c6-98e1-43e5-95b7-7f1047529881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:45.523410 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f518c6-98e1-43e5-95b7-7f1047529881 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:45.525951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:45.538145 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dc604-dd55-4455-babc-b6c52e43c85c None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:45.542107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-a1f518c6-98e1-43e5-95b7-7f1047529881 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:45.542107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:45.542107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:45.542107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:45.542107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:45.542107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:45.542107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:45.542107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:45.542107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:45.542107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:45.542107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:45.542107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:45.542107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:45.542107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:45.542107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:45.542107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:45.543192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:45.543192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:45.543192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:45.543192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:45.543192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:45.543192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:45.543192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:45.543192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:45.543192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:45.543192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:45.543192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:45.543192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:45.543192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:45.543192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:45.543192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:45.543192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:45.543192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:45.544159 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:45.544159 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:45.544159 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:45.544495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 317/633] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:45.545527 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f518c6-98e1-43e5-95b7-7f1047529881 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:45.586894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9e734-6534-4e44-b615-71a7ffcff622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:45.587888 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9e734-6534-4e44-b615-71a7ffcff622 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:45.588198 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9e734-6534-4e44-b615-71a7ffcff622 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:45.588447 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9e734-6534-4e44-b615-71a7ffcff622 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:45.603614 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9e734-6534-4e44-b615-71a7ffcff622 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:45.605039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9e734-6534-4e44-b615-71a7ffcff622 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:45.620732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-0ed9e734-6534-4e44-b615-71a7ffcff622 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:45.620732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:45.620732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:45.620732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:45.620732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:45.620732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:45.620732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:45.620732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:45.620732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:45.620732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:45.620732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:45.620732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:45.620732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:45.620732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:45.620732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:45.620732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:45.629723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:45.629723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:45.629723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:45.629723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:45.629723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:45.629723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:45.629723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:45.629723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:45.629723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:45.629723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:45.629723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:45.629723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:45.629723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:45.629723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:45.629723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:45.629723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:45.629723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:45.631973 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:45.631973 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:45.631973 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:45.631973 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 317/634] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:45.631973 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9e734-6534-4e44-b615-71a7ffcff622 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:45.676068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f518c6-98e1-43e5-95b7-7f1047529881 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:45.715931 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f69620-60d2-48d1-9c07-f474ea4387e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:45.716604 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f69620-60d2-48d1-9c07-f474ea4387e5 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:45.716996 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f69620-60d2-48d1-9c07-f474ea4387e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:45.717278 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f69620-60d2-48d1-9c07-f474ea4387e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:45.728316 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:45.730827 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f69620-60d2-48d1-9c07-f474ea4387e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:45.732319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f69620-60d2-48d1-9c07-f474ea4387e5 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:45.737709 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9e734-6534-4e44-b615-71a7ffcff622 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:45.748935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-44f69620-60d2-48d1-9c07-f474ea4387e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:45.748935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:45.748935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:45.748935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:45.748935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:45.748935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:45.748935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:45.748935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:45.748935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:45.748935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:45.748935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:45.748935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:45.748935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:45.748935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:45.748935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:45.748935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:45.750496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:45.750496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:45.750496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:45.750496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:45.750496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:45.750496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:45.750496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:45.750496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:45.750496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:45.750496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:45.750496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:45.750496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:45.750496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:45.750496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:45.750496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:45.750496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:45.750496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:45.751386 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:45.751386 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:45.751386 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:45.755639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 318/635] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:45.757143 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ed100-2da0-4f33-a3c1-7fb958cfbba2 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:45.757451 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ed100-2da0-4f33-a3c1-7fb958cfbba2 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:45.757768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ed100-2da0-4f33-a3c1-7fb958cfbba2 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:45.759285 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 319/636] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:45.763464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ed100-2da0-4f33-a3c1-7fb958cfbba2 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:45.783566 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a66107-eb55-4c9f-8b07-e263dc8766b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:45.784564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a66107-eb55-4c9f-8b07-e263dc8766b1 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:45.785038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a66107-eb55-4c9f-8b07-e263dc8766b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:45.785540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a66107-eb55-4c9f-8b07-e263dc8766b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:45.786393 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a66107-eb55-4c9f-8b07-e263dc8766b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:45.786904 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a66107-eb55-4c9f-8b07-e263dc8766b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:45.788721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a66107-eb55-4c9f-8b07-e263dc8766b1 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:45.806382 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 318/637] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:45.806382 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a66107-eb55-4c9f-8b07-e263dc8766b1 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:45.820260 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:45.881191 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ed100-2da0-4f33-a3c1-7fb958cfbba2 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:45.922521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96e44b-1ee3-44c5-ad1f-52af3bafed4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:45.923161 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96e44b-1ee3-44c5-ad1f-52af3bafed4e None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:45.923466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96e44b-1ee3-44c5-ad1f-52af3bafed4e None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:45.923732 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96e44b-1ee3-44c5-ad1f-52af3bafed4e None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:45.924659 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96e44b-1ee3-44c5-ad1f-52af3bafed4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:45.924659 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96e44b-1ee3-44c5-ad1f-52af3bafed4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:45.926049 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96e44b-1ee3-44c5-ad1f-52af3bafed4e None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:45.932220 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a66107-eb55-4c9f-8b07-e263dc8766b1 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:45.942321 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 320/638] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:45.942321 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee57e8-9b31-4065-8bfa-5b9bb8a4fe85 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:45.942321 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee57e8-9b31-4065-8bfa-5b9bb8a4fe85 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:45.942321 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee57e8-9b31-4065-8bfa-5b9bb8a4fe85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:45.965846 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-96ee57e8-9b31-4065-8bfa-5b9bb8a4fe85 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:45.967393 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-96ee57e8-9b31-4065-8bfa-5b9bb8a4fe85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:45.976845 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54c9b1-577b-4c81-8ef6-82313ce9705c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:45.977469 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54c9b1-577b-4c81-8ef6-82313ce9705c None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:45.977752 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54c9b1-577b-4c81-8ef6-82313ce9705c None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:45.978022 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54c9b1-577b-4c81-8ef6-82313ce9705c None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:45.979113 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54c9b1-577b-4c81-8ef6-82313ce9705c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:45.979113 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54c9b1-577b-4c81-8ef6-82313ce9705c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:45.980366 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54c9b1-577b-4c81-8ef6-82313ce9705c None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:45.994817 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 319/639] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:45.996236 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54c9b1-577b-4c81-8ef6-82313ce9705c None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:46.013066 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:46.051860 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 321/640] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:46.052634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee57e8-9b31-4065-8bfa-5b9bb8a4fe85 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:46.101211 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:46.132762 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54c9b1-577b-4c81-8ef6-82313ce9705c None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:46.175327 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee57e8-9b31-4065-8bfa-5b9bb8a4fe85 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:46.186393 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32721ff-1233-4777-be6c-8a832d6519cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:46.187943 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32721ff-1233-4777-be6c-8a832d6519cd None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:46.188735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32721ff-1233-4777-be6c-8a832d6519cd None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:46.189252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32721ff-1233-4777-be6c-8a832d6519cd None admin] PATH_INFO: `/v3/users/glance` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:46.200314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32721ff-1233-4777-be6c-8a832d6519cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:46.203481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32721ff-1233-4777-be6c-8a832d6519cd None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:46.214594 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddfa59-f9ae-4c30-b6ac-4063999847eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:46.215286 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddfa59-f9ae-4c30-b6ac-4063999847eb None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:46.215601 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddfa59-f9ae-4c30-b6ac-4063999847eb None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:46.215873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddfa59-f9ae-4c30-b6ac-4063999847eb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:46.221373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-a32721ff-1233-4777-be6c-8a832d6519cd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 06 20:06:46.221373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:46.221373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:46.221373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:46.221373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:46.221373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:46.221373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:46.221373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:46.221373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:46.221373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:46.221373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:46.221373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:46.221373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:06:46.221373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:06:46.221373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:06:46.221373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:06:46.222373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:46.222373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:46.222373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:06:46.222373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:46.222373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:06:46.222373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:46.222373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:46.222373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:46.222373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:46.222373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:46.222373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:46.222373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:46.222373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:46.222373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:46.222373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:46.222373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:46.222373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:46.222373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:46.223353 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:46.223353 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:46.223353 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:06:46.223353 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:06:46.223353 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:06:46.223353 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:06:46.223353 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:06:46.223353 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:06:46.223353 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 06 20:06:46.223353 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:46.225601 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddfa59-f9ae-4c30-b6ac-4063999847eb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:46.226056 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 320/641] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:06:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:46.227166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32721ff-1233-4777-be6c-8a832d6519cd None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:46.227471 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddfa59-f9ae-4c30-b6ac-4063999847eb None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:46.245201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-89ddfa59-f9ae-4c30-b6ac-4063999847eb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 20:06:46.245201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:46.245201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:46.245201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:46.245201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:46.245201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:46.245201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:46.245201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:46.245201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:46.245201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:46.245201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:46.245201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:46.245201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:06:46.245201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:06:46.245201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:06:46.245201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:06:46.246535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:46.246535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:46.246535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:06:46.246535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:46.246535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:06:46.246535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:46.246535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:46.246535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:46.246535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:46.246535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:46.246535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:46.246535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:46.246535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:46.246535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:46.246535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:46.246535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:46.246535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:46.246535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:46.247765 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:46.247765 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:46.247765 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:06:46.247765 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:06:46.247765 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:06:46.247765 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:06:46.247765 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:06:46.247765 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:06:46.247765 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 20:06:46.247765 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:46.249608 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 322/642] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Sep 6 20:06:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:46.250845 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddfa59-f9ae-4c30-b6ac-4063999847eb None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:46.322518 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:46.361275 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32721ff-1233-4777-be6c-8a832d6519cd None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:46.392190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:46.397206 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df54b69-ae99-4aa2-a83e-360d9acd41e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:46.397848 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df54b69-ae99-4aa2-a83e-360d9acd41e0 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:46.398127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df54b69-ae99-4aa2-a83e-360d9acd41e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:46.398396 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df54b69-ae99-4aa2-a83e-360d9acd41e0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:46.401083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddfa59-f9ae-4c30-b6ac-4063999847eb None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:46.409834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df54b69-ae99-4aa2-a83e-360d9acd41e0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:46.411316 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df54b69-ae99-4aa2-a83e-360d9acd41e0 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:46.427719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-6df54b69-ae99-4aa2-a83e-360d9acd41e0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 20:06:46.427719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:46.427719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:46.427719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:46.427719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:46.427719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:46.427719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:46.427719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:46.427719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:46.427719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:46.427719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:46.427719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:46.427719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:06:46.427719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:06:46.427719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:06:46.427719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:06:46.429309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:46.429309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:46.429309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:06:46.429309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:46.429309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:06:46.429309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:46.429309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:46.429309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:46.429309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:46.429309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:46.429309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:46.429309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:46.429309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:46.429309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:46.429309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:46.429309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:46.429309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:46.429309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:46.430703 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:46.430703 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:46.430703 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:06:46.430703 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:06:46.430703 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:06:46.430703 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:06:46.430703 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:06:46.430703 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:06:46.430703 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 20:06:46.430703 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:46.430703 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 321/643] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:06:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:46.430703 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df54b69-ae99-4aa2-a83e-360d9acd41e0 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:46.453571 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df61f7-faea-474f-ab24-4f87e43e8c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:46.454198 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df61f7-faea-474f-ab24-4f87e43e8c3d None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:46.454478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df61f7-faea-474f-ab24-4f87e43e8c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:46.454739 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df61f7-faea-474f-ab24-4f87e43e8c3d None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:46.456015 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df61f7-faea-474f-ab24-4f87e43e8c3d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:46.456322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df61f7-faea-474f-ab24-4f87e43e8c3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:46.457945 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35df61f7-faea-474f-ab24-4f87e43e8c3d None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:46.477380 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 323/644] 10.222.0.77 () {56 vars in 1137 bytes} [Tue Sep 6 20:06:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:46.478232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df61f7-faea-474f-ab24-4f87e43e8c3d None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:46.549695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df54b69-ae99-4aa2-a83e-360d9acd41e0 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:46.583611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:46.589411 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20ea7d-327c-4f45-be58-a719c48f2f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:46.590034 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20ea7d-327c-4f45-be58-a719c48f2f38 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:46.590319 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20ea7d-327c-4f45-be58-a719c48f2f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:46.590587 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20ea7d-327c-4f45-be58-a719c48f2f38 None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:46.593881 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20ea7d-327c-4f45-be58-a719c48f2f38 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:46.593881 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20ea7d-327c-4f45-be58-a719c48f2f38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:46.593881 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20ea7d-327c-4f45-be58-a719c48f2f38 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:46.596311 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df61f7-faea-474f-ab24-4f87e43e8c3d None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:46.620069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 322/645] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Sep 6 20:06:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:46.620069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20ea7d-327c-4f45-be58-a719c48f2f38 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:46.641451 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19874454-ad47-450e-89a0-6f3a5d0caa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:46.642084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19874454-ad47-450e-89a0-6f3a5d0caa77 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:46.642363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19874454-ad47-450e-89a0-6f3a5d0caa77 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:46.642631 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19874454-ad47-450e-89a0-6f3a5d0caa77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:46.653541 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19874454-ad47-450e-89a0-6f3a5d0caa77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:46.658951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-19874454-ad47-450e-89a0-6f3a5d0caa77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:46.658951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:46.658951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:46.658951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:46.658951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:46.658951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:46.658951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:46.658951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:46.658951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:46.658951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:46.658951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:46.658951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:46.658951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:46.658951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:46.658951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:46.658951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:46.659988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:46.659988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:46.659988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:46.659988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:46.659988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:46.659988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:46.659988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:46.659988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:46.659988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:46.659988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:46.659988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:46.659988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:46.659988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:46.659988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:46.659988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:46.659988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:46.660863 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:46.660863 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:46.660863 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:46.660863 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:46.660863 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:46.660863 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:46.660863 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:46.660863 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:46.660863 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:46.660863 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:46.660863 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:46.660863 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:46.660863 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 324/646] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Sep 6 20:06:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:46.661543 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19874454-ad47-450e-89a0-6f3a5d0caa77 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:46.681575 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:46.745089 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20ea7d-327c-4f45-be58-a719c48f2f38 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:46.784435 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19874454-ad47-450e-89a0-6f3a5d0caa77 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:46.787992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32223f1e-8eef-4b5d-ba2a-20eda1d29a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:46.788815 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32223f1e-8eef-4b5d-ba2a-20eda1d29a60 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:46.789177 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32223f1e-8eef-4b5d-ba2a-20eda1d29a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:46.789478 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32223f1e-8eef-4b5d-ba2a-20eda1d29a60 None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:46.790470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32223f1e-8eef-4b5d-ba2a-20eda1d29a60 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:46.790909 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32223f1e-8eef-4b5d-ba2a-20eda1d29a60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:46.792853 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32223f1e-8eef-4b5d-ba2a-20eda1d29a60 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:46.818728 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 323/647] 10.222.0.77 () {56 vars in 1137 bytes} [Tue Sep 6 20:06:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:46.818728 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32223f1e-8eef-4b5d-ba2a-20eda1d29a60 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:46.831403 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b669f53-b56e-4879-b88d-0d382fb92602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:46.832051 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b669f53-b56e-4879-b88d-0d382fb92602 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:46.832326 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b669f53-b56e-4879-b88d-0d382fb92602 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:46.832598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b669f53-b56e-4879-b88d-0d382fb92602 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:46.896978 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:46.929203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b669f53-b56e-4879-b88d-0d382fb92602 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:46.931737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b669f53-b56e-4879-b88d-0d382fb92602 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:46.952261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:46.968953 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32223f1e-8eef-4b5d-ba2a-20eda1d29a60 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:47.012936 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5830b9-734e-4c5d-8453-af478c013533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:47.013584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5830b9-734e-4c5d-8453-af478c013533 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:47.013861 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5830b9-734e-4c5d-8453-af478c013533 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:47.014134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5830b9-734e-4c5d-8453-af478c013533 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:47.066931 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 325/648] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:06:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:06:47.069162 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b669f53-b56e-4879-b88d-0d382fb92602 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:47.094868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5830b9-734e-4c5d-8453-af478c013533 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:47.096867 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5830b9-734e-4c5d-8453-af478c013533 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:47.153227 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:47.184207 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b669f53-b56e-4879-b88d-0d382fb92602 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:47.199114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:47.213197 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 324/649] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:06:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:06:47.214066 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5830b9-734e-4c5d-8453-af478c013533 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:47.227044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6f1a5-6a28-4f26-8b0c-e7230c851f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:47.228288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6f1a5-6a28-4f26-8b0c-e7230c851f30 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:47.228991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6f1a5-6a28-4f26-8b0c-e7230c851f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:47.229876 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6f1a5-6a28-4f26-8b0c-e7230c851f30 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:47.230768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6f1a5-6a28-4f26-8b0c-e7230c851f30 None admin] RBAC: Adding query filter params (name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:47.231472 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6f1a5-6a28-4f26-8b0c-e7230c851f30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:47.233202 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6f1a5-6a28-4f26-8b0c-e7230c851f30 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:47.249905 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 326/650] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Sep 6 20:06:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:47.249905 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6f1a5-6a28-4f26-8b0c-e7230c851f30 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:47.375052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5830b9-734e-4c5d-8453-af478c013533 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:47.417591 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6f1a5-6a28-4f26-8b0c-e7230c851f30 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:47.417855 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c40de-7a51-470b-b5fb-4f0ca0dbdc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:47.417855 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c40de-7a51-470b-b5fb-4f0ca0dbdc80 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:47.417855 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c40de-7a51-470b-b5fb-4f0ca0dbdc80 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:47.417855 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c40de-7a51-470b-b5fb-4f0ca0dbdc80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:47.441889 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:47.452429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe83e28-8c61-4b94-8e46-a8953fd3cd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:47.453659 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe83e28-8c61-4b94-8e46-a8953fd3cd77 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:47.453949 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe83e28-8c61-4b94-8e46-a8953fd3cd77 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:47.454334 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe83e28-8c61-4b94-8e46-a8953fd3cd77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:47.466164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe83e28-8c61-4b94-8e46-a8953fd3cd77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:47.467773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe83e28-8c61-4b94-8e46-a8953fd3cd77 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:47.483782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-6fe83e28-8c61-4b94-8e46-a8953fd3cd77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:47.483782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:47.483782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:47.483782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:47.483782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:47.483782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:47.483782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:47.483782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:47.483782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:47.483782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:47.483782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:47.483782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:47.483782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:47.483782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:47.483782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:47.483782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:47.486084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:47.486084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:47.486084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:47.486084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:47.486084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:47.486084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:47.486084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:47.486084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:47.486084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:47.486084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:47.486084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:47.486084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:47.486084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:47.486084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:47.486084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:47.486084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:47.486084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:47.488564 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:47.488564 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:47.488564 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:47.488564 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 327/651] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:47.488564 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe83e28-8c61-4b94-8e46-a8953fd3cd77 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:47.506515 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c40de-7a51-470b-b5fb-4f0ca0dbdc80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:47.508002 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c40de-7a51-470b-b5fb-4f0ca0dbdc80 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:47.523339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:47.607934 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe83e28-8c61-4b94-8e46-a8953fd3cd77 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:47.614906 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 325/652] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:06:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:06:47.615771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c40de-7a51-470b-b5fb-4f0ca0dbdc80 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:47.648947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd888a-a210-45b6-8e87-d201086ba10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:47.649587 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd888a-a210-45b6-8e87-d201086ba10e None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:47.650174 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd888a-a210-45b6-8e87-d201086ba10e None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:47.650174 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd888a-a210-45b6-8e87-d201086ba10e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:47.661507 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd888a-a210-45b6-8e87-d201086ba10e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:47.662961 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd888a-a210-45b6-8e87-d201086ba10e None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:47.677489 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:47.680313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-59bd888a-a210-45b6-8e87-d201086ba10e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:47.680313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:47.680313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:47.680313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:47.680313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:47.680313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:47.680313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:47.680313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:47.680313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:47.680313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:47.680313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:47.680313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:47.680313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:47.680313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:47.680313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:47.680313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:47.681233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:47.681233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:47.681233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:47.681233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:47.681233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:47.681233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:47.681233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:47.681233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:47.681233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:47.681233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:47.681233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:47.681233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:47.681233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:47.681233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:47.681233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:47.681233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:47.681233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:47.682941 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:47.682941 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:47.682941 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:47.682941 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 328/653] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:47.682941 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c37451-4664-4963-aa9d-849f5b571323 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:47.682941 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c37451-4664-4963-aa9d-849f5b571323 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:47.683329 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c37451-4664-4963-aa9d-849f5b571323 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:47.687675 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 329/654] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:47.687675 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c37451-4664-4963-aa9d-849f5b571323 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:47.745091 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c40de-7a51-470b-b5fb-4f0ca0dbdc80 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:47.772892 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:47.783851 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9958657-22ea-44e8-af74-6f21fb077834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:47.789255 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9958657-22ea-44e8-af74-6f21fb077834 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:47.789255 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9958657-22ea-44e8-af74-6f21fb077834 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:47.789255 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9958657-22ea-44e8-af74-6f21fb077834 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:47.795642 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c37451-4664-4963-aa9d-849f5b571323 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:47.815753 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9958657-22ea-44e8-af74-6f21fb077834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:47.817379 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9958657-22ea-44e8-af74-6f21fb077834 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:47.832759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-f9958657-22ea-44e8-af74-6f21fb077834 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:47.832759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:47.832759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:47.832759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:47.832759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:47.832759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:47.832759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:47.832759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:47.832759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:47.832759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:47.832759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:47.832759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:47.832759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:47.832759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:47.832759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:47.832759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:47.834057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:47.834057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:47.834057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:47.834057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:47.834057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:47.834057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:47.834057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:47.834057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:47.834057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:47.834057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:47.834057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:47.834057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:47.834057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:47.834057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:47.834057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:47.834057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:47.834057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:47.835344 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:47.835344 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:47.835344 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:47.835344 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 326/655] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:47.835344 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9958657-22ea-44e8-af74-6f21fb077834 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:47.837049 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc79e95-22cd-4844-bb81-84159179da93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:47.837548 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc79e95-22cd-4844-bb81-84159179da93 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:47.838127 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc79e95-22cd-4844-bb81-84159179da93 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:47.838780 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc79e95-22cd-4844-bb81-84159179da93 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:47.840284 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc79e95-22cd-4844-bb81-84159179da93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:47.840655 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc79e95-22cd-4844-bb81-84159179da93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:47.842177 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc79e95-22cd-4844-bb81-84159179da93 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:47.861289 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 330/656] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:47.861289 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc79e95-22cd-4844-bb81-84159179da93 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:47.941328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:47.944536 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9958657-22ea-44e8-af74-6f21fb077834 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:47.976510 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc79e95-22cd-4844-bb81-84159179da93 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:47.980115 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab85a16-e6ce-4e4a-b19c-149a83ba5b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:47.980739 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab85a16-e6ce-4e4a-b19c-149a83ba5b9b None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:47.981285 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab85a16-e6ce-4e4a-b19c-149a83ba5b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:47.981621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab85a16-e6ce-4e4a-b19c-149a83ba5b9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:47.993357 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab85a16-e6ce-4e4a-b19c-149a83ba5b9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:47.994800 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab85a16-e6ce-4e4a-b19c-149a83ba5b9b None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:48.009792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-fab85a16-e6ce-4e4a-b19c-149a83ba5b9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:48.009792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:48.009792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:48.009792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:48.009792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:48.009792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:48.009792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:48.009792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:48.009792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:48.009792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:48.009792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:48.009792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:48.009792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:48.009792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:48.009792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:48.009792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:48.010872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:48.010872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:48.010872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:48.010872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:48.010872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:48.010872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:48.010872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:48.010872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:48.010872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:48.010872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:48.010872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:48.010872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:48.010872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:48.010872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:48.010872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:48.010872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:48.010872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:48.011882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:48.011882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:48.011882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:48.011882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 327/657] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:48.012485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3d9e7-e05d-439b-a510-5933048a128c None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:48.012655 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3d9e7-e05d-439b-a510-5933048a128c None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:48.012920 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3d9e7-e05d-439b-a510-5933048a128c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:48.017287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381fdb5-26af-4217-85f7-cb513b07f805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:48.017911 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381fdb5-26af-4217-85f7-cb513b07f805 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:48.018204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381fdb5-26af-4217-85f7-cb513b07f805 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:48.018469 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381fdb5-26af-4217-85f7-cb513b07f805 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:48.019120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381fdb5-26af-4217-85f7-cb513b07f805 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:48.019422 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381fdb5-26af-4217-85f7-cb513b07f805 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:48.020832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381fdb5-26af-4217-85f7-cb513b07f805 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:48.031189 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:48.031426 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-4ac3d9e7-e05d-439b-a510-5933048a128c None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:48.032711 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-4ac3d9e7-e05d-439b-a510-5933048a128c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:48.035114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 331/658] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:48.036029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381fdb5-26af-4217-85f7-cb513b07f805 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:48.106045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 328/659] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:48.106866 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3d9e7-e05d-439b-a510-5933048a128c None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:48.141140 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381fdb5-26af-4217-85f7-cb513b07f805 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:48.180799 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ae3b1-e4e4-4f36-af15-e2c7cd697ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:48.181411 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ae3b1-e4e4-4f36-af15-e2c7cd697ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:48.181695 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ae3b1-e4e4-4f36-af15-e2c7cd697ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:48.181967 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ae3b1-e4e4-4f36-af15-e2c7cd697ca3 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:48.182615 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ae3b1-e4e4-4f36-af15-e2c7cd697ca3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:48.182920 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ae3b1-e4e4-4f36-af15-e2c7cd697ca3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:48.184326 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ae3b1-e4e4-4f36-af15-e2c7cd697ca3 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:48.196806 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 332/660] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:48.197388 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ae3b1-e4e4-4f36-af15-e2c7cd697ca3 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:48.212909 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:48.234189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3d9e7-e05d-439b-a510-5933048a128c None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:48.265581 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:48.273804 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d37ec-92a1-4c95-94ef-61393652a424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:48.274576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d37ec-92a1-4c95-94ef-61393652a424 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:48.274960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d37ec-92a1-4c95-94ef-61393652a424 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:48.275233 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d37ec-92a1-4c95-94ef-61393652a424 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:48.284337 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d37ec-92a1-4c95-94ef-61393652a424 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:48.285925 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d37ec-92a1-4c95-94ef-61393652a424 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:48.299134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-9a6d37ec-92a1-4c95-94ef-61393652a424 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:48.299134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:48.299134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:48.299134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:48.299134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:48.299134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:48.299134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:48.299134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:48.299134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:48.299134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:48.299134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:48.299134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:48.299134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:06:48.299134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:06:48.299134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:06:48.300901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:06:48.300901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:48.300901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:48.300901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:48.300901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:48.300901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:48.300901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:48.300901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:48.300901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:48.300901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:48.300901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:48.300901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:48.300901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:48.300901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:48.300901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:48.300901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:48.300901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:48.302673 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:06:48.302673 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:06:48.302673 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:06:48.302673 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:06:48.302673 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:06:48.302673 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:06:48.302673 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:48.302673 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:48.306851 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 329/661] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:06:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:48.307979 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d37ec-92a1-4c95-94ef-61393652a424 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:48.318072 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ae3b1-e4e4-4f36-af15-e2c7cd697ca3 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:48.357867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6f535-7d08-4137-86ce-f3991abed51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:48.358901 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6f535-7d08-4137-86ce-f3991abed51a None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:48.359276 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6f535-7d08-4137-86ce-f3991abed51a None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:48.359653 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6f535-7d08-4137-86ce-f3991abed51a None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:48.360367 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6f535-7d08-4137-86ce-f3991abed51a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:48.360765 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6f535-7d08-4137-86ce-f3991abed51a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:48.362225 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6f535-7d08-4137-86ce-f3991abed51a None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:48.375178 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 333/662] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:48.378032 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6f535-7d08-4137-86ce-f3991abed51a None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:48.427661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d37ec-92a1-4c95-94ef-61393652a424 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:48.461899 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912443a-4d9f-41ba-9547-9a9b7154a9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:48.462490 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912443a-4d9f-41ba-9547-9a9b7154a9d7 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:48.462769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912443a-4d9f-41ba-9547-9a9b7154a9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:48.463036 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912443a-4d9f-41ba-9547-9a9b7154a9d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:48.469843 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912443a-4d9f-41ba-9547-9a9b7154a9d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:48.471285 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912443a-4d9f-41ba-9547-9a9b7154a9d7 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:48.483970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-3912443a-4d9f-41ba-9547-9a9b7154a9d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:48.483970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:48.483970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:48.483970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:48.483970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:48.483970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:48.483970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:48.483970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:48.483970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:48.483970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:48.483970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:48.483970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:48.483970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:06:48.483970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:06:48.483970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:06:48.484901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:06:48.484901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:48.484901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:48.484901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:48.484901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:48.484901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:48.484901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:48.484901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:48.484901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:48.484901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:48.484901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:48.484901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:48.484901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:48.484901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:48.484901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:48.484901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:48.484901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:48.486012 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:06:48.486012 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:06:48.486012 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:06:48.486012 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:06:48.486012 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:06:48.486012 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:06:48.486012 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:48.486012 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:48.486012 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 330/663] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:06:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:48.486521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6f535-7d08-4137-86ce-f3991abed51a None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:48.486596 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912443a-4d9f-41ba-9547-9a9b7154a9d7 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:48.493045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:48.514979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:48.529890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e351a2-0556-4bde-ae89-5f4ea88a1bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:48.530541 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e351a2-0556-4bde-ae89-5f4ea88a1bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:48.530817 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e351a2-0556-4bde-ae89-5f4ea88a1bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:48.531089 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e351a2-0556-4bde-ae89-5f4ea88a1bd1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:48.538442 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e351a2-0556-4bde-ae89-5f4ea88a1bd1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:48.539956 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e351a2-0556-4bde-ae89-5f4ea88a1bd1 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:48.552371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-78e351a2-0556-4bde-ae89-5f4ea88a1bd1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 20:06:48.552371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:48.552371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:48.552371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:48.552371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:48.552371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:48.552371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:48.552371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:48.552371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:48.552371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:48.552371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:48.552371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:48.552371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:06:48.552371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:06:48.552371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:06:48.552371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:06:48.553919 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:48.553919 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:48.553919 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:06:48.553919 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:48.553919 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:06:48.553919 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:48.553919 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:48.553919 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:48.553919 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:48.553919 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:48.553919 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:48.553919 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:48.553919 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:48.553919 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:48.553919 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:48.553919 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:48.553919 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:48.553919 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:48.554978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:48.554978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:48.554978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:06:48.554978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:06:48.554978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:06:48.554978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:06:48.554978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:06:48.554978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:06:48.554978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 20:06:48.554978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:48.554978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 334/664] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Sep 6 20:06:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:48.554978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e351a2-0556-4bde-ae89-5f4ea88a1bd1 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:48.606056 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912443a-4d9f-41ba-9547-9a9b7154a9d7 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:48.641835 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09647a1-f40b-466a-af9e-39b4ad19951d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:48.642519 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09647a1-f40b-466a-af9e-39b4ad19951d None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:48.642740 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09647a1-f40b-466a-af9e-39b4ad19951d None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:48.643015 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09647a1-f40b-466a-af9e-39b4ad19951d None admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:48.643758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09647a1-f40b-466a-af9e-39b4ad19951d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:48.644068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09647a1-f40b-466a-af9e-39b4ad19951d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:48.645506 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09647a1-f40b-466a-af9e-39b4ad19951d None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:48.658981 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 331/665] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:06:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:48.659165 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e351a2-0556-4bde-ae89-5f4ea88a1bd1 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:48.659851 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09647a1-f40b-466a-af9e-39b4ad19951d None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:48.696593 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152e927-a2b2-4f46-b7a2-e1a78dac687f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:48.697305 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152e927-a2b2-4f46-b7a2-e1a78dac687f None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:48.697506 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152e927-a2b2-4f46-b7a2-e1a78dac687f None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:48.697773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152e927-a2b2-4f46-b7a2-e1a78dac687f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:48.708652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152e927-a2b2-4f46-b7a2-e1a78dac687f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:48.713634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-f152e927-a2b2-4f46-b7a2-e1a78dac687f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:48.713634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:48.713634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:48.713634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:48.713634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:48.713634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:48.713634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:48.713634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:48.713634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:48.713634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:48.713634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:48.713634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:48.713634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:48.713634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:48.713634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:48.713634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:48.714719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:48.714719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:48.714719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:48.714719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:48.714719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:48.714719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:48.714719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:48.714719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:48.714719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:48.714719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:48.714719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:48.714719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:48.714719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:48.714719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:48.714719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:48.714719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:48.715993 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:48.715993 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:48.715993 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:48.715993 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:48.715993 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:48.715993 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:48.715993 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:48.715993 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:48.715993 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:48.715993 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:48.715993 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:48.715993 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:48.715993 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 335/666] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Sep 6 20:06:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:48.717156 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152e927-a2b2-4f46-b7a2-e1a78dac687f None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:48.734324 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:48.766915 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:48.774508 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09647a1-f40b-466a-af9e-39b4ad19951d None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:48.810545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b186b9-6f10-4630-8a18-efcb2773cc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:48.811694 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b186b9-6f10-4630-8a18-efcb2773cc0b None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:48.811694 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b186b9-6f10-4630-8a18-efcb2773cc0b None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:48.811866 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b186b9-6f10-4630-8a18-efcb2773cc0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:48.819791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b186b9-6f10-4630-8a18-efcb2773cc0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:48.821383 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b186b9-6f10-4630-8a18-efcb2773cc0b None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:48.835015 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-67b186b9-6f10-4630-8a18-efcb2773cc0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:48.835015 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:48.835015 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:48.835015 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:48.835015 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:48.835015 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:48.835015 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:48.835015 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:48.835015 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:48.835015 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:48.835015 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:48.835015 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:48.835015 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:06:48.835015 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:06:48.835015 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:06:48.836219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:06:48.836219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:48.836219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:48.836219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:48.836219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:48.836219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:48.836219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:48.836219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:48.836219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:48.836219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:48.836219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:48.836219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:48.836219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:48.836219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:48.836219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:48.836219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:48.836219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:48.842238 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:06:48.842238 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:06:48.842238 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:06:48.842238 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:06:48.842238 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:06:48.842238 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:06:48.842238 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:48.842238 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:48.843285 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152e927-a2b2-4f46-b7a2-e1a78dac687f None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:48.843744 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 332/667] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:06:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:48.843744 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b186b9-6f10-4630-8a18-efcb2773cc0b None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:48.873850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f952d-6a39-4d42-9f88-b855803d7cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:48.874502 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f952d-6a39-4d42-9f88-b855803d7cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:48.874784 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f952d-6a39-4d42-9f88-b855803d7cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:48.875057 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f952d-6a39-4d42-9f88-b855803d7cd9 None admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:48.875789 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f952d-6a39-4d42-9f88-b855803d7cd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:48.876102 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f952d-6a39-4d42-9f88-b855803d7cd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:48.877808 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f952d-6a39-4d42-9f88-b855803d7cd9 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:48.890376 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 336/668] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:06:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:48.891229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f952d-6a39-4d42-9f88-b855803d7cd9 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:48.963450 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b186b9-6f10-4630-8a18-efcb2773cc0b None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:48.988410 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:49.000133 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d6bfb-eeec-4998-9173-3884583cd886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:49.003607 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d6bfb-eeec-4998-9173-3884583cd886 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:49.003607 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d6bfb-eeec-4998-9173-3884583cd886 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:49.003607 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d6bfb-eeec-4998-9173-3884583cd886 None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:49.003607 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d6bfb-eeec-4998-9173-3884583cd886 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:49.003607 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d6bfb-eeec-4998-9173-3884583cd886 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:49.004069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d6bfb-eeec-4998-9173-3884583cd886 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:49.008062 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:49.016347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f952d-6a39-4d42-9f88-b855803d7cd9 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:49.030358 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 333/669] 10.222.0.77 () {56 vars in 1139 bytes} [Tue Sep 6 20:06:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:49.032471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d6bfb-eeec-4998-9173-3884583cd886 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:49.057592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a4764-0693-4c66-a9ad-444f7f83a427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:49.058346 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a4764-0693-4c66-a9ad-444f7f83a427 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:49.058619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a4764-0693-4c66-a9ad-444f7f83a427 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:49.059100 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a4764-0693-4c66-a9ad-444f7f83a427 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:49.060324 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a4764-0693-4c66-a9ad-444f7f83a427 None admin] RBAC: Adding query filter params (role.id=140b49dfcc2b489ca0504d2e7abfdbdb, scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343, user.id=871f208a13ba435491022b9ea9b735e6) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:49.060649 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a4764-0693-4c66-a9ad-444f7f83a427 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:49.062050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a4764-0693-4c66-a9ad-444f7f83a427 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:49.068350 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 337/670] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:06:48 2022] GET /identity/v3/role_assignments?user.id=871f208a13ba435491022b9ea9b735e6&scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343&role.id=140b49dfcc2b489ca0504d2e7abfdbdb => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:49.069167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a4764-0693-4c66-a9ad-444f7f83a427 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:49.154917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d6bfb-eeec-4998-9173-3884583cd886 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:49.194344 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a4764-0693-4c66-a9ad-444f7f83a427 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:49.196932 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d77887-535f-43d0-8a89-af55ba06dd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:49.197587 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d77887-535f-43d0-8a89-af55ba06dd2e None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:49.197999 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d77887-535f-43d0-8a89-af55ba06dd2e None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:49.198278 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d77887-535f-43d0-8a89-af55ba06dd2e None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:49.198998 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d77887-535f-43d0-8a89-af55ba06dd2e None admin] RBAC: Adding query filter params (name=service) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:49.199414 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d77887-535f-43d0-8a89-af55ba06dd2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:49.200874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d77887-535f-43d0-8a89-af55ba06dd2e None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:49.211054 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 334/671] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Sep 6 20:06:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:49.211973 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d77887-535f-43d0-8a89-af55ba06dd2e None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:49.243111 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84b8e9-93bb-4668-9738-54db9e35b226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:49.243856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84b8e9-93bb-4668-9738-54db9e35b226 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:49.244128 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84b8e9-93bb-4668-9738-54db9e35b226 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:49.244578 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84b8e9-93bb-4668-9738-54db9e35b226 None admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:49.245480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84b8e9-93bb-4668-9738-54db9e35b226 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:49.245852 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84b8e9-93bb-4668-9738-54db9e35b226 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:49.247389 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84b8e9-93bb-4668-9738-54db9e35b226 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:49.266419 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 338/672] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:06:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:49.267651 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84b8e9-93bb-4668-9738-54db9e35b226 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:49.271423 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:49.299695 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:49.338116 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d77887-535f-43d0-8a89-af55ba06dd2e None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:49.384858 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b0093-0251-4e45-a181-57a6d3a8a58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:49.385468 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b0093-0251-4e45-a181-57a6d3a8a58a None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:49.385756 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b0093-0251-4e45-a181-57a6d3a8a58a None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:49.386027 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b0093-0251-4e45-a181-57a6d3a8a58a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:49.386749 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b0093-0251-4e45-a181-57a6d3a8a58a None admin] RBAC: Adding query filter params (role.id=140b49dfcc2b489ca0504d2e7abfdbdb, scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343, user.id=b09ce16da49b4af38491ad4eb6287d70) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:49.387058 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b0093-0251-4e45-a181-57a6d3a8a58a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:49.388558 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b0093-0251-4e45-a181-57a6d3a8a58a None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:49.395908 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 335/673] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:06:49 2022] GET /identity/v3/role_assignments?user.id=b09ce16da49b4af38491ad4eb6287d70&scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343&role.id=140b49dfcc2b489ca0504d2e7abfdbdb => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:49.396547 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b0093-0251-4e45-a181-57a6d3a8a58a None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:49.426479 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84b8e9-93bb-4668-9738-54db9e35b226 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:49.484731 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e51607-16ac-43da-837f-c39eb7ea392d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:49.486061 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e51607-16ac-43da-837f-c39eb7ea392d None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:49.487681 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e51607-16ac-43da-837f-c39eb7ea392d None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:49.488220 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e51607-16ac-43da-837f-c39eb7ea392d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:49.524679 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b0093-0251-4e45-a181-57a6d3a8a58a None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:49.533866 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:49.566473 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3e64b-3015-4256-903e-134dcd24ca5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:49.567847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3e64b-3015-4256-903e-134dcd24ca5d None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:49.568234 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3e64b-3015-4256-903e-134dcd24ca5d None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:49.568611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3e64b-3015-4256-903e-134dcd24ca5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:49.581104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3e64b-3015-4256-903e-134dcd24ca5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:49.582728 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3e64b-3015-4256-903e-134dcd24ca5d None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:49.596947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e51607-16ac-43da-837f-c39eb7ea392d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:49.598741 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e51607-16ac-43da-837f-c39eb7ea392d None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:49.600562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-c4b3e64b-3015-4256-903e-134dcd24ca5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:49.600562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:49.600562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:49.600562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:49.600562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:49.600562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:49.600562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:49.600562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:49.600562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:49.600562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:49.600562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:49.600562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:49.600562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:49.600562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:49.600562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:49.600562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:49.601706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:49.601706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:49.601706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:49.601706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:49.601706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:49.601706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:49.601706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:49.601706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:49.601706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:49.601706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:49.601706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:49.601706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:49.601706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:49.601706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:49.601706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:49.601706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:49.601706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:49.602817 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:49.602817 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:49.602817 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:49.604417 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 336/674] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:49.605951 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3e64b-3015-4256-903e-134dcd24ca5d None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:49.636981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:49.740278 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 339/675] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:06:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:06:49.740278 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e51607-16ac-43da-837f-c39eb7ea392d None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:49.754889 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3e64b-3015-4256-903e-134dcd24ca5d None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:49.800137 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1e102-8cc3-4a24-a480-de9c966adcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:49.800769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1e102-8cc3-4a24-a480-de9c966adcdf None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:49.801050 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1e102-8cc3-4a24-a480-de9c966adcdf None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:49.801325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1e102-8cc3-4a24-a480-de9c966adcdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:49.802074 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1e102-8cc3-4a24-a480-de9c966adcdf None admin] RBAC: Adding query filter params (role.id=140b49dfcc2b489ca0504d2e7abfdbdb, scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343, user.id=c6d2bb1c23484010bcc9238f9a9203a4) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:49.802387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1e102-8cc3-4a24-a480-de9c966adcdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:49.804448 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1e102-8cc3-4a24-a480-de9c966adcdf None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:49.811894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 337/676] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:06:49 2022] GET /identity/v3/role_assignments?user.id=c6d2bb1c23484010bcc9238f9a9203a4&scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343&role.id=140b49dfcc2b489ca0504d2e7abfdbdb => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:49.812810 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1e102-8cc3-4a24-a480-de9c966adcdf None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:49.852488 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:49.938816 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e51607-16ac-43da-837f-c39eb7ea392d None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:49.949822 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1e102-8cc3-4a24-a480-de9c966adcdf None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:49.987205 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:50.003391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa2998-6da8-40d3-91fd-1c2b8cad5406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:50.004067 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa2998-6da8-40d3-91fd-1c2b8cad5406 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:50.004349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa2998-6da8-40d3-91fd-1c2b8cad5406 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:50.004625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa2998-6da8-40d3-91fd-1c2b8cad5406 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:50.005303 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa2998-6da8-40d3-91fd-1c2b8cad5406 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:50.005611 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa2998-6da8-40d3-91fd-1c2b8cad5406 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:50.007983 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa2998-6da8-40d3-91fd-1c2b8cad5406 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:50.030971 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 340/677] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:50.038335 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa2998-6da8-40d3-91fd-1c2b8cad5406 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:50.059888 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b95d9-ed8f-4bb7-adf5-33b3b2d05610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:50.060505 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b95d9-ed8f-4bb7-adf5-33b3b2d05610 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:50.060897 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b95d9-ed8f-4bb7-adf5-33b3b2d05610 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:50.061174 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b95d9-ed8f-4bb7-adf5-33b3b2d05610 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:50.081437 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b95d9-ed8f-4bb7-adf5-33b3b2d05610 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:50.083257 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b95d9-ed8f-4bb7-adf5-33b3b2d05610 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:50.110562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-d47b95d9-ed8f-4bb7-adf5-33b3b2d05610 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:50.110562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:50.110562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:50.110562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:50.110562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:50.110562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:50.110562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:50.110562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:50.110562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:50.110562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:50.110562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:50.110562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:50.110562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:50.110562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:50.110562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:50.110562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:50.111657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:50.111657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:50.111657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:50.111657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:50.111657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:50.111657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:50.111657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:50.111657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:50.111657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:50.111657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:50.111657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:50.111657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:50.111657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:50.111657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:50.111657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:50.111657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:50.111657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:50.112536 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:50.112536 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:50.112536 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:50.114695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 338/678] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:50.122822 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b95d9-ed8f-4bb7-adf5-33b3b2d05610 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:50.189807 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa2998-6da8-40d3-91fd-1c2b8cad5406 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:50.217447 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:50.233309 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527add2-0123-4742-8281-8e1d4450a058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:50.236062 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527add2-0123-4742-8281-8e1d4450a058 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:50.236062 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527add2-0123-4742-8281-8e1d4450a058 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:50.236062 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527add2-0123-4742-8281-8e1d4450a058 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:50.243868 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527add2-0123-4742-8281-8e1d4450a058 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:50.245647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527add2-0123-4742-8281-8e1d4450a058 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:50.248030 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b95d9-ed8f-4bb7-adf5-33b3b2d05610 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:50.260120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-9527add2-0123-4742-8281-8e1d4450a058 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 20:06:50.260120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:50.260120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:50.260120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:50.260120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:50.260120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:50.260120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:50.260120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:50.260120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:50.260120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:50.260120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:50.260120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:50.260120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:06:50.260120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:06:50.260120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:06:50.260120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:06:50.261108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:50.261108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:50.261108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:06:50.261108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:50.261108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:06:50.261108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:50.261108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:50.261108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:50.261108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:50.261108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:50.261108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:50.261108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:50.261108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:50.261108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:50.261108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:50.261108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:50.261108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:50.261108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:50.262044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:50.262044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:50.262044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:06:50.262044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:06:50.262044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:06:50.262044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:06:50.262044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:06:50.262044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:06:50.262044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 20:06:50.262044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:50.265376 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 341/679] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:06:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:50.270933 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527add2-0123-4742-8281-8e1d4450a058 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:50.289507 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec746cb5-f0b4-4c0f-a4ad-b541dd2607dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:50.290314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec746cb5-f0b4-4c0f-a4ad-b541dd2607dc None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:50.290622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec746cb5-f0b4-4c0f-a4ad-b541dd2607dc None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:50.290925 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec746cb5-f0b4-4c0f-a4ad-b541dd2607dc None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:50.291578 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec746cb5-f0b4-4c0f-a4ad-b541dd2607dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:50.291881 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec746cb5-f0b4-4c0f-a4ad-b541dd2607dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:50.293374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec746cb5-f0b4-4c0f-a4ad-b541dd2607dc None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:50.311862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 339/680] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:50.317130 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec746cb5-f0b4-4c0f-a4ad-b541dd2607dc None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:50.359887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:50.453616 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527add2-0123-4742-8281-8e1d4450a058 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:50.501602 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac70548-8311-439e-a279-d3ac41486b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:50.502827 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac70548-8311-439e-a279-d3ac41486b18 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:50.503267 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac70548-8311-439e-a279-d3ac41486b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:50.503753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac70548-8311-439e-a279-d3ac41486b18 None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:50.504684 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac70548-8311-439e-a279-d3ac41486b18 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:50.505163 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac70548-8311-439e-a279-d3ac41486b18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:50.506966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac70548-8311-439e-a279-d3ac41486b18 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:50.528248 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 342/681] 10.222.0.77 () {56 vars in 1135 bytes} [Tue Sep 6 20:06:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:50.535212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac70548-8311-439e-a279-d3ac41486b18 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:50.547751 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec746cb5-f0b4-4c0f-a4ad-b541dd2607dc None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:50.623707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646defe-d76c-43cb-a3ef-2d55cd8d868b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:50.624386 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646defe-d76c-43cb-a3ef-2d55cd8d868b None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:50.624669 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646defe-d76c-43cb-a3ef-2d55cd8d868b None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:50.624938 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646defe-d76c-43cb-a3ef-2d55cd8d868b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:50.629820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:50.642294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6646defe-d76c-43cb-a3ef-2d55cd8d868b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:50.643922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6646defe-d76c-43cb-a3ef-2d55cd8d868b None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:50.666149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-6646defe-d76c-43cb-a3ef-2d55cd8d868b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:50.666149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:50.666149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:50.666149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:50.666149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:50.666149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:50.666149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:50.666149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:50.666149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:50.666149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:50.666149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:50.666149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:50.666149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:06:50.666149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:06:50.666149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:06:50.667297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:06:50.667297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:50.667297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:50.667297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:50.667297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:50.667297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:50.667297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:50.667297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:50.667297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:50.667297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:50.667297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:50.667297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:50.667297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:50.667297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:50.667297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:50.667297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:50.667297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:50.672526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:06:50.672526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:06:50.672526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:06:50.672526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:06:50.672526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:06:50.672526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:06:50.672526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:50.672526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:50.672526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 340/682] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:06:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:50.676401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac70548-8311-439e-a279-d3ac41486b18 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:50.679590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:50.684523 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646defe-d76c-43cb-a3ef-2d55cd8d868b None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:50.723960 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ae49f-b897-4d72-9229-9efefb87cbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:50.725160 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ae49f-b897-4d72-9229-9efefb87cbe5 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:50.725719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ae49f-b897-4d72-9229-9efefb87cbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:50.726154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ae49f-b897-4d72-9229-9efefb87cbe5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:50.809645 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ae49f-b897-4d72-9229-9efefb87cbe5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:50.811475 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ae49f-b897-4d72-9229-9efefb87cbe5 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:50.934081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 343/683] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:06:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:06:50.935265 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646defe-d76c-43cb-a3ef-2d55cd8d868b None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:50.940185 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ae49f-b897-4d72-9229-9efefb87cbe5 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:50.979836 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:51.016550 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65315c82-c967-454c-ade1-ea13c941336e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:51.017075 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65315c82-c967-454c-ade1-ea13c941336e None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:51.017433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65315c82-c967-454c-ade1-ea13c941336e None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:51.017834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65315c82-c967-454c-ade1-ea13c941336e None admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:51.018701 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65315c82-c967-454c-ade1-ea13c941336e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:51.019079 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65315c82-c967-454c-ade1-ea13c941336e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:51.020818 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65315c82-c967-454c-ade1-ea13c941336e None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:51.051481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 341/684] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:06:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:06:51.061110 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65315c82-c967-454c-ade1-ea13c941336e None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:51.070640 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ae49f-b897-4d72-9229-9efefb87cbe5 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:51.114564 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f07713-954e-45c2-943d-ab885bdc0f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:51.115640 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f07713-954e-45c2-943d-ab885bdc0f87 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:51.116227 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f07713-954e-45c2-943d-ab885bdc0f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:51.116786 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f07713-954e-45c2-943d-ab885bdc0f87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:51.130020 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f07713-954e-45c2-943d-ab885bdc0f87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:51.131862 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f07713-954e-45c2-943d-ab885bdc0f87 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:51.162463 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:51.163849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-15f07713-954e-45c2-943d-ab885bdc0f87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:51.163849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:51.163849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:51.163849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:51.163849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:51.163849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:51.163849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:51.163849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:51.163849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:51.163849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:51.163849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:51.163849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:51.163849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:51.163849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:51.163849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:51.163849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:51.164772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:51.164772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:51.164772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:51.164772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:51.164772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:51.164772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:51.164772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:51.164772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:51.164772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:51.164772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:51.164772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:51.164772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:51.164772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:51.164772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:51.164772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:51.164772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:51.164772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:51.165679 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:51.165679 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:51.165679 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:51.173022 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 344/685] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:51.179478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f07713-954e-45c2-943d-ab885bdc0f87 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:51.227168 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65315c82-c967-454c-ade1-ea13c941336e None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:51.283191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984006c-7515-498b-82e6-a4e1bc495829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:51.284145 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984006c-7515-498b-82e6-a4e1bc495829 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:51.284613 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984006c-7515-498b-82e6-a4e1bc495829 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:51.285121 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984006c-7515-498b-82e6-a4e1bc495829 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:51.286040 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984006c-7515-498b-82e6-a4e1bc495829 None admin] RBAC: Adding query filter params (role.id=140b49dfcc2b489ca0504d2e7abfdbdb, scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343, user.id=5a876d70d9634bf59af5f138e856f75f) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:51.286545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984006c-7515-498b-82e6-a4e1bc495829 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:51.288183 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984006c-7515-498b-82e6-a4e1bc495829 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:51.299566 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 342/686] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:06:51 2022] GET /identity/v3/role_assignments?user.id=5a876d70d9634bf59af5f138e856f75f&scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343&role.id=140b49dfcc2b489ca0504d2e7abfdbdb => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:06:51.315901 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:51.387357 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f07713-954e-45c2-943d-ab885bdc0f87 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:51.451213 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e264bb1-e060-47af-b5ca-e0f12c3d0b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:51.452023 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e264bb1-e060-47af-b5ca-e0f12c3d0b5a None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:51.452516 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e264bb1-e060-47af-b5ca-e0f12c3d0b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:51.452809 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e264bb1-e060-47af-b5ca-e0f12c3d0b5a None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:51.453548 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e264bb1-e060-47af-b5ca-e0f12c3d0b5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:51.453935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e264bb1-e060-47af-b5ca-e0f12c3d0b5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:51.455596 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e264bb1-e060-47af-b5ca-e0f12c3d0b5a None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:51.476437 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 345/687] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:51.481620 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984006c-7515-498b-82e6-a4e1bc495829 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:51.607387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984006c-7515-498b-82e6-a4e1bc495829 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:51.629351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:51.647949 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4a144-3b14-4f5d-a8fb-f3b8d96634cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:51.648669 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4a144-3b14-4f5d-a8fb-f3b8d96634cf None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:51.648981 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4a144-3b14-4f5d-a8fb-f3b8d96634cf None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:51.649280 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4a144-3b14-4f5d-a8fb-f3b8d96634cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:51.657798 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4a144-3b14-4f5d-a8fb-f3b8d96634cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:51.659391 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4a144-3b14-4f5d-a8fb-f3b8d96634cf None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:51.674917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-02a4a144-3b14-4f5d-a8fb-f3b8d96634cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:51.674917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:51.674917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:51.674917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:51.674917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:51.674917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:51.674917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:51.674917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:51.674917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:51.674917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:51.674917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:51.674917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:51.674917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:06:51.674917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:06:51.674917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:06:51.675914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:06:51.675914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:51.675914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:51.675914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:51.675914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:51.675914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:51.675914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:51.675914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:51.675914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:51.675914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:51.675914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:51.675914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:51.675914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:51.675914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:51.675914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:51.675914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:51.675914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:51.677218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:06:51.677218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:06:51.677218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:06:51.677218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:06:51.677218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:06:51.677218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:06:51.677218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:51.677218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:51.677218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 343/688] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:06:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:51.683177 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e264bb1-e060-47af-b5ca-e0f12c3d0b5a None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:51.805414 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e264bb1-e060-47af-b5ca-e0f12c3d0b5a None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:51.829658 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:51.860839 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f72df-3e43-4a01-b3a8-71d6e936feb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:51.861491 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f72df-3e43-4a01-b3a8-71d6e936feb1 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:51.861766 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f72df-3e43-4a01-b3a8-71d6e936feb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:51.862069 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f72df-3e43-4a01-b3a8-71d6e936feb1 None admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:51.862783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f72df-3e43-4a01-b3a8-71d6e936feb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:51.863134 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f72df-3e43-4a01-b3a8-71d6e936feb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:51.864681 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f72df-3e43-4a01-b3a8-71d6e936feb1 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:51.886637 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 346/689] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:06:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:51.893121 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4a144-3b14-4f5d-a8fb-f3b8d96634cf None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:52.008659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4a144-3b14-4f5d-a8fb-f3b8d96634cf None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:52.055075 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b101e-6c02-457d-8991-baffb759ef14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:52.055777 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b101e-6c02-457d-8991-baffb759ef14 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:52.055999 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b101e-6c02-457d-8991-baffb759ef14 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:52.056272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b101e-6c02-457d-8991-baffb759ef14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:52.057000 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b101e-6c02-457d-8991-baffb759ef14 None admin] RBAC: Adding query filter params (role.id=140b49dfcc2b489ca0504d2e7abfdbdb, scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343, user.id=5a6c4f91a59548fd979e7232a2afd6ec) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:52.057385 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b101e-6c02-457d-8991-baffb759ef14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:52.058818 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b101e-6c02-457d-8991-baffb759ef14 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:52.068637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 344/690] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:06:51 2022] GET /identity/v3/role_assignments?user.id=5a6c4f91a59548fd979e7232a2afd6ec&scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343&role.id=140b49dfcc2b489ca0504d2e7abfdbdb => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:52.234927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e16745-5146-4bf7-9841-601d39347d5a None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:52.235473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e16745-5146-4bf7-9841-601d39347d5a None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:52.235555 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e16745-5146-4bf7-9841-601d39347d5a None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:52.236961 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 347/691] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:52.242696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08402878-efa7-4cdf-b7da-5b14383eff42 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:52.243004 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08402878-efa7-4cdf-b7da-5b14383eff42 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:52.243252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08402878-efa7-4cdf-b7da-5b14383eff42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:52.266240 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-08402878-efa7-4cdf-b7da-5b14383eff42 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:52.267563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-08402878-efa7-4cdf-b7da-5b14383eff42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:52.284281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910a111-a346-4c5a-9828-380bb6645d3b None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:52.284923 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910a111-a346-4c5a-9828-380bb6645d3b None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:52.285406 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910a111-a346-4c5a-9828-380bb6645d3b None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:52.287428 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 348/692] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:52.294595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a30672-8415-41d3-aac0-487e32d3ed63 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:52.294935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a30672-8415-41d3-aac0-487e32d3ed63 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:52.295158 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a30672-8415-41d3-aac0-487e32d3ed63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:52.320075 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-f1a30672-8415-41d3-aac0-487e32d3ed63 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:52.321286 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-f1a30672-8415-41d3-aac0-487e32d3ed63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:52.327992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:52.379145 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 345/693] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:52.432348 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 349/694] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 20:06:52.702736 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08402878-efa7-4cdf-b7da-5b14383eff42 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:52.728557 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a30672-8415-41d3-aac0-487e32d3ed63 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:52.851508 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08402878-efa7-4cdf-b7da-5b14383eff42 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:52.897493 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3dd7c-cd86-4fd2-9b1b-e5ade0193241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:52.898676 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3dd7c-cd86-4fd2-9b1b-e5ade0193241 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:52.899223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3dd7c-cd86-4fd2-9b1b-e5ade0193241 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:52.899748 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3dd7c-cd86-4fd2-9b1b-e5ade0193241 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:52.918903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3dd7c-cd86-4fd2-9b1b-e5ade0193241 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:52.922293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3dd7c-cd86-4fd2-9b1b-e5ade0193241 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:52.927477 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a30672-8415-41d3-aac0-487e32d3ed63 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:52.940802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:52.962963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-1ca3dd7c-cd86-4fd2-9b1b-e5ade0193241 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:52.962963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:52.962963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:52.962963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:52.962963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:52.962963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:52.962963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:52.962963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:52.962963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:52.962963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:52.962963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:52.962963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:52.962963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:52.962963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:52.962963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:52.962963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:52.963975 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:52.963975 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:52.963975 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:52.963975 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:52.963975 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:52.963975 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:52.963975 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:52.963975 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:52.963975 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:52.963975 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:52.963975 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:52.963975 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:52.963975 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:52.963975 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:52.963975 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:52.963975 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:52.963975 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:52.964840 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:52.964840 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:52.964840 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:52.964840 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 346/695] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:52.964840 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339bbf5-bb65-4e63-b653-30b853757b4a None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:52.964840 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339bbf5-bb65-4e63-b653-30b853757b4a None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:52.964840 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339bbf5-bb65-4e63-b653-30b853757b4a None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:52.965742 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 347/696] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:52.971592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339bbf5-bb65-4e63-b653-30b853757b4a None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:52.975299 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615c971-3fee-45dd-b0cf-2940c9c02165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:52.976175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615c971-3fee-45dd-b0cf-2940c9c02165 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:52.976644 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615c971-3fee-45dd-b0cf-2940c9c02165 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:52.977097 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615c971-3fee-45dd-b0cf-2940c9c02165 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:52.989318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615c971-3fee-45dd-b0cf-2940c9c02165 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:52.994832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-3615c971-3fee-45dd-b0cf-2940c9c02165 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:06:52.994832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:52.994832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:52.994832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:52.994832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:52.994832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:52.994832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:52.994832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:52.994832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:52.994832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:52.994832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:52.994832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:52.994832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:52.994832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:52.994832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:52.994832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:52.995812 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:52.995812 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:52.995812 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:52.995812 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:52.995812 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:52.995812 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:52.995812 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:52.995812 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:52.995812 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:52.995812 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:52.995812 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:52.995812 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:52.995812 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:52.995812 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:52.995812 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:52.995812 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:52.996633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:52.996633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:52.996633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:52.996633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:52.996633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:52.996633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:52.996633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:52.996633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:52.996633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:52.996633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:52.996633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:06:52.996633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:52.999953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 350/697] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:06:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:53.001446 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe33c16-c56b-472d-b558-f6b2be19ebeb None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:53.002146 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe33c16-c56b-472d-b558-f6b2be19ebeb None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:53.002552 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe33c16-c56b-472d-b558-f6b2be19ebeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:53.008745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:53.023070 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-3fe33c16-c56b-472d-b558-f6b2be19ebeb None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:53.024593 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-3fe33c16-c56b-472d-b558-f6b2be19ebeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:53.106958 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339bbf5-bb65-4e63-b653-30b853757b4a None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:53.119595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 351/698] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:53.120811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe33c16-c56b-472d-b558-f6b2be19ebeb None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:53.178503 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dad1c7-8457-414e-8c26-ae3f48abdc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:53.179662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dad1c7-8457-414e-8c26-ae3f48abdc92 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:53.180970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dad1c7-8457-414e-8c26-ae3f48abdc92 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:53.182034 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dad1c7-8457-414e-8c26-ae3f48abdc92 None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:53.183040 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dad1c7-8457-414e-8c26-ae3f48abdc92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:53.185584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dad1c7-8457-414e-8c26-ae3f48abdc92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:53.187536 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dad1c7-8457-414e-8c26-ae3f48abdc92 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:53.213636 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 348/699] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:53.222796 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dad1c7-8457-414e-8c26-ae3f48abdc92 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:53.329086 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:53.346161 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:53.349452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dad1c7-8457-414e-8c26-ae3f48abdc92 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:53.370403 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe33c16-c56b-472d-b558-f6b2be19ebeb None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:53.394745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88b086-4dda-4a58-97c8-633b9a6e9eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:53.395372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88b086-4dda-4a58-97c8-633b9a6e9eed None admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:53.395690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88b086-4dda-4a58-97c8-633b9a6e9eed None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:53.395966 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88b086-4dda-4a58-97c8-633b9a6e9eed None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:53.396621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88b086-4dda-4a58-97c8-633b9a6e9eed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:53.398089 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88b086-4dda-4a58-97c8-633b9a6e9eed None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:53.439522 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee4276-e766-4486-9e72-1ae8766aa771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:53.440271 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee4276-e766-4486-9e72-1ae8766aa771 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:53.440556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee4276-e766-4486-9e72-1ae8766aa771 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:53.440833 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee4276-e766-4486-9e72-1ae8766aa771 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:53.441560 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee4276-e766-4486-9e72-1ae8766aa771 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:53.441874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee4276-e766-4486-9e72-1ae8766aa771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:53.443292 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee4276-e766-4486-9e72-1ae8766aa771 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:53.453543 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 352/700] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:06:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:53.459217 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee4276-e766-4486-9e72-1ae8766aa771 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:53.579380 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee4276-e766-4486-9e72-1ae8766aa771 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:53.616636 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb44305-4845-4cef-b8d4-840dec77561c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:53.617268 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb44305-4845-4cef-b8d4-840dec77561c None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:53.617543 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb44305-4845-4cef-b8d4-840dec77561c None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:53.617809 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb44305-4845-4cef-b8d4-840dec77561c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:53.631088 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb44305-4845-4cef-b8d4-840dec77561c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:53.632588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb44305-4845-4cef-b8d4-840dec77561c None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:53.644372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 349/701] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Sep 6 20:06:53 2022] POST /identity/v3/users => generated 254 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:06:53.645441 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88b086-4dda-4a58-97c8-633b9a6e9eed None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:53.659793 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-adb44305-4845-4cef-b8d4-840dec77561c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:53.659793 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:53.659793 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:53.659793 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:53.659793 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:53.659793 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:53.659793 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:53.659793 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:53.659793 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:53.659793 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:53.659793 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:53.659793 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:53.659793 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:53.659793 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:53.659793 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:53.659793 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:53.660811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:53.660811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:53.660811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:53.660811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:53.660811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:53.660811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:53.660811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:53.660811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:53.660811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:53.660811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:53.660811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:53.660811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:53.660811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:53.660811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:53.660811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:53.660811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:53.660811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:53.661707 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:53.661707 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:53.661707 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:53.661707 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 353/702] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:06:53.668066 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb44305-4845-4cef-b8d4-840dec77561c None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:53.692930 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:53.831554 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb44305-4845-4cef-b8d4-840dec77561c None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:53.871656 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3aa09-7e4f-4df9-9d35-36c83f986e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:53.872287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3aa09-7e4f-4df9-9d35-36c83f986e38 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:53.872567 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3aa09-7e4f-4df9-9d35-36c83f986e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:53.872833 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3aa09-7e4f-4df9-9d35-36c83f986e38 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:53.873555 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3aa09-7e4f-4df9-9d35-36c83f986e38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:53.873940 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3aa09-7e4f-4df9-9d35-36c83f986e38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:53.875856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3aa09-7e4f-4df9-9d35-36c83f986e38 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:53.886618 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88b086-4dda-4a58-97c8-633b9a6e9eed None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:53.891503 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 354/703] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:06:53.911482 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3aa09-7e4f-4df9-9d35-36c83f986e38 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:53.960241 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49203be-71a1-4da9-a5da-9b6eb0329b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:53.960895 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49203be-71a1-4da9-a5da-9b6eb0329b50 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:53.961175 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49203be-71a1-4da9-a5da-9b6eb0329b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:53.961449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49203be-71a1-4da9-a5da-9b6eb0329b50 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:53.962039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49203be-71a1-4da9-a5da-9b6eb0329b50 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:53.964488 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49203be-71a1-4da9-a5da-9b6eb0329b50 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:53.979857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-a49203be-71a1-4da9-a5da-9b6eb0329b50 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 20:06:53.979857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:53.979857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 20:06:53.979857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 20:06:53.979857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 20:06:53.979857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 20:06:53.979857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 20:06:53.979857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:06:53.979857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 20:06:53.979857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:53.979857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:06:53.979857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:53.979857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:53.979857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:53.979857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:53.979857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:53.979857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:53.981019 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:53.981019 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:53.981019 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:53.981019 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:53.981019 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:53.981019 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:53.981019 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 20:06:53.981019 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 20:06:53.981019 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 20:06:53.981019 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 20:06:53.981019 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:53.981019 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:53.981019 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:53.981019 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:53.981019 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:53.981019 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:53.981916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:53.981916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:53.981916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:53.981916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:53.981916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:53.981916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:53.981916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:53.981916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:53.981916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:53.981916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:53.981916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 20:06:53.981916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:06:53.981916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 20:06:53.981916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:53.981916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 350/704] 10.222.0.77 () {56 vars in 1129 bytes} [Tue Sep 6 20:06:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:53.988318 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49203be-71a1-4da9-a5da-9b6eb0329b50 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:53.992943 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:54.021171 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:54.065122 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3aa09-7e4f-4df9-9d35-36c83f986e38 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:54.122339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819b2d9-2eaa-4d21-b696-2ed8272d9918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:54.123123 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819b2d9-2eaa-4d21-b696-2ed8272d9918 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:54.123504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819b2d9-2eaa-4d21-b696-2ed8272d9918 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:54.123794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819b2d9-2eaa-4d21-b696-2ed8272d9918 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:54.133984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49203be-71a1-4da9-a5da-9b6eb0329b50 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:54.141605 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819b2d9-2eaa-4d21-b696-2ed8272d9918 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:54.144388 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819b2d9-2eaa-4d21-b696-2ed8272d9918 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:54.165981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-e819b2d9-2eaa-4d21-b696-2ed8272d9918 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 20:06:54.165981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:54.165981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:54.165981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:54.165981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:54.165981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:54.165981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:54.165981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:54.165981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:54.165981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:54.165981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:54.165981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:54.165981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:06:54.165981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:06:54.165981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:06:54.165981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:06:54.167192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:54.167192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:54.167192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:06:54.167192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:54.167192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:06:54.167192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:54.167192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:54.167192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:54.167192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:54.167192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:54.167192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:54.167192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:54.167192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:54.167192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:54.167192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:54.167192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:54.167192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:54.167192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:54.168499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:54.168499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:54.168499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:06:54.168499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:06:54.168499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:06:54.168499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:06:54.168499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:06:54.168499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:06:54.168499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 20:06:54.168499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:54.172023 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 355/705] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Sep 6 20:06:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:54.178362 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819b2d9-2eaa-4d21-b696-2ed8272d9918 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:54.196857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b5ba9-32e5-469f-b22e-81d765d39c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:54.198017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b5ba9-32e5-469f-b22e-81d765d39c6d None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:54.198341 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b5ba9-32e5-469f-b22e-81d765d39c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:54.198697 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b5ba9-32e5-469f-b22e-81d765d39c6d None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:54.199597 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b5ba9-32e5-469f-b22e-81d765d39c6d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:54.200002 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b5ba9-32e5-469f-b22e-81d765d39c6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:54.202022 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b5ba9-32e5-469f-b22e-81d765d39c6d None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:54.209939 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 351/706] 10.222.0.77 () {56 vars in 1124 bytes} [Tue Sep 6 20:06:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:06:54.218819 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b5ba9-32e5-469f-b22e-81d765d39c6d None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:54.328931 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819b2d9-2eaa-4d21-b696-2ed8272d9918 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:54.331242 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:54.360428 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:54.369735 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36649ae6-3414-4ff6-a185-96780d860579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:54.370467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36649ae6-3414-4ff6-a185-96780d860579 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:54.370850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36649ae6-3414-4ff6-a185-96780d860579 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:54.371221 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36649ae6-3414-4ff6-a185-96780d860579 None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:54.372090 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36649ae6-3414-4ff6-a185-96780d860579 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:54.372594 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36649ae6-3414-4ff6-a185-96780d860579 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:54.373883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b5ba9-32e5-469f-b22e-81d765d39c6d None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:54.374190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36649ae6-3414-4ff6-a185-96780d860579 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:54.397045 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 356/707] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Sep 6 20:06:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:54.404667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a11eb6-ae2b-436f-a326-56431beb3a76 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:54.405331 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a11eb6-ae2b-436f-a326-56431beb3a76 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:54.405554 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a11eb6-ae2b-436f-a326-56431beb3a76 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:54.407338 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 357/708] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:54 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:54.411493 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a11eb6-ae2b-436f-a326-56431beb3a76 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:54.422195 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2991aa0-8fc4-416a-a810-2ba9a8926801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:54.422925 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2991aa0-8fc4-416a-a810-2ba9a8926801 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:54.423425 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2991aa0-8fc4-416a-a810-2ba9a8926801 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:54.424034 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2991aa0-8fc4-416a-a810-2ba9a8926801 None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:54.425253 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2991aa0-8fc4-416a-a810-2ba9a8926801 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:54.425876 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2991aa0-8fc4-416a-a810-2ba9a8926801 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:54.427817 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2991aa0-8fc4-416a-a810-2ba9a8926801 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:54.434663 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 352/709] 10.222.0.77 () {56 vars in 1124 bytes} [Tue Sep 6 20:06:54 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:54.436067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52045b87-e4cf-45e6-948d-4eba4f8981f5 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:54.437050 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52045b87-e4cf-45e6-948d-4eba4f8981f5 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:54.437434 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52045b87-e4cf-45e6-948d-4eba4f8981f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:54.457213 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-52045b87-e4cf-45e6-948d-4eba4f8981f5 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:54.458510 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-52045b87-e4cf-45e6-948d-4eba4f8981f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:54.535315 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a11eb6-ae2b-436f-a326-56431beb3a76 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:54.535615 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 353/710] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:54.583705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ac677-fd5f-4bbb-b487-bddda55b2193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:54.584323 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ac677-fd5f-4bbb-b487-bddda55b2193 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:54.584605 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ac677-fd5f-4bbb-b487-bddda55b2193 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:54.584878 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ac677-fd5f-4bbb-b487-bddda55b2193 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:54.649956 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:54.666761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ac677-fd5f-4bbb-b487-bddda55b2193 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:54.668271 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ac677-fd5f-4bbb-b487-bddda55b2193 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:54.783044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 358/711] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:06:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:06:54.788605 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52045b87-e4cf-45e6-948d-4eba4f8981f5 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:54.877803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:54.926008 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52045b87-e4cf-45e6-948d-4eba4f8981f5 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:54.964434 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4649a-69af-4eb6-8e64-cd02f29b4ee1 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:54.964722 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4649a-69af-4eb6-8e64-cd02f29b4ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:54.965004 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4649a-69af-4eb6-8e64-cd02f29b4ee1 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:54.966391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 359/712] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:54.975200 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f78bc5-d452-4306-89a5-1d39032cf1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:54.976228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f78bc5-d452-4306-89a5-1d39032cf1fa None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:54.976926 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f78bc5-d452-4306-89a5-1d39032cf1fa None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:54.977523 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8b72f-9f60-4b10-b909-275b5f29c73f None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:54.977817 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8b72f-9f60-4b10-b909-275b5f29c73f None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:54.977991 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f78bc5-d452-4306-89a5-1d39032cf1fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:54.978150 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8b72f-9f60-4b10-b909-275b5f29c73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:54.990733 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f78bc5-d452-4306-89a5-1d39032cf1fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:54.992455 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f78bc5-d452-4306-89a5-1d39032cf1fa None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:54.998764 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-4af8b72f-9f60-4b10-b909-275b5f29c73f None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:55.000664 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-4af8b72f-9f60-4b10-b909-275b5f29c73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:55.010805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-18f78bc5-d452-4306-89a5-1d39032cf1fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:55.010805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:55.010805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:55.010805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:55.010805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:55.010805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:55.010805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:55.010805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:55.010805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:55.010805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:55.010805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:55.010805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:55.010805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:55.010805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:55.010805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:55.010805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:55.012007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:55.012007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:55.012007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:55.012007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:55.012007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:55.012007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:55.012007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:55.012007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:55.012007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:55.012007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:55.012007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:55.012007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:55.012007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:55.012007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:55.012007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:55.012007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:55.012007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:55.013067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:55.013067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:55.013067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:55.015312 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 354/713] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:06:55.016291 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f78bc5-d452-4306-89a5-1d39032cf1fa None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:55.098132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 360/714] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:55.099631 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8b72f-9f60-4b10-b909-275b5f29c73f None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:55.124060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:55.154812 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f78bc5-d452-4306-89a5-1d39032cf1fa None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:55.172270 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:55.194179 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83710bd-9fa3-4161-9501-2391b7f5878f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:55.195279 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83710bd-9fa3-4161-9501-2391b7f5878f None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:55.195743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83710bd-9fa3-4161-9501-2391b7f5878f None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:55.196160 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83710bd-9fa3-4161-9501-2391b7f5878f None admin] PATH_INFO: `/v3/services/network` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:55.196915 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83710bd-9fa3-4161-9501-2391b7f5878f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:55.198456 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83710bd-9fa3-4161-9501-2391b7f5878f None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:55.209909 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-d83710bd-9fa3-4161-9501-2391b7f5878f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 20:06:55.209909 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:55.209909 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 20:06:55.209909 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 20:06:55.209909 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 20:06:55.209909 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 20:06:55.209909 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 20:06:55.209909 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:06:55.209909 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 20:06:55.209909 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:55.209909 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:06:55.209909 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:55.209909 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:55.209909 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:55.209909 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:55.209909 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:55.209909 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:55.211181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:55.211181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:55.211181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:55.211181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:55.211181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:55.211181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:55.211181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 20:06:55.211181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 20:06:55.211181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 20:06:55.211181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 20:06:55.211181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:55.211181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:55.211181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:55.211181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:55.211181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:55.211181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:55.212187 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:55.212187 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:55.212187 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:55.212187 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:55.212187 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:55.212187 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:55.212187 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:55.212187 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:55.212187 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:55.212187 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:55.212187 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 20:06:55.212187 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:06:55.212187 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 20:06:55.212187 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:55.214547 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 355/715] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:06:55 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:55.230195 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83710bd-9fa3-4161-9501-2391b7f5878f None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:55.234469 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8b72f-9f60-4b10-b909-275b5f29c73f None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:55.286207 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95dd00-3c81-4212-99fa-d94d91d75483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:55.286738 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95dd00-3c81-4212-99fa-d94d91d75483 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:55.287059 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95dd00-3c81-4212-99fa-d94d91d75483 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:55.287342 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95dd00-3c81-4212-99fa-d94d91d75483 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:55.288027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95dd00-3c81-4212-99fa-d94d91d75483 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:55.288335 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95dd00-3c81-4212-99fa-d94d91d75483 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:55.289913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95dd00-3c81-4212-99fa-d94d91d75483 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:55.311604 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 361/716] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:55.317332 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95dd00-3c81-4212-99fa-d94d91d75483 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:55.384869 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83710bd-9fa3-4161-9501-2391b7f5878f None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:55.452020 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:55.453331 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6a0a4-a912-495b-9563-beb6d88bea02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:55.453970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6a0a4-a912-495b-9563-beb6d88bea02 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:55.454251 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6a0a4-a912-495b-9563-beb6d88bea02 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:55.454522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6a0a4-a912-495b-9563-beb6d88bea02 None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:55.455172 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6a0a4-a912-495b-9563-beb6d88bea02 None admin] RBAC: Adding query filter params (name=network) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:55.455499 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6a0a4-a912-495b-9563-beb6d88bea02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:55.456950 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6a0a4-a912-495b-9563-beb6d88bea02 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:55.468092 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 356/717] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Sep 6 20:06:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:06:55.469034 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6a0a4-a912-495b-9563-beb6d88bea02 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:55.480739 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95dd00-3c81-4212-99fa-d94d91d75483 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:55.525860 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65462009-0750-4253-af75-42f4f68c1985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:55.526510 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65462009-0750-4253-af75-42f4f68c1985 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:55.529472 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65462009-0750-4253-af75-42f4f68c1985 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:55.529472 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65462009-0750-4253-af75-42f4f68c1985 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:55.544207 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65462009-0750-4253-af75-42f4f68c1985 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:55.545705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65462009-0750-4253-af75-42f4f68c1985 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:55.567816 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-65462009-0750-4253-af75-42f4f68c1985 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:55.567816 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:55.567816 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:55.567816 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:55.567816 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:55.567816 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:55.567816 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:55.567816 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:55.567816 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:55.567816 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:55.567816 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:55.567816 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:55.567816 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:06:55.567816 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:06:55.567816 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:06:55.570287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:06:55.570287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:55.570287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:55.570287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:55.570287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:55.570287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:55.570287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:55.570287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:55.570287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:55.570287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:55.570287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:55.570287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:55.570287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:55.570287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:55.570287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:55.570287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:55.570287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:55.571194 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:06:55.571194 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:06:55.571194 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:06:55.571194 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:06:55.571194 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:06:55.571194 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:06:55.571194 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:55.571194 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:55.571194 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 362/718] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:06:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:06:55.574717 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:55.575769 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65462009-0750-4253-af75-42f4f68c1985 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:55.649274 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6a0a4-a912-495b-9563-beb6d88bea02 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:55.690323 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65462009-0750-4253-af75-42f4f68c1985 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:55.695802 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf43a96-214a-4d5c-83ef-87dfa06eb4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:55.696424 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf43a96-214a-4d5c-83ef-87dfa06eb4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:55.696702 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf43a96-214a-4d5c-83ef-87dfa06eb4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:55.696977 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf43a96-214a-4d5c-83ef-87dfa06eb4c5 None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:55.697610 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf43a96-214a-4d5c-83ef-87dfa06eb4c5 None admin] RBAC: Adding query filter params (type=network) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:55.697917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf43a96-214a-4d5c-83ef-87dfa06eb4c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:55.699561 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf43a96-214a-4d5c-83ef-87dfa06eb4c5 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:55.707647 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 357/719] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Sep 6 20:06:55 2022] GET /identity/v3/services?type=network => generated 124 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:55.708409 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf43a96-214a-4d5c-83ef-87dfa06eb4c5 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:55.743320 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae716cc0-b5e8-4283-897b-abc5e6390c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:55.744038 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae716cc0-b5e8-4283-897b-abc5e6390c55 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:55.744313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae716cc0-b5e8-4283-897b-abc5e6390c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:55.746320 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae716cc0-b5e8-4283-897b-abc5e6390c55 None admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:55.747129 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae716cc0-b5e8-4283-897b-abc5e6390c55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:55.747465 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae716cc0-b5e8-4283-897b-abc5e6390c55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:55.751377 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae716cc0-b5e8-4283-897b-abc5e6390c55 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:55.760686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:55.787825 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 363/720] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:06:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:55.793890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae716cc0-b5e8-4283-897b-abc5e6390c55 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:55.928759 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae716cc0-b5e8-4283-897b-abc5e6390c55 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:55.948605 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf43a96-214a-4d5c-83ef-87dfa06eb4c5 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:55.957854 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:55.971154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2e780-51b9-4ebb-abbf-15b08a34a7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:55.971880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2e780-51b9-4ebb-abbf-15b08a34a7c1 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:55.972160 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2e780-51b9-4ebb-abbf-15b08a34a7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:55.972487 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2e780-51b9-4ebb-abbf-15b08a34a7c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:55.978067 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2e780-51b9-4ebb-abbf-15b08a34a7c1 None admin] RBAC: Adding query filter params (role.id=1e2ac44410664e6b8f42ab3c37e2643f, scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343, user.id=b09ce16da49b4af38491ad4eb6287d70) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:55.978067 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2e780-51b9-4ebb-abbf-15b08a34a7c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:55.978067 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2e780-51b9-4ebb-abbf-15b08a34a7c1 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:55.985218 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 364/721] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:06:55 2022] GET /identity/v3/role_assignments?user.id=b09ce16da49b4af38491ad4eb6287d70&scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343&role.id=1e2ac44410664e6b8f42ab3c37e2643f => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:06:55.995833 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f09522-507d-43e5-ae8e-dd5a93fb8c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:55.996362 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f09522-507d-43e5-ae8e-dd5a93fb8c60 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:55.996639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f09522-507d-43e5-ae8e-dd5a93fb8c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:55.996906 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f09522-507d-43e5-ae8e-dd5a93fb8c60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:56.012992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f09522-507d-43e5-ae8e-dd5a93fb8c60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:56.018294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-00f09522-507d-43e5-ae8e-dd5a93fb8c60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:06:56.018294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:56.018294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:56.018294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:56.018294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:56.018294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:56.018294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:56.018294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:56.018294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:56.018294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:56.018294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:56.018294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:56.018294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:56.018294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:56.018294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:56.018294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:56.019290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:56.019290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:56.019290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:56.019290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:56.019290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:56.019290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:56.019290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:56.019290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:56.019290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:56.019290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:56.019290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:56.019290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:56.019290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:56.019290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:56.019290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:56.019290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:56.020145 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:56.020145 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:56.020145 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:56.020145 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:56.020145 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:56.020145 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:56.020145 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:56.020145 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:56.020145 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:56.020145 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:56.020145 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:06:56.020145 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:56.020145 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 358/722] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:06:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:56.025790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2e780-51b9-4ebb-abbf-15b08a34a7c1 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:56.101509 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:56.168060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2e780-51b9-4ebb-abbf-15b08a34a7c1 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:56.219349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f87d89-a891-48c3-a0bb-9536c91836bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:56.219926 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f87d89-a891-48c3-a0bb-9536c91836bb None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:56.220209 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f87d89-a891-48c3-a0bb-9536c91836bb None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:56.220482 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f87d89-a891-48c3-a0bb-9536c91836bb None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:56.221176 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f87d89-a891-48c3-a0bb-9536c91836bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:56.221477 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f87d89-a891-48c3-a0bb-9536c91836bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:56.223263 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f87d89-a891-48c3-a0bb-9536c91836bb None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:56.239198 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 365/723] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:06:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:56.245314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f09522-507d-43e5-ae8e-dd5a93fb8c60 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:56.384395 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f09522-507d-43e5-ae8e-dd5a93fb8c60 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:56.429535 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31c140-a842-4eb6-b388-aa34c8d9f317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:56.430185 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31c140-a842-4eb6-b388-aa34c8d9f317 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:56.430463 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31c140-a842-4eb6-b388-aa34c8d9f317 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:56.430734 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31c140-a842-4eb6-b388-aa34c8d9f317 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:56.447652 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31c140-a842-4eb6-b388-aa34c8d9f317 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:56.449108 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31c140-a842-4eb6-b388-aa34c8d9f317 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:56.469760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-1c31c140-a842-4eb6-b388-aa34c8d9f317 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:56.469760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:56.469760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:56.469760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:56.469760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:56.469760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:56.469760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:56.469760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:56.469760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:56.469760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:56.469760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:56.469760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:56.469760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:56.469760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:56.469760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:56.469760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:56.470763 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:56.470763 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:56.470763 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:56.470763 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:56.470763 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:56.470763 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:56.470763 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:56.470763 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:56.470763 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:56.470763 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:56.470763 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:56.470763 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:56.470763 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:56.470763 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:56.470763 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:56.470763 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:56.470763 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:56.471675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:56.471675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:56.471675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:56.471675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 359/724] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:56.476502 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f87d89-a891-48c3-a0bb-9536c91836bb None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:56.623296 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f87d89-a891-48c3-a0bb-9536c91836bb None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:56.647728 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:56.659948 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b6c1e-aa09-46a1-bebd-040caa211e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:56.660559 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b6c1e-aa09-46a1-bebd-040caa211e26 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:56.660841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b6c1e-aa09-46a1-bebd-040caa211e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:56.661116 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b6c1e-aa09-46a1-bebd-040caa211e26 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:56.661764 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b6c1e-aa09-46a1-bebd-040caa211e26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:56.662069 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b6c1e-aa09-46a1-bebd-040caa211e26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:56.663467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b6c1e-aa09-46a1-bebd-040caa211e26 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:56.676288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 366/725] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:56.688621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31c140-a842-4eb6-b388-aa34c8d9f317 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:56.700673 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18738b-96d9-4298-bdd4-f723e309f453 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:56.700984 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18738b-96d9-4298-bdd4-f723e309f453 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:56.701231 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18738b-96d9-4298-bdd4-f723e309f453 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:56.708451 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 367/726] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:56.711569 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be86db-3d33-4f95-8d99-1a7b2182f6bf None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:56.711858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be86db-3d33-4f95-8d99-1a7b2182f6bf None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:56.712133 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be86db-3d33-4f95-8d99-1a7b2182f6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:56.745668 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-21be86db-3d33-4f95-8d99-1a7b2182f6bf None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:56.747200 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-21be86db-3d33-4f95-8d99-1a7b2182f6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:56.752870 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:56.813388 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31c140-a842-4eb6-b388-aa34c8d9f317 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:56.850325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930ce38-c6bb-462e-83eb-4915b04872a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:56.851029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930ce38-c6bb-462e-83eb-4915b04872a9 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:56.851314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930ce38-c6bb-462e-83eb-4915b04872a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:56.851619 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930ce38-c6bb-462e-83eb-4915b04872a9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:56.860087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930ce38-c6bb-462e-83eb-4915b04872a9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:56.861610 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930ce38-c6bb-462e-83eb-4915b04872a9 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:56.873659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-b930ce38-c6bb-462e-83eb-4915b04872a9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 20:06:56.873659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:56.873659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:56.873659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:56.873659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:56.873659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:56.873659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:56.873659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:56.873659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:56.873659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:56.873659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:56.873659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:56.873659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:06:56.873659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:06:56.873659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:06:56.873659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:06:56.874745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:56.874745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:56.874745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:06:56.874745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:56.874745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:06:56.874745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:56.874745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:56.874745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:56.874745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:56.874745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:56.874745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:56.874745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:56.874745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:56.874745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:56.874745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:56.874745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:56.874745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:56.874745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:56.875722 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:56.875722 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:56.875722 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:06:56.875722 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:06:56.875722 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:06:56.875722 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:06:56.875722 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:06:56.875722 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:06:56.875722 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 20:06:56.875722 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:56.879588 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 360/727] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:06:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:56.881511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930ce38-c6bb-462e-83eb-4915b04872a9 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:56.901256 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 368/728] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:56.976011 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:56.994202 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930ce38-c6bb-462e-83eb-4915b04872a9 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:57.033876 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6ec64-2fc1-40c8-b4c8-9f8e17ac8703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:57.034503 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6ec64-2fc1-40c8-b4c8-9f8e17ac8703 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:57.034784 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6ec64-2fc1-40c8-b4c8-9f8e17ac8703 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:57.035060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6ec64-2fc1-40c8-b4c8-9f8e17ac8703 None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:57.035830 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6ec64-2fc1-40c8-b4c8-9f8e17ac8703 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:57.036140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6ec64-2fc1-40c8-b4c8-9f8e17ac8703 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:57.037595 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6ec64-2fc1-40c8-b4c8-9f8e17ac8703 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:57.062494 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 361/729] 10.222.0.77 () {56 vars in 1135 bytes} [Tue Sep 6 20:06:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:06:57.064024 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be86db-3d33-4f95-8d99-1a7b2182f6bf None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:57.219879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be86db-3d33-4f95-8d99-1a7b2182f6bf None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:57.240553 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:57.269366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd550eca-a2b5-4e3e-9a83-fccf0d074e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:57.270015 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd550eca-a2b5-4e3e-9a83-fccf0d074e8f None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:57.270300 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd550eca-a2b5-4e3e-9a83-fccf0d074e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:57.270574 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd550eca-a2b5-4e3e-9a83-fccf0d074e8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:57.359318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd550eca-a2b5-4e3e-9a83-fccf0d074e8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:57.360748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd550eca-a2b5-4e3e-9a83-fccf0d074e8f None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:57.415050 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6ec64-2fc1-40c8-b4c8-9f8e17ac8703 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:57.536413 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6ec64-2fc1-40c8-b4c8-9f8e17ac8703 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:57.572250 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcce34-d823-4e44-970a-fa8e04a12f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:57.572893 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcce34-d823-4e44-970a-fa8e04a12f4c None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:57.573174 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcce34-d823-4e44-970a-fa8e04a12f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:57.573448 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcce34-d823-4e44-970a-fa8e04a12f4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:57.576321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:57.585536 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcce34-d823-4e44-970a-fa8e04a12f4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:57.590592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-80dcce34-d823-4e44-970a-fa8e04a12f4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:57.590592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:57.590592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:57.590592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:57.590592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:57.590592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:57.590592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:57.590592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:57.590592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:57.590592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:57.590592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:57.590592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:57.590592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:57.590592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:57.590592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:57.590592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:57.591545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:57.591545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:57.591545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:57.591545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:57.591545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:57.591545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:57.591545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:57.591545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:57.591545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:57.591545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:57.591545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:57.591545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:57.591545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:57.591545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:57.591545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:57.591545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:57.592377 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:57.592377 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:57.592377 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:57.592377 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:57.592377 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:57.592377 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:57.592377 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:57.592377 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:57.592377 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:57.592377 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:57.592377 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:06:57.592377 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:57.592377 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 362/730] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Sep 6 20:06:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:06:57.602580 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795e1f6-f93c-4d6b-8e28-6e3def0dd24c None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:57.602580 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795e1f6-f93c-4d6b-8e28-6e3def0dd24c None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:57.602580 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795e1f6-f93c-4d6b-8e28-6e3def0dd24c None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:57.602580 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 363/731] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:57.602580 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795e1f6-f93c-4d6b-8e28-6e3def0dd24c None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:57.616543 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 369/732] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:06:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:06:57.618429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82fc6f-d40a-4c00-b9bc-1ca011e5b103 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:57.618921 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82fc6f-d40a-4c00-b9bc-1ca011e5b103 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:57.619386 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82fc6f-d40a-4c00-b9bc-1ca011e5b103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:57.639766 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-5e82fc6f-d40a-4c00-b9bc-1ca011e5b103 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:57.641524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-5e82fc6f-d40a-4c00-b9bc-1ca011e5b103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:57.656051 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:57.725972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795e1f6-f93c-4d6b-8e28-6e3def0dd24c None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:57.726307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 370/733] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:57.727324 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82fc6f-d40a-4c00-b9bc-1ca011e5b103 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:57.765040 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed5bb7-4c40-4033-97d2-be8e96e04081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:57.765731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed5bb7-4c40-4033-97d2-be8e96e04081 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:57.766009 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed5bb7-4c40-4033-97d2-be8e96e04081 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:57.766287 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed5bb7-4c40-4033-97d2-be8e96e04081 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:57.766999 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed5bb7-4c40-4033-97d2-be8e96e04081 None admin] RBAC: Adding query filter params (name=service) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:57.767309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed5bb7-4c40-4033-97d2-be8e96e04081 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:57.768824 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed5bb7-4c40-4033-97d2-be8e96e04081 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:57.778552 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 364/734] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Sep 6 20:06:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:57.786376 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed5bb7-4c40-4033-97d2-be8e96e04081 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:57.847159 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82fc6f-d40a-4c00-b9bc-1ca011e5b103 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:57.888186 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c89aa8-69c5-4cea-b904-ceed454378ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:57.888810 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c89aa8-69c5-4cea-b904-ceed454378ab None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:57.889084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c89aa8-69c5-4cea-b904-ceed454378ab None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:57.889576 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c89aa8-69c5-4cea-b904-ceed454378ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:57.897053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:57.902981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c89aa8-69c5-4cea-b904-ceed454378ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:57.905581 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c89aa8-69c5-4cea-b904-ceed454378ab None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:57.908072 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:57.924633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-41c89aa8-69c5-4cea-b904-ceed454378ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:57.924633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:57.924633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:57.924633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:57.924633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:57.924633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:57.924633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:57.924633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:57.924633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:57.924633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:57.924633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:57.924633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:57.924633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:57.924633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:57.924633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:57.924633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:57.925873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:57.925873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:57.925873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:57.925873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:57.925873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:57.925873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:57.925873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:57.925873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:57.925873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:57.925873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:57.925873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:57.925873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:57.925873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:57.925873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:57.925873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:57.925873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:57.925873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:57.927071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:57.927071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:57.927071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:57.928916 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 371/735] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:57.937489 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c89aa8-69c5-4cea-b904-ceed454378ab None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:57.962297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed5bb7-4c40-4033-97d2-be8e96e04081 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:58.002568 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2ad52-aa73-49bb-af25-c7c78df21141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:58.003322 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2ad52-aa73-49bb-af25-c7c78df21141 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:58.003643 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2ad52-aa73-49bb-af25-c7c78df21141 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:58.003921 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2ad52-aa73-49bb-af25-c7c78df21141 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:58.015862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2ad52-aa73-49bb-af25-c7c78df21141 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:58.017488 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2ad52-aa73-49bb-af25-c7c78df21141 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:58.033834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-cff2ad52-aa73-49bb-af25-c7c78df21141 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:58.033834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:58.033834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:58.033834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:58.033834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:58.033834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:58.033834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:58.033834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:58.033834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:58.033834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:58.033834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:58.033834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:58.033834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:06:58.033834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:06:58.033834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:06:58.033834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:06:58.034956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:58.034956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:58.034956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:58.034956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:58.034956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:58.034956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:58.034956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:58.034956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:58.034956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:58.034956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:58.034956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:58.034956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:58.034956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:58.034956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:58.034956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:58.034956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:58.034956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:06:58.035979 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:06:58.035979 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:06:58.035979 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:58.035979 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 365/736] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:58.042961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2ad52-aa73-49bb-af25-c7c78df21141 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:58.121724 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c89aa8-69c5-4cea-b904-ceed454378ab None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:58.167642 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d392f-8970-4ce5-a65c-00b749c9516d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:58.168172 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d392f-8970-4ce5-a65c-00b749c9516d None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:58.168450 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d392f-8970-4ce5-a65c-00b749c9516d None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:58.168718 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d392f-8970-4ce5-a65c-00b749c9516d None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:58.169356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d392f-8970-4ce5-a65c-00b749c9516d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:58.169654 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d392f-8970-4ce5-a65c-00b749c9516d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:58.172479 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d392f-8970-4ce5-a65c-00b749c9516d None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:58.187341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 372/737] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:58.188273 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d392f-8970-4ce5-a65c-00b749c9516d None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:58.217731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2ad52-aa73-49bb-af25-c7c78df21141 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:58.235119 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:58.258570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:58.269724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7d7c7-b9b3-47e0-9e7d-6f5b9ab0e194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:58.271611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7d7c7-b9b3-47e0-9e7d-6f5b9ab0e194 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:58.271611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7d7c7-b9b3-47e0-9e7d-6f5b9ab0e194 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:58.272448 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7d7c7-b9b3-47e0-9e7d-6f5b9ab0e194 None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:58.273280 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7d7c7-b9b3-47e0-9e7d-6f5b9ab0e194 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:58.273956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7d7c7-b9b3-47e0-9e7d-6f5b9ab0e194 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:58.276378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7d7c7-b9b3-47e0-9e7d-6f5b9ab0e194 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:58.294218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 366/738] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:58.296600 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7d7c7-b9b3-47e0-9e7d-6f5b9ab0e194 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:58.308662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d392f-8970-4ce5-a65c-00b749c9516d None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:58.347767 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8ec5b-e462-4a33-a886-336f2c91c777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:58.348493 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8ec5b-e462-4a33-a886-336f2c91c777 None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:58.348848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8ec5b-e462-4a33-a886-336f2c91c777 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:58.349195 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8ec5b-e462-4a33-a886-336f2c91c777 None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:58.350290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8ec5b-e462-4a33-a886-336f2c91c777 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:58.351467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8ec5b-e462-4a33-a886-336f2c91c777 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:58.419599 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7d7c7-b9b3-47e0-9e7d-6f5b9ab0e194 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:58.460317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3da6cf-25f0-4aa5-8df3-b52fed6d157f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:58.461028 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3da6cf-25f0-4aa5-8df3-b52fed6d157f None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:58.464351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3da6cf-25f0-4aa5-8df3-b52fed6d157f None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:58.464351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3da6cf-25f0-4aa5-8df3-b52fed6d157f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:58.482019 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3da6cf-25f0-4aa5-8df3-b52fed6d157f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:58.484246 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3da6cf-25f0-4aa5-8df3-b52fed6d157f None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:58.497958 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-aa3da6cf-25f0-4aa5-8df3-b52fed6d157f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:58.497958 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:58.497958 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:58.497958 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:58.497958 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:58.497958 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:58.497958 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:58.497958 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:58.497958 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:58.497958 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:58.497958 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:58.497958 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:58.497958 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:06:58.497958 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:06:58.497958 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:06:58.499069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:06:58.499069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:58.499069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:58.499069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:58.499069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:58.499069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:58.499069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:58.499069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:58.499069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:58.499069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:58.499069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:58.499069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:58.499069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:58.499069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:58.499069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:58.499069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:58.499069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:58.500011 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:06:58.500011 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:06:58.500011 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:06:58.500011 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:06:58.500011 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:06:58.500011 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:06:58.500011 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:06:58.500011 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:58.500011 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 367/739] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:06:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:58.501337 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3da6cf-25f0-4aa5-8df3-b52fed6d157f None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:58.523676 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 373/740] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Sep 6 20:06:58 2022] POST /identity/v3/services => generated 251 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:06:58.524903 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8ec5b-e462-4a33-a886-336f2c91c777 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:58.567697 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:58.666326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3da6cf-25f0-4aa5-8df3-b52fed6d157f None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:58.701971 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8ec5b-e462-4a33-a886-336f2c91c777 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:58.706814 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e7e29-7763-43db-800c-11791d7e4e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:58.707509 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e7e29-7763-43db-800c-11791d7e4e3a None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:58.707795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e7e29-7763-43db-800c-11791d7e4e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:58.708053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e7e29-7763-43db-800c-11791d7e4e3a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:58.714152 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:58.716494 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e7e29-7763-43db-800c-11791d7e4e3a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:58.718608 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e7e29-7763-43db-800c-11791d7e4e3a None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:58.745317 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f538d8c-292c-4bf8-8727-7812bfced42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:58.746227 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f538d8c-292c-4bf8-8727-7812bfced42f None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:58.746661 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f538d8c-292c-4bf8-8727-7812bfced42f None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:58.747085 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f538d8c-292c-4bf8-8727-7812bfced42f None admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:58.747985 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f538d8c-292c-4bf8-8727-7812bfced42f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:58.748485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f538d8c-292c-4bf8-8727-7812bfced42f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:58.750171 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f538d8c-292c-4bf8-8727-7812bfced42f None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:58.767617 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 374/741] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:06:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:58.769300 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dffbe0-ffd3-4d75-801c-7578bdfb3b65 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:58.769839 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dffbe0-ffd3-4d75-801c-7578bdfb3b65 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:58.770298 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dffbe0-ffd3-4d75-801c-7578bdfb3b65 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:58.772081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 375/742] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:58.773686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838837fc-d5db-4afa-a594-9437f4837baf None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:58.773978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838837fc-d5db-4afa-a594-9437f4837baf None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:58.774264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838837fc-d5db-4afa-a594-9437f4837baf None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:58.775999 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 376/743] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:06:58.783996 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838837fc-d5db-4afa-a594-9437f4837baf None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:58.846963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-337e7e29-7763-43db-800c-11791d7e4e3a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 20:06:58.846963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:58.846963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:58.846963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:58.846963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:58.846963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:58.846963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:58.846963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:58.846963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:58.846963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:58.846963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:58.846963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:58.846963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:06:58.846963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:06:58.846963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:06:58.846963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:06:58.848092 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:58.848092 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:58.848092 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:06:58.848092 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:58.848092 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:06:58.848092 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:06:58.848092 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:58.848092 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:58.848092 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:58.848092 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:58.848092 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:58.848092 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:58.848092 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:58.848092 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:58.848092 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:58.848092 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:58.848092 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:58.848092 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:58.849054 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:58.849054 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:58.849054 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:06:58.849054 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:06:58.849054 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:06:58.849054 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:06:58.849054 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:06:58.849054 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:06:58.849054 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 20:06:58.849054 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:06:58.849054 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 368/744] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Sep 6 20:06:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:58.849702 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc8244-70bb-45e6-ae5a-20e101e31c90 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:58.850795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc8244-70bb-45e6-ae5a-20e101e31c90 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:58.850795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc8244-70bb-45e6-ae5a-20e101e31c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:58.872170 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-73dc8244-70bb-45e6-ae5a-20e101e31c90 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:58.873434 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-73dc8244-70bb-45e6-ae5a-20e101e31c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:58.934972 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838837fc-d5db-4afa-a594-9437f4837baf None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:58.959506 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 369/745] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:58 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:58.959506 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76c5d9-8197-43ef-a6b4-0d9d3af21441 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:58.959506 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76c5d9-8197-43ef-a6b4-0d9d3af21441 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:58.959506 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76c5d9-8197-43ef-a6b4-0d9d3af21441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:58.979087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-fa76c5d9-8197-43ef-a6b4-0d9d3af21441 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:06:58.981085 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-fa76c5d9-8197-43ef-a6b4-0d9d3af21441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:06:58.990665 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495578c-dc88-4c4d-ab17-e7704508feb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:58.991476 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495578c-dc88-4c4d-ab17-e7704508feb3 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:58.993084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495578c-dc88-4c4d-ab17-e7704508feb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:58.993457 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495578c-dc88-4c4d-ab17-e7704508feb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:58.994348 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495578c-dc88-4c4d-ab17-e7704508feb3 None admin] RBAC: Adding query filter params (role.id=1e2ac44410664e6b8f42ab3c37e2643f, scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343, user.id=5a6c4f91a59548fd979e7232a2afd6ec) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:58.994783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495578c-dc88-4c4d-ab17-e7704508feb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:58.996491 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495578c-dc88-4c4d-ab17-e7704508feb3 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:59.003916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:59.016111 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 377/746] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:06:58 2022] GET /identity/v3/role_assignments?user.id=5a6c4f91a59548fd979e7232a2afd6ec&scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343&role.id=1e2ac44410664e6b8f42ab3c37e2643f => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:59.017643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495578c-dc88-4c4d-ab17-e7704508feb3 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:59.089157 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 370/747] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:06:58 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 20:06:59.099483 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:59.175597 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495578c-dc88-4c4d-ab17-e7704508feb3 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:59.221101 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd6f92-52fb-48a6-bbec-7ba889ecd30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:59.221747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd6f92-52fb-48a6-bbec-7ba889ecd30e None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:59.222027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd6f92-52fb-48a6-bbec-7ba889ecd30e None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:59.222299 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd6f92-52fb-48a6-bbec-7ba889ecd30e None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:59.223041 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd6f92-52fb-48a6-bbec-7ba889ecd30e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:06:59.223348 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd6f92-52fb-48a6-bbec-7ba889ecd30e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:59.224826 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd6f92-52fb-48a6-bbec-7ba889ecd30e None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:59.245423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 378/748] 10.222.0.77 () {56 vars in 1149 bytes} [Tue Sep 6 20:06:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:06:59.250771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76c5d9-8197-43ef-a6b4-0d9d3af21441 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:59.277527 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd6f92-52fb-48a6-bbec-7ba889ecd30e None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:59.398436 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd6f92-52fb-48a6-bbec-7ba889ecd30e None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:59.411999 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:59.443927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d5872-ec80-4570-8f61-b972ffc4e6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:59.444741 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d5872-ec80-4570-8f61-b972ffc4e6b1 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:59.445115 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d5872-ec80-4570-8f61-b972ffc4e6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:59.446382 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d5872-ec80-4570-8f61-b972ffc4e6b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:59.459953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d5872-ec80-4570-8f61-b972ffc4e6b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:06:59.466339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-029d5872-ec80-4570-8f61-b972ffc4e6b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:06:59.466339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:06:59.466339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:06:59.466339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:06:59.466339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:06:59.466339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:06:59.466339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:06:59.466339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:06:59.466339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:06:59.466339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:06:59.466339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:06:59.466339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:06:59.466339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:06:59.466339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:06:59.466339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:06:59.466339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:06:59.467343 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:06:59.467343 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:06:59.467343 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:06:59.467343 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:06:59.467343 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:06:59.467343 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:06:59.467343 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:06:59.467343 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:06:59.467343 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:06:59.467343 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:06:59.467343 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:06:59.467343 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:06:59.467343 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:06:59.467343 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:06:59.467343 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:06:59.467343 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:06:59.468866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:06:59.468866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:06:59.468866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:06:59.468866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:06:59.468866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:06:59.468866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:06:59.468866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:06:59.468866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:06:59.468866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:06:59.468866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:06:59.468866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:06:59.468866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:06:59.468866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 379/749] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:06:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:06:59.469558 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d5872-ec80-4570-8f61-b972ffc4e6b1 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:59.493968 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76c5d9-8197-43ef-a6b4-0d9d3af21441 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:59.543383 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51fe60-5d46-47ab-a252-3923bfe401ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:59.544071 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51fe60-5d46-47ab-a252-3923bfe401ec None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:59.544354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51fe60-5d46-47ab-a252-3923bfe401ec None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:59.544632 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51fe60-5d46-47ab-a252-3923bfe401ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:59.569601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:59.637346 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51fe60-5d46-47ab-a252-3923bfe401ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:59.638036 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d5872-ec80-4570-8f61-b972ffc4e6b1 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:06:59.638818 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51fe60-5d46-47ab-a252-3923bfe401ec None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:59.696374 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819e58b-0b5e-4690-8f0b-676a81dbfb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:06:59.697691 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819e58b-0b5e-4690-8f0b-676a81dbfb6e None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:06:59.698322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819e58b-0b5e-4690-8f0b-676a81dbfb6e None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:06:59.698796 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819e58b-0b5e-4690-8f0b-676a81dbfb6e None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:06:59.699831 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819e58b-0b5e-4690-8f0b-676a81dbfb6e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:06:59.701744 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819e58b-0b5e-4690-8f0b-676a81dbfb6e None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:06:59.767259 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 371/750] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:06:59 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 20:06:59.768034 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51fe60-5d46-47ab-a252-3923bfe401ec None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:59.788762 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 380/751] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Sep 6 20:06:59 2022] POST /identity/v3/services => generated 240 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:06:59.791495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819e58b-0b5e-4690-8f0b-676a81dbfb6e None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:06:59.832913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:59.880118 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:06:59.954492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819e58b-0b5e-4690-8f0b-676a81dbfb6e None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:00.000165 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e7a78-a277-4f81-892f-7d3877451ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:00.001195 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e7a78-a277-4f81-892f-7d3877451ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:00.001950 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e7a78-a277-4f81-892f-7d3877451ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:00.002446 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e7a78-a277-4f81-892f-7d3877451ba2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:00.016389 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e7a78-a277-4f81-892f-7d3877451ba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:00.018249 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e7a78-a277-4f81-892f-7d3877451ba2 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:00.037281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-b81e7a78-a277-4f81-892f-7d3877451ba2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:00.037281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:00.037281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:00.037281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:00.037281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:00.037281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:00.037281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:00.037281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:00.037281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:00.037281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:00.037281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:00.037281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:00.037281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:07:00.037281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:07:00.037281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:07:00.037281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:07:00.038426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:00.038426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:00.038426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:00.038426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:00.038426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:00.038426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:00.038426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:00.038426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:00.038426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:00.038426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:00.038426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:00.038426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:00.038426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:00.038426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:00.038426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:00.038426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:00.038426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:07:00.039402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:07:00.039402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:00.039402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:00.042001 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 381/752] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:06:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:00.047990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e7a78-a277-4f81-892f-7d3877451ba2 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:00.070223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51fe60-5d46-47ab-a252-3923bfe401ec None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:00.156756 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cc6bc-d5ce-49bd-9e76-93ee32ecdbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:00.157431 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cc6bc-d5ce-49bd-9e76-93ee32ecdbea None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:00.157887 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cc6bc-d5ce-49bd-9e76-93ee32ecdbea None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:00.158394 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cc6bc-d5ce-49bd-9e76-93ee32ecdbea None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:00.159409 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cc6bc-d5ce-49bd-9e76-93ee32ecdbea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:00.159984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cc6bc-d5ce-49bd-9e76-93ee32ecdbea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:00.162263 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cc6bc-d5ce-49bd-9e76-93ee32ecdbea None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:00.175740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:00.183592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 372/753] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:06:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:00.188922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cc6bc-d5ce-49bd-9e76-93ee32ecdbea None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:00.231852 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e7a78-a277-4f81-892f-7d3877451ba2 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:00.277718 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345506d8-dad7-4cb2-9509-91ae10d7f48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:00.278683 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345506d8-dad7-4cb2-9509-91ae10d7f48f None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:00.279162 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345506d8-dad7-4cb2-9509-91ae10d7f48f None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:00.279664 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345506d8-dad7-4cb2-9509-91ae10d7f48f None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:00.280849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345506d8-dad7-4cb2-9509-91ae10d7f48f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:00.281361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345506d8-dad7-4cb2-9509-91ae10d7f48f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:00.283525 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345506d8-dad7-4cb2-9509-91ae10d7f48f None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:00.298902 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 382/754] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:00.304772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345506d8-dad7-4cb2-9509-91ae10d7f48f None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:00.434132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cc6bc-d5ce-49bd-9e76-93ee32ecdbea None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:00.446624 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345506d8-dad7-4cb2-9509-91ae10d7f48f None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:00.469795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:00.472040 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:00.488976 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d84cb8-4996-4bd9-a766-e6affb755217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:00.489626 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d84cb8-4996-4bd9-a766-e6affb755217 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:00.489907 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d84cb8-4996-4bd9-a766-e6affb755217 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:00.490176 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d84cb8-4996-4bd9-a766-e6affb755217 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:00.499459 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d84cb8-4996-4bd9-a766-e6affb755217 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:00.500972 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d84cb8-4996-4bd9-a766-e6affb755217 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:00.515363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-40d84cb8-4996-4bd9-a766-e6affb755217 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:00.515363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:00.515363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:00.515363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:00.515363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:00.515363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:00.515363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:00.515363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:00.515363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:00.515363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:00.515363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:00.515363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:00.515363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:07:00.515363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:07:00.515363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:07:00.519091 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:07:00.519091 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:00.519091 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:00.519091 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:00.519091 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:00.519091 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:00.519091 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:00.519091 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:00.519091 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:00.519091 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:00.519091 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:00.519091 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:00.519091 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:00.519091 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:00.519091 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:00.519091 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:00.519091 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:00.520083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:07:00.520083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:07:00.520083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:07:00.520083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:07:00.520083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:07:00.520083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:07:00.520083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:00.520083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:00.520083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 383/755] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:07:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:07:00.522857 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d84cb8-4996-4bd9-a766-e6affb755217 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:00.562616 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cead0-d13e-4a29-affa-44c650be3be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:00.563357 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cead0-d13e-4a29-affa-44c650be3be0 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:00.563581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cead0-d13e-4a29-affa-44c650be3be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:00.563852 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cead0-d13e-4a29-affa-44c650be3be0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:00.593337 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cead0-d13e-4a29-affa-44c650be3be0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:00.594818 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cead0-d13e-4a29-affa-44c650be3be0 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:00.626442 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-836cead0-d13e-4a29-affa-44c650be3be0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:00.626442 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:00.626442 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:00.626442 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:00.626442 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:00.626442 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:00.626442 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:00.626442 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:00.626442 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:00.626442 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:00.626442 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:00.626442 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:00.626442 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:07:00.626442 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:07:00.626442 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:07:00.626442 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:07:00.629156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:00.629156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:00.629156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:00.629156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:00.629156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:00.629156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:00.629156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:00.629156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:00.629156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:00.629156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:00.629156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:00.629156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:00.629156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:00.629156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:00.629156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:00.629156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:00.629156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:07:00.631217 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:07:00.631217 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:00.631217 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:00.635904 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 373/756] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 448 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:07:00.639658 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d84cb8-4996-4bd9-a766-e6affb755217 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:00.642072 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cead0-d13e-4a29-affa-44c650be3be0 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:00.681606 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1696bcc-0937-4292-a9dd-e8899d560224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:00.682224 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1696bcc-0937-4292-a9dd-e8899d560224 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:00.682506 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1696bcc-0937-4292-a9dd-e8899d560224 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:00.682778 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1696bcc-0937-4292-a9dd-e8899d560224 None admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:00.683515 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1696bcc-0937-4292-a9dd-e8899d560224 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:00.683989 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1696bcc-0937-4292-a9dd-e8899d560224 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:00.685705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1696bcc-0937-4292-a9dd-e8899d560224 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:00.701745 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 384/757] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:07:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:00.707677 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1696bcc-0937-4292-a9dd-e8899d560224 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:00.769940 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:00.847880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1696bcc-0937-4292-a9dd-e8899d560224 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:00.891133 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090452ab-e4d3-4679-a5f5-9ba02fb9f43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:00.892060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090452ab-e4d3-4679-a5f5-9ba02fb9f43f None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:00.893019 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090452ab-e4d3-4679-a5f5-9ba02fb9f43f None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:00.893448 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090452ab-e4d3-4679-a5f5-9ba02fb9f43f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:00.894492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090452ab-e4d3-4679-a5f5-9ba02fb9f43f None admin] RBAC: Adding query filter params (role.id=140b49dfcc2b489ca0504d2e7abfdbdb, scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343, user.id=c314372147b2491cb4481d538056472c) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:00.895085 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090452ab-e4d3-4679-a5f5-9ba02fb9f43f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:00.896722 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090452ab-e4d3-4679-a5f5-9ba02fb9f43f None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:00.897267 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cead0-d13e-4a29-affa-44c650be3be0 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:00.904017 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 385/758] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:07:00 2022] GET /identity/v3/role_assignments?user.id=c314372147b2491cb4481d538056472c&scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343&role.id=140b49dfcc2b489ca0504d2e7abfdbdb => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:00.978368 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef25c8-a809-4521-9473-dae867683bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:00.979462 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef25c8-a809-4521-9473-dae867683bcc None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:00.979891 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef25c8-a809-4521-9473-dae867683bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:00.980269 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef25c8-a809-4521-9473-dae867683bcc None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:00.981060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef25c8-a809-4521-9473-dae867683bcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:00.981622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef25c8-a809-4521-9473-dae867683bcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:00.984272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef25c8-a809-4521-9473-dae867683bcc None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:01.007045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 374/759] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:01.013489 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090452ab-e4d3-4679-a5f5-9ba02fb9f43f None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:01.150334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936677e-9478-4218-b60c-03a2f2f5fce9 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:01.150522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936677e-9478-4218-b60c-03a2f2f5fce9 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:01.150801 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936677e-9478-4218-b60c-03a2f2f5fce9 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:01.155638 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 375/760] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:01.160505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090452ab-e4d3-4679-a5f5-9ba02fb9f43f None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:01.164626 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:01.165113 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5594796-1b46-4540-8f79-c006a5e5fad8 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:01.165406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5594796-1b46-4540-8f79-c006a5e5fad8 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:01.165768 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5594796-1b46-4540-8f79-c006a5e5fad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:01.204740 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-d5594796-1b46-4540-8f79-c006a5e5fad8 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:01.205765 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-d5594796-1b46-4540-8f79-c006a5e5fad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:01.220120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cbbcc-e2fd-400d-ad8d-adef2a4ca0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:01.222865 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cbbcc-e2fd-400d-ad8d-adef2a4ca0f0 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:01.222865 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cbbcc-e2fd-400d-ad8d-adef2a4ca0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:01.222865 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cbbcc-e2fd-400d-ad8d-adef2a4ca0f0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:01.233573 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cbbcc-e2fd-400d-ad8d-adef2a4ca0f0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:01.235536 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:01.236503 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cbbcc-e2fd-400d-ad8d-adef2a4ca0f0 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:01.254473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-e83cbbcc-e2fd-400d-ad8d-adef2a4ca0f0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 20:07:01.254473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:01.254473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:01.254473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:01.254473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:01.254473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:01.254473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:01.254473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:01.254473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:01.254473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:01.254473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:01.254473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:01.254473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:07:01.254473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:07:01.254473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:07:01.254473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:07:01.255625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:01.255625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:01.255625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:07:01.255625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:01.255625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:07:01.255625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:01.255625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:01.255625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:01.255625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:01.255625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:01.255625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:01.255625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:01.255625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:01.255625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:01.255625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:01.255625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:01.255625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:01.255625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:01.256570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:01.256570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:01.256570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:07:01.256570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:07:01.256570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:07:01.256570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:07:01.256570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:07:01.256570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:07:01.256570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 20:07:01.256570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:01.257154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 386/761] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Sep 6 20:07:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:01.266410 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cbbcc-e2fd-400d-ad8d-adef2a4ca0f0 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:01.325081 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 376/762] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 20:07:01.439222 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cbbcc-e2fd-400d-ad8d-adef2a4ca0f0 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:01.488315 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6ad07-2f9d-4f3c-a099-c8fb519b1308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:01.488931 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6ad07-2f9d-4f3c-a099-c8fb519b1308 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:01.489212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6ad07-2f9d-4f3c-a099-c8fb519b1308 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:01.489484 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6ad07-2f9d-4f3c-a099-c8fb519b1308 None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:01.490253 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6ad07-2f9d-4f3c-a099-c8fb519b1308 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:01.490561 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6ad07-2f9d-4f3c-a099-c8fb519b1308 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:01.492047 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6ad07-2f9d-4f3c-a099-c8fb519b1308 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:01.527115 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 387/763] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Sep 6 20:07:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:01.537090 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5594796-1b46-4540-8f79-c006a5e5fad8 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:01.669711 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5594796-1b46-4540-8f79-c006a5e5fad8 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:01.688739 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6ad07-2f9d-4f3c-a099-c8fb519b1308 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:01.706438 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59dc38-0bbc-4304-a498-c914740e2358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:01.706999 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59dc38-0bbc-4304-a498-c914740e2358 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:01.707338 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59dc38-0bbc-4304-a498-c914740e2358 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:01.707653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59dc38-0bbc-4304-a498-c914740e2358 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:01.719133 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59dc38-0bbc-4304-a498-c914740e2358 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:01.720662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59dc38-0bbc-4304-a498-c914740e2358 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:01.737882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-7b59dc38-0bbc-4304-a498-c914740e2358 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:01.737882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:01.737882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:01.737882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:01.737882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:01.737882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:01.737882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:01.737882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:01.737882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:01.737882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:01.737882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:01.737882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:01.737882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:07:01.737882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:07:01.737882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:07:01.737882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:07:01.738960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:01.738960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:01.738960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:01.738960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:01.738960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:01.738960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:01.738960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:01.738960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:01.738960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:01.738960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:01.738960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:01.738960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:01.738960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:01.738960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:01.738960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:01.738960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:01.738960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:07:01.740045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:07:01.740045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:01.740045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:01.740045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 377/764] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:01.746502 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59dc38-0bbc-4304-a498-c914740e2358 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:01.758828 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:01.776094 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:01.861728 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59dc38-0bbc-4304-a498-c914740e2358 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:01.906378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f46b2-291a-4fb8-bdf6-cf9de7f8e1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:01.906994 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f46b2-291a-4fb8-bdf6-cf9de7f8e1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:01.907276 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f46b2-291a-4fb8-bdf6-cf9de7f8e1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:01.907577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f46b2-291a-4fb8-bdf6-cf9de7f8e1f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:01.908223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f46b2-291a-4fb8-bdf6-cf9de7f8e1f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:01.908530 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f46b2-291a-4fb8-bdf6-cf9de7f8e1f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:01.909899 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f46b2-291a-4fb8-bdf6-cf9de7f8e1f9 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:01.926543 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 378/765] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:01.926543 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf709b5-a2c2-4270-99f6-8c8533156bca None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:01.926543 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf709b5-a2c2-4270-99f6-8c8533156bca None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:01.926543 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf709b5-a2c2-4270-99f6-8c8533156bca None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:01.926543 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 379/766] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:01.930799 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf709b5-a2c2-4270-99f6-8c8533156bca None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:01.939157 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6ad07-2f9d-4f3c-a099-c8fb519b1308 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:01.991280 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21adce-d5b8-48bd-89e7-d8c649339dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:01.992554 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21adce-d5b8-48bd-89e7-d8c649339dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:01.993061 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21adce-d5b8-48bd-89e7-d8c649339dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:01.994051 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21adce-d5b8-48bd-89e7-d8c649339dc2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:01.995147 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21adce-d5b8-48bd-89e7-d8c649339dc2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:01.997012 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21adce-d5b8-48bd-89e7-d8c649339dc2 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:02.013306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-8e21adce-d5b8-48bd-89e7-d8c649339dc2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 20:07:02.013306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:02.013306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 20:07:02.013306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 20:07:02.013306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 20:07:02.013306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 20:07:02.013306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 20:07:02.013306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:02.013306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 20:07:02.013306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:02.013306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:07:02.013306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:02.013306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:02.013306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:02.013306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:02.013306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:02.013306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:02.014349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:02.014349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:02.014349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:02.014349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:02.014349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:02.014349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:02.014349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 20:07:02.014349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 20:07:02.014349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 20:07:02.014349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 20:07:02.014349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:02.014349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:02.014349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:02.014349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:02.014349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:02.014349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:02.015259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:02.015259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:02.015259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:02.015259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:02.015259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:02.015259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:02.015259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:02.015259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:02.015259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:02.015259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:02.015259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 20:07:02.015259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:02.015259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 20:07:02.015259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:02.017686 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:02.024781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 388/767] 10.222.0.77 () {56 vars in 1129 bytes} [Tue Sep 6 20:07:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:02.025041 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc45554-c404-424a-aa0d-67fdea824aef None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:02.026967 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc45554-c404-424a-aa0d-67fdea824aef None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:02.026967 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc45554-c404-424a-aa0d-67fdea824aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:02.046071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-cbc45554-c404-424a-aa0d-67fdea824aef None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:02.047273 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-cbc45554-c404-424a-aa0d-67fdea824aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:02.068224 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf709b5-a2c2-4270-99f6-8c8533156bca None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:02.119309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07aa31-e371-43ba-8ad1-5ada9aa7553d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:02.120064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07aa31-e371-43ba-8ad1-5ada9aa7553d None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:02.120341 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07aa31-e371-43ba-8ad1-5ada9aa7553d None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:02.120657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07aa31-e371-43ba-8ad1-5ada9aa7553d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:02.133523 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07aa31-e371-43ba-8ad1-5ada9aa7553d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:02.136405 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07aa31-e371-43ba-8ad1-5ada9aa7553d None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:02.140786 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 389/768] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:07:02.141797 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc45554-c404-424a-aa0d-67fdea824aef None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:02.153195 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-3e07aa31-e371-43ba-8ad1-5ada9aa7553d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:02.153195 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:02.153195 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:02.153195 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:02.153195 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:02.153195 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:02.153195 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:02.153195 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:02.153195 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:02.153195 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:02.153195 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:02.153195 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:02.153195 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:07:02.153195 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:07:02.153195 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:07:02.154465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:07:02.154465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:02.154465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:02.154465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:02.154465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:02.154465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:02.154465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:02.154465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:02.154465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:02.154465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:02.154465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:02.154465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:02.154465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:02.154465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:02.154465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:02.154465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:02.154465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:02.156269 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:07:02.156269 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:07:02.156269 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:07:02.156269 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:07:02.156269 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:07:02.156269 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:07:02.156269 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:02.156269 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:02.163494 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 380/769] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:07:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:07:02.163494 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07aa31-e371-43ba-8ad1-5ada9aa7553d None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:02.173092 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:02.274789 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07aa31-e371-43ba-8ad1-5ada9aa7553d None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:02.304043 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:02.313978 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd12cb-9ca2-411f-80ed-591382d90c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:02.314657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd12cb-9ca2-411f-80ed-591382d90c98 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:02.314936 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd12cb-9ca2-411f-80ed-591382d90c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:02.315205 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd12cb-9ca2-411f-80ed-591382d90c98 None admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:02.315925 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd12cb-9ca2-411f-80ed-591382d90c98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:02.316230 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd12cb-9ca2-411f-80ed-591382d90c98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:02.317773 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd12cb-9ca2-411f-80ed-591382d90c98 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:02.320756 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc45554-c404-424a-aa0d-67fdea824aef None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:02.335579 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 381/770] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:07:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:02.337735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd12cb-9ca2-411f-80ed-591382d90c98 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:02.373230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816831aa-4932-4204-88ad-69b28ca4d3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:02.373934 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816831aa-4932-4204-88ad-69b28ca4d3a6 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:02.374212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816831aa-4932-4204-88ad-69b28ca4d3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:02.374481 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816831aa-4932-4204-88ad-69b28ca4d3a6 None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:02.375119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816831aa-4932-4204-88ad-69b28ca4d3a6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:02.375427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816831aa-4932-4204-88ad-69b28ca4d3a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:02.378035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816831aa-4932-4204-88ad-69b28ca4d3a6 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:02.388874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 390/771] 10.222.0.77 () {56 vars in 1124 bytes} [Tue Sep 6 20:07:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:02.400564 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816831aa-4932-4204-88ad-69b28ca4d3a6 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:02.486163 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd12cb-9ca2-411f-80ed-591382d90c98 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:02.525546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfec4ae-ee2f-4575-9025-8b2c9f1570ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:02.526130 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfec4ae-ee2f-4575-9025-8b2c9f1570ed None admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:02.526407 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfec4ae-ee2f-4575-9025-8b2c9f1570ed None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:02.526680 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfec4ae-ee2f-4575-9025-8b2c9f1570ed None admin] PATH_INFO: `/v3/projects/1b4323c35aef456b90ba9f1b7eb2b343/users/b09ce16da49b4af38491ad4eb6287d70/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:02.527293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:02.529867 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfec4ae-ee2f-4575-9025-8b2c9f1570ed None admin] RBAC: Authorizing `identity:create_grant(project_id=1b4323c35aef456b90ba9f1b7eb2b343, user_id=b09ce16da49b4af38491ad4eb6287d70, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:02.531856 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfec4ae-ee2f-4575-9025-8b2c9f1570ed None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:02.548877 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816831aa-4932-4204-88ad-69b28ca4d3a6 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:02.586006 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ca0f3-875d-4a3c-be07-fecfd0df98a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:02.586853 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ca0f3-875d-4a3c-be07-fecfd0df98a2 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:02.587280 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ca0f3-875d-4a3c-be07-fecfd0df98a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:02.587728 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ca0f3-875d-4a3c-be07-fecfd0df98a2 None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:02.588509 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ca0f3-875d-4a3c-be07-fecfd0df98a2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:02.588987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ca0f3-875d-4a3c-be07-fecfd0df98a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:02.590633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ca0f3-875d-4a3c-be07-fecfd0df98a2 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:02.595869 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 382/772] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Sep 6 20:07:02 2022] PUT /identity/v3/projects/1b4323c35aef456b90ba9f1b7eb2b343/users/b09ce16da49b4af38491ad4eb6287d70/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:07:02.597182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfec4ae-ee2f-4575-9025-8b2c9f1570ed None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:02.598721 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 391/773] 10.222.0.77 () {56 vars in 1124 bytes} [Tue Sep 6 20:07:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:02.610544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ca0f3-875d-4a3c-be07-fecfd0df98a2 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:02.720627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:02.805918 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ca0f3-875d-4a3c-be07-fecfd0df98a2 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:02.829733 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfec4ae-ee2f-4575-9025-8b2c9f1570ed None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:02.847178 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0247fa6-5d96-4cda-b7a5-eb96b1d3a9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:02.847835 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0247fa6-5d96-4cda-b7a5-eb96b1d3a9c1 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:02.848118 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0247fa6-5d96-4cda-b7a5-eb96b1d3a9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:02.848390 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0247fa6-5d96-4cda-b7a5-eb96b1d3a9c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:02.849102 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0247fa6-5d96-4cda-b7a5-eb96b1d3a9c1 None admin] RBAC: Adding query filter params (interface=public, service_id=2c69f954ff7742768d3f7bfa50180f85, region_id=RegionOne) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:02.849410 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0247fa6-5d96-4cda-b7a5-eb96b1d3a9c1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:02.850801 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0247fa6-5d96-4cda-b7a5-eb96b1d3a9c1 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:02.866801 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 392/774] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Sep 6 20:07:02 2022] GET /identity/v3/endpoints?service_id=2c69f954ff7742768d3f7bfa50180f85&interface=public®ion_id=RegionOne => generated 194 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:02.868561 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bed646-b664-4558-bcdc-047299b7c932 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:02.868780 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bed646-b664-4558-bcdc-047299b7c932 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:02.869160 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bed646-b664-4558-bcdc-047299b7c932 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:02.870873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 393/775] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:02.878448 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc77e9f-3c21-452c-bbf6-b89a9308f2c0 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:02.879037 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc77e9f-3c21-452c-bbf6-b89a9308f2c0 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:02.879371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc77e9f-3c21-452c-bbf6-b89a9308f2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:02.900500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96132eb2-d816-4c21-839f-9dab9ca480f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:02.901524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96132eb2-d816-4c21-839f-9dab9ca480f6 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:02.902005 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96132eb2-d816-4c21-839f-9dab9ca480f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:02.902489 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96132eb2-d816-4c21-839f-9dab9ca480f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:02.904866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-cfc77e9f-3c21-452c-bbf6-b89a9308f2c0 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:02.906986 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-cfc77e9f-3c21-452c-bbf6-b89a9308f2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:02.912021 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:02.926298 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96132eb2-d816-4c21-839f-9dab9ca480f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:07:02.938732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-96132eb2-d816-4c21-839f-9dab9ca480f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:07:02.938732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:02.938732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:02.938732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:02.938732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:02.938732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:02.938732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:02.938732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:02.938732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:02.938732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:02.938732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:02.938732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:02.938732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:07:02.938732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:07:02.938732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:07:02.938732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:07:02.939774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:07:02.939774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:07:02.939774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:07:02.939774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:07:02.939774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:02.939774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:02.939774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:02.939774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:02.939774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:02.939774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:02.939774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:02.939774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:02.939774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:02.939774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:02.939774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:02.939774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:02.940601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:02.940601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:02.940601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:02.940601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:02.940601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:07:02.940601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:07:02.940601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:07:02.940601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:07:02.940601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:07:02.940601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:07:02.940601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:07:02.940601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:02.941894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 383/776] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:07:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:02.942270 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96132eb2-d816-4c21-839f-9dab9ca480f6 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:03.004903 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 394/777] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 20:07:03.005627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc77e9f-3c21-452c-bbf6-b89a9308f2c0 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:03.083943 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96132eb2-d816-4c21-839f-9dab9ca480f6 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:03.092021 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:03.116246 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc77e9f-3c21-452c-bbf6-b89a9308f2c0 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:03.154396 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb4717-ea62-4b80-9cbf-3ab0431ea078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:03.156028 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb4717-ea62-4b80-9cbf-3ab0431ea078 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:03.156526 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb4717-ea62-4b80-9cbf-3ab0431ea078 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:03.157012 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb4717-ea62-4b80-9cbf-3ab0431ea078 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:03.157866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb4717-ea62-4b80-9cbf-3ab0431ea078 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:03.158382 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb4717-ea62-4b80-9cbf-3ab0431ea078 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:03.160149 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb4717-ea62-4b80-9cbf-3ab0431ea078 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:03.164198 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85573de-1a84-4ba6-a584-b9661874b7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:03.164808 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85573de-1a84-4ba6-a584-b9661874b7a8 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:03.165086 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85573de-1a84-4ba6-a584-b9661874b7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:03.165358 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85573de-1a84-4ba6-a584-b9661874b7a8 None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:03.165973 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85573de-1a84-4ba6-a584-b9661874b7a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:03.167349 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85573de-1a84-4ba6-a584-b9661874b7a8 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:03.167761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:03.173011 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 395/778] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:07:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:03.178339 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 384/779] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Sep 6 20:07:02 2022] GET /identity/v3/services => generated 772 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:03.181780 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb4717-ea62-4b80-9cbf-3ab0431ea078 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:03.322674 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb4717-ea62-4b80-9cbf-3ab0431ea078 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:03.375522 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5c91f-59c0-4297-a737-8d17f5aba3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:03.376099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5c91f-59c0-4297-a737-8d17f5aba3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:03.376489 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5c91f-59c0-4297-a737-8d17f5aba3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:03.377033 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5c91f-59c0-4297-a737-8d17f5aba3c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:03.398353 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5c91f-59c0-4297-a737-8d17f5aba3c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:03.399874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5c91f-59c0-4297-a737-8d17f5aba3c3 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:03.419909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-15e5c91f-59c0-4297-a737-8d17f5aba3c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:03.419909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:03.419909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:03.419909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:03.419909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:03.419909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:03.419909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:03.419909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:03.419909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:03.419909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:03.419909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:03.419909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:03.419909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:07:03.419909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:07:03.419909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:07:03.419909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:07:03.422150 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:03.422150 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:03.422150 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:03.422150 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:03.422150 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:03.422150 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:03.422150 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:03.422150 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:03.422150 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:03.422150 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:03.422150 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:03.422150 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:03.422150 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:03.422150 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:03.422150 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:03.422150 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:03.422150 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:07:03.423025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:07:03.423025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:03.423025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:03.423025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 396/780] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:07:03.427700 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85573de-1a84-4ba6-a584-b9661874b7a8 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:03.441934 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5c91f-59c0-4297-a737-8d17f5aba3c3 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:03.551382 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:03.579553 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85573de-1a84-4ba6-a584-b9661874b7a8 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:03.659709 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5c91f-59c0-4297-a737-8d17f5aba3c3 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:03.684179 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbeb9a-8b29-447b-ac88-a30e1b06213b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:03.684818 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbeb9a-8b29-447b-ac88-a30e1b06213b None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:03.685103 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbeb9a-8b29-447b-ac88-a30e1b06213b None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:03.685380 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbeb9a-8b29-447b-ac88-a30e1b06213b None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:03.686031 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbeb9a-8b29-447b-ac88-a30e1b06213b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:03.686369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbeb9a-8b29-447b-ac88-a30e1b06213b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:03.687856 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbeb9a-8b29-447b-ac88-a30e1b06213b None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:03.716710 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 385/781] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:03.719916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbeb9a-8b29-447b-ac88-a30e1b06213b None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:03.728030 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641a5e9-544d-4e72-92ac-735291b3c89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:03.729421 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641a5e9-544d-4e72-92ac-735291b3c89d None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:03.731282 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641a5e9-544d-4e72-92ac-735291b3c89d None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:03.732021 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641a5e9-544d-4e72-92ac-735291b3c89d None admin] PATH_INFO: `/v3/services/network` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:03.733931 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641a5e9-544d-4e72-92ac-735291b3c89d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:03.740989 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641a5e9-544d-4e72-92ac-735291b3c89d None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:03.764112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-c641a5e9-544d-4e72-92ac-735291b3c89d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 20:07:03.764112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:03.764112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 20:07:03.764112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 20:07:03.764112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 20:07:03.764112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 20:07:03.764112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 20:07:03.764112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:03.764112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 20:07:03.764112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:03.764112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:07:03.764112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:03.764112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:03.764112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:03.764112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:03.764112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:03.764112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:03.765237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:03.765237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:03.765237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:03.765237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:03.765237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:03.765237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:03.765237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 20:07:03.765237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 20:07:03.765237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 20:07:03.765237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 20:07:03.765237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:03.765237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:03.765237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:03.765237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:03.765237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:03.765237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:03.766050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:03.766050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:03.766050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:03.766050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:03.766050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:03.766050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:03.766050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:03.766050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:03.766050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:03.766050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:03.766050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 20:07:03.766050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:03.766050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 20:07:03.766050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:03.766785 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 397/782] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:07:03 2022] GET /identity/v3/services/network => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:07:03.776152 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6a4c5-05f9-4a09-9481-3718305965ec None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:03.776661 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6a4c5-05f9-4a09-9481-3718305965ec None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:03.777144 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6a4c5-05f9-4a09-9481-3718305965ec None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:03.784266 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 398/783] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:03 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:03.784266 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6a4c5-05f9-4a09-9481-3718305965ec None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:03.811674 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:03.883901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbeb9a-8b29-447b-ac88-a30e1b06213b None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:03.928104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf4cbf-f04c-48fd-bbe3-c0025a1408d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:03.928689 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf4cbf-f04c-48fd-bbe3-c0025a1408d6 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:03.928974 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf4cbf-f04c-48fd-bbe3-c0025a1408d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:03.929267 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf4cbf-f04c-48fd-bbe3-c0025a1408d6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:03.939783 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf4cbf-f04c-48fd-bbe3-c0025a1408d6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:03.941544 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf4cbf-f04c-48fd-bbe3-c0025a1408d6 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:03.953741 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6a4c5-05f9-4a09-9481-3718305965ec None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:03.958328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-dfaf4cbf-f04c-48fd-bbe3-c0025a1408d6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 20:07:03.958328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:03.958328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:03.958328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:03.958328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:03.958328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:03.958328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:03.958328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:03.958328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:03.958328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:03.958328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:03.958328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:03.958328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:07:03.958328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:07:03.958328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:07:03.958328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:07:03.959229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:03.959229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:03.959229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:07:03.959229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:03.959229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:07:03.959229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:03.959229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:03.959229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:03.959229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:03.959229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:03.959229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:03.959229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:03.959229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:03.959229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:03.959229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:03.959229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:03.959229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:03.959229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:03.960199 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:03.960199 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:03.960199 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:07:03.960199 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:07:03.960199 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:07:03.960199 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:07:03.960199 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:07:03.960199 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:07:03.960199 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 20:07:03.960199 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:03.964379 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 386/784] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:07:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:03.966384 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48e96e-982f-488e-b42e-1dd0ae3971d5 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:03.966674 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48e96e-982f-488e-b42e-1dd0ae3971d5 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:03.966950 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48e96e-982f-488e-b42e-1dd0ae3971d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:03.978957 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:03.994434 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-bc48e96e-982f-488e-b42e-1dd0ae3971d5 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:03.996878 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-bc48e96e-982f-488e-b42e-1dd0ae3971d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:04.003342 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d93a2-4590-4bfd-9244-bba2df3fff48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:04.004593 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d93a2-4590-4bfd-9244-bba2df3fff48 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:04.005109 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d93a2-4590-4bfd-9244-bba2df3fff48 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:04.006003 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d93a2-4590-4bfd-9244-bba2df3fff48 None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:04.006935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d93a2-4590-4bfd-9244-bba2df3fff48 None admin] RBAC: Adding query filter params (name=network) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:04.007483 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d93a2-4590-4bfd-9244-bba2df3fff48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:04.009120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d93a2-4590-4bfd-9244-bba2df3fff48 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:04.016923 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 399/785] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Sep 6 20:07:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:04.018119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d93a2-4590-4bfd-9244-bba2df3fff48 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:04.095812 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 387/786] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:07:04.097108 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48e96e-982f-488e-b42e-1dd0ae3971d5 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:04.143164 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:04.147846 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d93a2-4590-4bfd-9244-bba2df3fff48 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:04.191545 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562d7dd-2f93-4546-ba75-b9f96066fe07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:04.192408 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562d7dd-2f93-4546-ba75-b9f96066fe07 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:04.192855 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562d7dd-2f93-4546-ba75-b9f96066fe07 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:04.193783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562d7dd-2f93-4546-ba75-b9f96066fe07 None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:04.194979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562d7dd-2f93-4546-ba75-b9f96066fe07 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:04.195461 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562d7dd-2f93-4546-ba75-b9f96066fe07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:04.197345 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562d7dd-2f93-4546-ba75-b9f96066fe07 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:04.220123 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 400/787] 10.222.0.77 () {56 vars in 1135 bytes} [Tue Sep 6 20:07:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:04.226729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562d7dd-2f93-4546-ba75-b9f96066fe07 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:04.279889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:04.329294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48e96e-982f-488e-b42e-1dd0ae3971d5 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:04.362569 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562d7dd-2f93-4546-ba75-b9f96066fe07 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:04.411974 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606be15-8228-489e-99ba-977793626e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:04.412585 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606be15-8228-489e-99ba-977793626e0b None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:04.412855 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606be15-8228-489e-99ba-977793626e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:04.413119 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606be15-8228-489e-99ba-977793626e0b None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:04.413770 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606be15-8228-489e-99ba-977793626e0b None admin] RBAC: Adding query filter params (type=network) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:04.414094 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606be15-8228-489e-99ba-977793626e0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:04.416911 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606be15-8228-489e-99ba-977793626e0b None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:04.428571 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 388/788] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Sep 6 20:07:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:04.430153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957f8ef-1c73-462b-9d39-f91869e8873d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:04.430804 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957f8ef-1c73-462b-9d39-f91869e8873d None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:04.431087 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957f8ef-1c73-462b-9d39-f91869e8873d None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:04.431360 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957f8ef-1c73-462b-9d39-f91869e8873d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:04.434618 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606be15-8228-489e-99ba-977793626e0b None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:04.455675 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957f8ef-1c73-462b-9d39-f91869e8873d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:04.457485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957f8ef-1c73-462b-9d39-f91869e8873d None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:04.473592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-f957f8ef-1c73-462b-9d39-f91869e8873d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:04.473592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:04.473592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:04.473592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:04.473592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:04.473592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:04.473592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:04.473592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:04.473592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:04.473592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:04.473592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:04.473592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:04.473592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:07:04.473592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:07:04.473592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:07:04.473592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:07:04.474717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:04.474717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:04.474717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:04.474717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:04.474717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:04.474717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:04.474717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:04.474717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:04.474717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:04.474717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:04.474717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:04.474717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:04.474717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:04.474717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:04.474717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:04.474717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:04.474717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:07:04.475641 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:07:04.475641 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:04.475641 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:04.477858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 401/789] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:07:04.483156 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957f8ef-1c73-462b-9d39-f91869e8873d None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:04.601290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:04.620929 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606be15-8228-489e-99ba-977793626e0b None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:04.636546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:04.650511 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957f8ef-1c73-462b-9d39-f91869e8873d None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:04.660101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f5be2-dd7b-4a1b-9100-8402de6b55cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:04.660850 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f5be2-dd7b-4a1b-9100-8402de6b55cc None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:04.661139 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f5be2-dd7b-4a1b-9100-8402de6b55cc None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:04.679725 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f5be2-dd7b-4a1b-9100-8402de6b55cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:04.679725 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f5be2-dd7b-4a1b-9100-8402de6b55cc None admin] RBAC: Adding query filter params (interface=public, service_id=69ebc4bfda7b4ae191c8f2bb8e373445, region_id=RegionOne) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:04.679725 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f5be2-dd7b-4a1b-9100-8402de6b55cc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:04.679725 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f5be2-dd7b-4a1b-9100-8402de6b55cc None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:04.679725 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 389/790] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Sep 6 20:07:04 2022] GET /identity/v3/endpoints?service_id=69ebc4bfda7b4ae191c8f2bb8e373445&interface=public®ion_id=RegionOne => generated 194 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:04.679725 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f5be2-dd7b-4a1b-9100-8402de6b55cc None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:04.702534 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86859c4-4827-426b-b3ec-8de62652a282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:04.703774 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86859c4-4827-426b-b3ec-8de62652a282 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:04.704478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86859c4-4827-426b-b3ec-8de62652a282 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:04.705211 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86859c4-4827-426b-b3ec-8de62652a282 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:04.706562 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86859c4-4827-426b-b3ec-8de62652a282 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:04.707056 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86859c4-4827-426b-b3ec-8de62652a282 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:04.709215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86859c4-4827-426b-b3ec-8de62652a282 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:04.727495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 402/791] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:04.728427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86859c4-4827-426b-b3ec-8de62652a282 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:04.792402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f5be2-dd7b-4a1b-9100-8402de6b55cc None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:04.836396 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f852c42-632a-433d-93fd-95203499396a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:04.838415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f852c42-632a-433d-93fd-95203499396a None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:04.838902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f852c42-632a-433d-93fd-95203499396a None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:04.839565 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f852c42-632a-433d-93fd-95203499396a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:04.852233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86859c4-4827-426b-b3ec-8de62652a282 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:04.855679 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f852c42-632a-433d-93fd-95203499396a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:07:04.861691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-2f852c42-632a-433d-93fd-95203499396a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:07:04.861691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:04.861691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:04.861691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:04.861691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:04.861691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:04.861691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:04.861691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:04.861691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:04.861691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:04.861691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:04.861691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:04.861691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:07:04.861691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:07:04.861691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:07:04.861691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:07:04.862718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:07:04.862718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:07:04.862718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:07:04.862718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:07:04.862718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:04.862718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:04.862718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:04.862718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:04.862718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:04.862718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:04.862718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:04.862718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:04.862718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:04.862718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:04.862718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:04.862718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:04.863622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:04.863622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:04.863622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:04.863622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:04.863622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:07:04.863622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:07:04.863622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:07:04.863622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:07:04.863622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:07:04.863622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:07:04.863622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:07:04.863622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:04.863622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 390/792] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Sep 6 20:07:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:04.864311 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f852c42-632a-433d-93fd-95203499396a None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:04.878017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:04.915409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1ba9b-ae33-4063-80e1-0dea81704ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:04.916431 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1ba9b-ae33-4063-80e1-0dea81704ecf None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:04.916955 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1ba9b-ae33-4063-80e1-0dea81704ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:04.917424 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1ba9b-ae33-4063-80e1-0dea81704ecf None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:04.918337 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1ba9b-ae33-4063-80e1-0dea81704ecf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:04.920085 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1ba9b-ae33-4063-80e1-0dea81704ecf None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:04.927823 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 403/793] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Sep 6 20:07:04 2022] GET /identity/v3/services => generated 772 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:04.929031 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1ba9b-ae33-4063-80e1-0dea81704ecf None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:04.968324 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:05.048196 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f852c42-632a-433d-93fd-95203499396a None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:05.137142 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c0e94-b8d3-4a59-a734-7e2e90a3a97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:05.137856 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c0e94-b8d3-4a59-a734-7e2e90a3a97d None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:05.138202 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c0e94-b8d3-4a59-a734-7e2e90a3a97d None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:05.138428 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c0e94-b8d3-4a59-a734-7e2e90a3a97d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:05.151215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1ba9b-ae33-4063-80e1-0dea81704ecf None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:05.153091 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c0e94-b8d3-4a59-a734-7e2e90a3a97d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:05.156212 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c0e94-b8d3-4a59-a734-7e2e90a3a97d None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:05.176873 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-6c2c0e94-b8d3-4a59-a734-7e2e90a3a97d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:05.176873 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:05.176873 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:05.176873 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:05.176873 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:05.176873 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:05.176873 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:05.176873 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:05.176873 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:05.176873 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:05.176873 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:05.176873 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:05.176873 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:07:05.176873 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:07:05.176873 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:07:05.177809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:07:05.177809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:05.177809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:05.177809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:05.177809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:05.177809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:05.177809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:05.177809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:05.177809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:05.177809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:05.177809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:05.177809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:05.177809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:05.177809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:05.177809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:05.177809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:05.177809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:05.178691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:07:05.178691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:07:05.178691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:07:05.178691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:07:05.178691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:07:05.178691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:07:05.178691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:05.178691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:05.180292 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 391/794] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:07:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:05.186185 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c0e94-b8d3-4a59-a734-7e2e90a3a97d None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:05.199620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c9abd-0245-45f2-aa4c-8817800bf942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:05.200609 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c9abd-0245-45f2-aa4c-8817800bf942 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:05.201114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c9abd-0245-45f2-aa4c-8817800bf942 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:05.201618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c9abd-0245-45f2-aa4c-8817800bf942 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:05.202534 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c9abd-0245-45f2-aa4c-8817800bf942 None admin] RBAC: Adding query filter params (name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:05.203045 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c9abd-0245-45f2-aa4c-8817800bf942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:05.205243 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c9abd-0245-45f2-aa4c-8817800bf942 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:05.216014 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 404/795] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Sep 6 20:07:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:05.223433 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c0839-777a-4fb8-bf11-031cb00f6576 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:05.223765 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c0839-777a-4fb8-bf11-031cb00f6576 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:05.223972 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c0839-777a-4fb8-bf11-031cb00f6576 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:05.225661 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 405/796] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:05.226498 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c0839-777a-4fb8-bf11-031cb00f6576 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:05.274366 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:05.314165 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c0e94-b8d3-4a59-a734-7e2e90a3a97d None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:05.326465 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:05.356456 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c0839-777a-4fb8-bf11-031cb00f6576 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:05.362144 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4dc69-9ae3-4e8a-a2e7-570298a54e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:05.362769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4dc69-9ae3-4e8a-a2e7-570298a54e0e None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:05.363048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4dc69-9ae3-4e8a-a2e7-570298a54e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:05.363316 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4dc69-9ae3-4e8a-a2e7-570298a54e0e None admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:05.364050 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4dc69-9ae3-4e8a-a2e7-570298a54e0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:05.364356 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4dc69-9ae3-4e8a-a2e7-570298a54e0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:05.365879 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4dc69-9ae3-4e8a-a2e7-570298a54e0e None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:05.383476 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 392/797] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:07:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:05.384793 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0463816-075e-47d9-8392-9034c5f4e185 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:05.385076 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0463816-075e-47d9-8392-9034c5f4e185 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:05.385348 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0463816-075e-47d9-8392-9034c5f4e185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:05.408186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-c0463816-075e-47d9-8392-9034c5f4e185 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:05.409782 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c0463816-075e-47d9-8392-9034c5f4e185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:05.409918 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a113c-189a-4c42-98ae-6a42915f89d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:05.410856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a113c-189a-4c42-98ae-6a42915f89d4 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:05.411215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a113c-189a-4c42-98ae-6a42915f89d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:05.411531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a113c-189a-4c42-98ae-6a42915f89d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:05.427289 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a113c-189a-4c42-98ae-6a42915f89d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:05.429271 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a113c-189a-4c42-98ae-6a42915f89d4 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:05.453187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-b56a113c-189a-4c42-98ae-6a42915f89d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:05.453187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:05.453187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:05.453187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:05.453187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:05.453187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:05.453187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:05.453187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:05.453187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:05.453187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:05.453187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:05.453187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:05.453187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:07:05.453187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:07:05.453187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:07:05.453187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:07:05.454430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:05.454430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:05.454430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:05.454430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:05.454430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:05.454430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:05.454430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:05.454430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:05.454430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:05.454430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:05.454430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:05.454430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:05.454430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:05.454430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:05.454430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:05.454430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:05.454430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:07:05.455662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:07:05.455662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:05.455662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:05.455662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 406/798] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:05.455662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a113c-189a-4c42-98ae-6a42915f89d4 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:05.500884 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 393/799] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:07:05.502659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0463816-075e-47d9-8392-9034c5f4e185 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:05.611820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:05.645107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0463816-075e-47d9-8392-9034c5f4e185 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:05.645422 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a113c-189a-4c42-98ae-6a42915f89d4 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:05.682293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:05.691408 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9068a8-fa1a-4123-9f1a-08cf6d1858c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:05.692197 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9068a8-fa1a-4123-9f1a-08cf6d1858c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:05.696293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9068a8-fa1a-4123-9f1a-08cf6d1858c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:05.696293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9068a8-fa1a-4123-9f1a-08cf6d1858c5 None admin] PATH_INFO: `/v3/projects/1b4323c35aef456b90ba9f1b7eb2b343/users/5a6c4f91a59548fd979e7232a2afd6ec/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:05.696485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90000dc7-6ae6-45c9-bfb9-de1dcb54c946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:05.696576 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9068a8-fa1a-4123-9f1a-08cf6d1858c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b4323c35aef456b90ba9f1b7eb2b343, user_id=5a6c4f91a59548fd979e7232a2afd6ec, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:05.696660 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90000dc7-6ae6-45c9-bfb9-de1dcb54c946 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:05.696660 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90000dc7-6ae6-45c9-bfb9-de1dcb54c946 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:05.696660 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90000dc7-6ae6-45c9-bfb9-de1dcb54c946 None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:05.696660 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90000dc7-6ae6-45c9-bfb9-de1dcb54c946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:05.696959 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9068a8-fa1a-4123-9f1a-08cf6d1858c5 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:05.697033 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90000dc7-6ae6-45c9-bfb9-de1dcb54c946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:05.697865 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90000dc7-6ae6-45c9-bfb9-de1dcb54c946 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:05.712225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 394/800] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:05.713648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a1bd3-4dfd-4b7d-8eea-ca90289b359e None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:05.713942 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a1bd3-4dfd-4b7d-8eea-ca90289b359e None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:05.714215 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a1bd3-4dfd-4b7d-8eea-ca90289b359e None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:05.715770 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 395/801] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:05.718086 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a1bd3-4dfd-4b7d-8eea-ca90289b359e None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:05.782935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 407/802] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Sep 6 20:07:05 2022] PUT /identity/v3/projects/1b4323c35aef456b90ba9f1b7eb2b343/users/5a6c4f91a59548fd979e7232a2afd6ec/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:07:05.784557 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bb6b9-318c-4254-870c-97b55395ceff None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:05.784844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bb6b9-318c-4254-870c-97b55395ceff None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:05.785127 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bb6b9-318c-4254-870c-97b55395ceff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:05.839632 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-002bb6b9-318c-4254-870c-97b55395ceff None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:05.840849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-002bb6b9-318c-4254-870c-97b55395ceff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:05.872785 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a1bd3-4dfd-4b7d-8eea-ca90289b359e None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:05.904242 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:05.932771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15be26-6f0e-4a6f-84ba-dce98fd830b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:05.934225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15be26-6f0e-4a6f-84ba-dce98fd830b7 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:05.934965 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15be26-6f0e-4a6f-84ba-dce98fd830b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:05.935397 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15be26-6f0e-4a6f-84ba-dce98fd830b7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:05.946192 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15be26-6f0e-4a6f-84ba-dce98fd830b7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:05.947797 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 408/803] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:07:05.948183 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15be26-6f0e-4a6f-84ba-dce98fd830b7 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:05.948889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bb6b9-318c-4254-870c-97b55395ceff None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:05.964189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-4f15be26-6f0e-4a6f-84ba-dce98fd830b7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 20:07:05.964189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:05.964189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:05.964189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:05.964189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:05.964189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:05.964189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:05.964189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:05.964189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:05.964189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:05.964189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:05.964189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:05.964189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:07:05.964189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:07:05.964189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:07:05.964189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:07:05.965401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:05.965401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:05.965401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:07:05.965401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:05.965401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:07:05.965401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:05.965401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:05.965401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:05.965401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:05.965401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:05.965401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:05.965401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:05.965401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:05.965401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:05.965401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:05.965401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:05.965401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:05.965401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:05.966414 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:05.966414 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:05.966414 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:07:05.966414 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:07:05.966414 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:07:05.966414 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:07:05.966414 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:07:05.966414 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:07:05.966414 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 20:07:05.966414 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:05.969338 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 396/804] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Sep 6 20:07:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:05.975627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15be26-6f0e-4a6f-84ba-dce98fd830b7 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:06.106323 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15be26-6f0e-4a6f-84ba-dce98fd830b7 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:06.111480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bb6b9-318c-4254-870c-97b55395ceff None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:06.130617 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:06.157886 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8625761-a310-4374-b414-b0777cc56572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:06.157886 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8625761-a310-4374-b414-b0777cc56572 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:06.157886 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8625761-a310-4374-b414-b0777cc56572 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:06.157886 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8625761-a310-4374-b414-b0777cc56572 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:06.180654 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8625761-a310-4374-b414-b0777cc56572 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:07:06.189760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-c8625761-a310-4374-b414-b0777cc56572 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:07:06.189760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:06.189760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:06.189760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:06.189760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:06.189760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:06.189760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:06.189760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:06.189760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:06.189760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:06.189760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:06.189760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:06.189760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:07:06.189760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:07:06.189760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:07:06.189760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:07:06.190844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:07:06.190844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:07:06.190844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:07:06.190844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:07:06.190844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:06.190844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:06.190844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:06.190844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:06.190844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:06.190844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:06.190844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:06.190844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:06.190844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:06.190844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:06.190844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:06.190844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:06.191780 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:06.191780 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:06.191780 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:06.191780 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:06.191780 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:07:06.191780 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:07:06.191780 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:07:06.191780 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:07:06.191780 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:07:06.191780 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:07:06.191780 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:07:06.191780 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:06.191780 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 409/805] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:07:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:06.196966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8625761-a310-4374-b414-b0777cc56572 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:06.204168 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd90d10-253d-48cc-be89-e4f0cf9c0d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:06.204800 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd90d10-253d-48cc-be89-e4f0cf9c0d3b None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:06.205078 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd90d10-253d-48cc-be89-e4f0cf9c0d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:06.205350 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd90d10-253d-48cc-be89-e4f0cf9c0d3b None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:06.206092 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd90d10-253d-48cc-be89-e4f0cf9c0d3b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:06.206398 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd90d10-253d-48cc-be89-e4f0cf9c0d3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:06.207875 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd90d10-253d-48cc-be89-e4f0cf9c0d3b None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:06.252043 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 397/806] 10.222.0.77 () {56 vars in 1149 bytes} [Tue Sep 6 20:07:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:06.254229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd90d10-253d-48cc-be89-e4f0cf9c0d3b None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:06.296799 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:06.366010 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8625761-a310-4374-b414-b0777cc56572 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:06.372207 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd90d10-253d-48cc-be89-e4f0cf9c0d3b None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:06.413000 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8891fd-1b56-46e4-9724-e3859290bf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:06.413521 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa838d92-2eca-43c8-9f65-9e1d4bf9d05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:06.413655 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8891fd-1b56-46e4-9724-e3859290bf73 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:06.413894 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8891fd-1b56-46e4-9724-e3859290bf73 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:06.414183 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa838d92-2eca-43c8-9f65-9e1d4bf9d05f None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:06.414307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8891fd-1b56-46e4-9724-e3859290bf73 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:06.414470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa838d92-2eca-43c8-9f65-9e1d4bf9d05f None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:06.414729 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa838d92-2eca-43c8-9f65-9e1d4bf9d05f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:06.414902 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8891fd-1b56-46e4-9724-e3859290bf73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:06.415168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8891fd-1b56-46e4-9724-e3859290bf73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:06.416997 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8891fd-1b56-46e4-9724-e3859290bf73 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:06.428253 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa838d92-2eca-43c8-9f65-9e1d4bf9d05f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:06.428775 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 410/807] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:07:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:06.429729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8891fd-1b56-46e4-9724-e3859290bf73 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:06.429999 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa838d92-2eca-43c8-9f65-9e1d4bf9d05f None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:06.448256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-fa838d92-2eca-43c8-9f65-9e1d4bf9d05f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:06.448256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:06.448256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:06.448256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:06.448256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:06.448256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:06.448256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:06.448256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:06.448256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:06.448256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:06.448256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:06.448256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:06.448256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:07:06.448256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:07:06.448256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:07:06.448256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:07:06.449272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:06.449272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:06.449272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:06.449272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:06.449272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:06.449272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:06.449272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:06.449272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:06.449272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:06.449272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:06.449272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:06.449272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:06.449272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:06.449272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:06.449272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:06.449272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:06.449272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:07:06.450166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:07:06.450166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:06.450166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:06.454195 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 398/808] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:07:06.462091 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa838d92-2eca-43c8-9f65-9e1d4bf9d05f None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:06.480831 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:06.552256 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8891fd-1b56-46e4-9724-e3859290bf73 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:06.554251 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:06.567877 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa838d92-2eca-43c8-9f65-9e1d4bf9d05f None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:06.595181 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99810bc-3f41-4743-be59-885c124da0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:06.596159 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99810bc-3f41-4743-be59-885c124da0e9 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:06.596529 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99810bc-3f41-4743-be59-885c124da0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:06.596946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99810bc-3f41-4743-be59-885c124da0e9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:06.597644 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99810bc-3f41-4743-be59-885c124da0e9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:06.599244 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99810bc-3f41-4743-be59-885c124da0e9 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:06.609295 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a536b3-25b2-482b-af4e-f59851c4680f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:06.610019 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a536b3-25b2-482b-af4e-f59851c4680f None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:06.610303 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a536b3-25b2-482b-af4e-f59851c4680f None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:06.610524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-c99810bc-3f41-4743-be59-885c124da0e9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 20:07:06.610524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:06.610524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 20:07:06.610524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 20:07:06.610524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 20:07:06.610524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 20:07:06.610524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 20:07:06.610524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:06.610524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 20:07:06.610524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:06.610524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:07:06.610524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:06.610524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:06.610524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:06.610524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:06.610524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:06.610524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:06.612627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:06.612627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:06.612627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:06.612627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:06.612627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:06.612627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:06.612627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 20:07:06.612627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 20:07:06.612627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 20:07:06.612627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 20:07:06.612627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:06.612627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:06.612627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:06.612627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:06.612627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:06.612627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:06.614673 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:06.614673 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:06.614673 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:06.614673 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:06.614673 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:06.614673 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:06.614673 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:06.614673 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:06.614673 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:06.614673 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:06.614673 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 20:07:06.614673 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:06.614673 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 20:07:06.614673 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:06.616509 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a536b3-25b2-482b-af4e-f59851c4680f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:06.623480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 411/809] 10.222.0.77 () {56 vars in 1129 bytes} [Tue Sep 6 20:07:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:06.623480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99810bc-3f41-4743-be59-885c124da0e9 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:06.624511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a536b3-25b2-482b-af4e-f59851c4680f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:06.625074 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a536b3-25b2-482b-af4e-f59851c4680f None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:06.642511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-16a536b3-25b2-482b-af4e-f59851c4680f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:06.642511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:06.642511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:06.642511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:06.642511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:06.642511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:06.642511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:06.642511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:06.642511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:06.642511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:06.642511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:06.642511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:06.642511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:07:06.642511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:07:06.642511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:07:06.642511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:07:06.644868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:06.644868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:06.644868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:06.644868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:06.644868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:06.644868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:06.644868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:06.644868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:06.644868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:06.644868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:06.644868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:06.644868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:06.644868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:06.644868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:06.644868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:06.644868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:06.644868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:07:06.646981 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:07:06.646981 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:06.646981 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:06.646981 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 399/810] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:06.646981 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a536b3-25b2-482b-af4e-f59851c4680f None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:06.735401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99810bc-3f41-4743-be59-885c124da0e9 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:06.738195 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:06.757078 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a536b3-25b2-482b-af4e-f59851c4680f None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:06.775190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e5bb3-99e0-4f13-9fa5-45708c1f3c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:06.776188 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e5bb3-99e0-4f13-9fa5-45708c1f3c19 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:06.776536 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e5bb3-99e0-4f13-9fa5-45708c1f3c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:06.776897 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e5bb3-99e0-4f13-9fa5-45708c1f3c19 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:06.777621 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e5bb3-99e0-4f13-9fa5-45708c1f3c19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:06.777997 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e5bb3-99e0-4f13-9fa5-45708c1f3c19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:06.779594 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e5bb3-99e0-4f13-9fa5-45708c1f3c19 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:06.794576 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 412/811] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:06.797417 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e5bb3-99e0-4f13-9fa5-45708c1f3c19 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:06.805097 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5bab6-cfab-4da3-97d3-249e5302f13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:06.811472 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5bab6-cfab-4da3-97d3-249e5302f13c None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:06.811472 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5bab6-cfab-4da3-97d3-249e5302f13c None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:06.811472 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5bab6-cfab-4da3-97d3-249e5302f13c None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:06.811472 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5bab6-cfab-4da3-97d3-249e5302f13c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:06.811472 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5bab6-cfab-4da3-97d3-249e5302f13c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:06.811472 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5bab6-cfab-4da3-97d3-249e5302f13c None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:06.814839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 400/812] 10.222.0.77 () {56 vars in 1124 bytes} [Tue Sep 6 20:07:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:06.815764 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5bab6-cfab-4da3-97d3-249e5302f13c None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:06.823256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:06.928456 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e5bb3-99e0-4f13-9fa5-45708c1f3c19 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:06.941868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5bab6-cfab-4da3-97d3-249e5302f13c None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:06.969129 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fa75e-ec49-4ca9-a037-34dabc699dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:06.970029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fa75e-ec49-4ca9-a037-34dabc699dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:06.970479 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fa75e-ec49-4ca9-a037-34dabc699dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:06.971009 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fa75e-ec49-4ca9-a037-34dabc699dc7 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:06.971940 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fa75e-ec49-4ca9-a037-34dabc699dc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:06.972405 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fa75e-ec49-4ca9-a037-34dabc699dc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:06.974256 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fa75e-ec49-4ca9-a037-34dabc699dc7 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:06.979783 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6e169-bc59-4e1a-8945-f4bcbf44bd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:06.980420 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6e169-bc59-4e1a-8945-f4bcbf44bd4e None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:06.980698 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6e169-bc59-4e1a-8945-f4bcbf44bd4e None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:06.980966 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6e169-bc59-4e1a-8945-f4bcbf44bd4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:06.988513 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6e169-bc59-4e1a-8945-f4bcbf44bd4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:06.989344 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 413/813] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:06.990191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6e169-bc59-4e1a-8945-f4bcbf44bd4e None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:06.990597 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fa75e-ec49-4ca9-a037-34dabc699dc7 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:07.004010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-1ac6e169-bc59-4e1a-8945-f4bcbf44bd4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:07.004010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:07.004010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:07.004010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:07.004010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:07.004010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:07.004010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:07.004010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:07.004010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:07.004010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:07.004010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:07.004010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:07.004010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:07:07.004010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:07:07.004010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:07:07.005226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:07:07.005226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:07.005226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:07.005226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:07.005226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:07.005226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:07.005226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:07.005226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:07.005226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:07.005226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:07.005226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:07.005226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:07.005226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:07.005226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:07.005226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:07.005226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:07.005226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:07.006418 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:07:07.006418 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:07:07.006418 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:07:07.006418 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:07:07.006418 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:07:07.006418 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:07:07.006418 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:07.006418 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:07.009840 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 401/814] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:07:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:07.010795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6e169-bc59-4e1a-8945-f4bcbf44bd4e None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:07.025085 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:07.093405 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:07.152849 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6e169-bc59-4e1a-8945-f4bcbf44bd4e None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:07.164714 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fa75e-ec49-4ca9-a037-34dabc699dc7 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:07.195862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527b13f-15cb-4d79-b66a-3d243aa7b4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:07.196822 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527b13f-15cb-4d79-b66a-3d243aa7b4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:07.197257 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527b13f-15cb-4d79-b66a-3d243aa7b4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:07.197685 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527b13f-15cb-4d79-b66a-3d243aa7b4f1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:07.204786 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127e892-c53a-4f73-99b3-e8af6dbd3d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:07.205401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127e892-c53a-4f73-99b3-e8af6dbd3d54 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:07.205687 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127e892-c53a-4f73-99b3-e8af6dbd3d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:07.205954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127e892-c53a-4f73-99b3-e8af6dbd3d54 None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:07.206586 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127e892-c53a-4f73-99b3-e8af6dbd3d54 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:07.206979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127e892-c53a-4f73-99b3-e8af6dbd3d54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:07.208217 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527b13f-15cb-4d79-b66a-3d243aa7b4f1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:07.208343 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127e892-c53a-4f73-99b3-e8af6dbd3d54 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:07.210062 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527b13f-15cb-4d79-b66a-3d243aa7b4f1 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:07.218818 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 414/815] 10.222.0.77 () {56 vars in 1124 bytes} [Tue Sep 6 20:07:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:07.219892 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127e892-c53a-4f73-99b3-e8af6dbd3d54 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:07.224029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-7527b13f-15cb-4d79-b66a-3d243aa7b4f1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 20:07:07.224029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:07.224029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:07.224029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:07.224029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:07.224029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:07.224029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:07.224029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:07.224029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:07.224029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:07.224029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:07.224029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:07.224029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:07:07.224029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:07:07.224029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:07:07.224029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:07:07.225216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:07.225216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:07.225216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:07:07.225216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:07.225216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:07:07.225216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:07.225216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:07.225216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:07.225216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:07.225216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:07.225216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:07.225216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:07.225216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:07.225216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:07.225216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:07.225216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:07.225216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:07.225216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:07.226171 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:07.226171 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:07.226171 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:07:07.226171 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:07:07.226171 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:07:07.226171 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:07:07.226171 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:07:07.226171 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:07:07.226171 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 20:07:07.226171 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:07.228351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 402/816] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Sep 6 20:07:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:07.229601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527b13f-15cb-4d79-b66a-3d243aa7b4f1 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:07.321390 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:07.336094 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127e892-c53a-4f73-99b3-e8af6dbd3d54 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:07.345579 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527b13f-15cb-4d79-b66a-3d243aa7b4f1 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:07.374839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:07.382738 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ca89a-0bcb-44ee-b275-63cbf499b7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:07.383385 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ca89a-0bcb-44ee-b275-63cbf499b7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:07.386442 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ca89a-0bcb-44ee-b275-63cbf499b7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:07.386442 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ca89a-0bcb-44ee-b275-63cbf499b7f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:07.386442 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ca89a-0bcb-44ee-b275-63cbf499b7f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:07.386442 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ca89a-0bcb-44ee-b275-63cbf499b7f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:07.387223 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ca89a-0bcb-44ee-b275-63cbf499b7f3 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:07.391046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565894ad-40ab-4607-9dc1-b5d662fa8437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:07.392183 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565894ad-40ab-4607-9dc1-b5d662fa8437 None admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:07.392613 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565894ad-40ab-4607-9dc1-b5d662fa8437 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:07.393031 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565894ad-40ab-4607-9dc1-b5d662fa8437 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:07.393859 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565894ad-40ab-4607-9dc1-b5d662fa8437 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:07.395516 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565894ad-40ab-4607-9dc1-b5d662fa8437 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:07.402767 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 415/817] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:07:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:07.404350 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ca89a-0bcb-44ee-b275-63cbf499b7f3 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:07.496174 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 403/818] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:07:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:07:07.496869 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565894ad-40ab-4607-9dc1-b5d662fa8437 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:07.530667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ca89a-0bcb-44ee-b275-63cbf499b7f3 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:07.581643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f5ce0-3e02-4224-9e6e-e5bf65920af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:07.582417 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f5ce0-3e02-4224-9e6e-e5bf65920af7 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:07.582699 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f5ce0-3e02-4224-9e6e-e5bf65920af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:07.582974 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f5ce0-3e02-4224-9e6e-e5bf65920af7 None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:07.583780 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f5ce0-3e02-4224-9e6e-e5bf65920af7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:07.584093 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f5ce0-3e02-4224-9e6e-e5bf65920af7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:07.585574 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f5ce0-3e02-4224-9e6e-e5bf65920af7 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:07.608203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 416/819] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Sep 6 20:07:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:07.609672 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf73aa-c9f0-4f86-ab9f-eadf48c5e22d None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:07.609954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf73aa-c9f0-4f86-ab9f-eadf48c5e22d None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:07.610344 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf73aa-c9f0-4f86-ab9f-eadf48c5e22d None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:07.615986 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 417/820] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:07.616960 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf73aa-c9f0-4f86-ab9f-eadf48c5e22d None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:07.620939 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:07.661670 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565894ad-40ab-4607-9dc1-b5d662fa8437 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:07.713728 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342db119-36d8-4901-b631-8c0082481d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:07.713728 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342db119-36d8-4901-b631-8c0082481d38 None admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:07.713728 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342db119-36d8-4901-b631-8c0082481d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:07.714136 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342db119-36d8-4901-b631-8c0082481d38 None admin] PATH_INFO: `/v3/projects/1b4323c35aef456b90ba9f1b7eb2b343/users/c314372147b2491cb4481d538056472c/roles/140b49dfcc2b489ca0504d2e7abfdbdb` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:07.733989 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342db119-36d8-4901-b631-8c0082481d38 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b4323c35aef456b90ba9f1b7eb2b343, user_id=c314372147b2491cb4481d538056472c, role_id=140b49dfcc2b489ca0504d2e7abfdbdb)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:07.735469 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342db119-36d8-4901-b631-8c0082481d38 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:07.763918 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf73aa-c9f0-4f86-ab9f-eadf48c5e22d None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:07.811628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 404/821] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Sep 6 20:07:07 2022] PUT /identity/v3/projects/1b4323c35aef456b90ba9f1b7eb2b343/users/c314372147b2491cb4481d538056472c/roles/140b49dfcc2b489ca0504d2e7abfdbdb => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:07:07.814100 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f775f0a-ff4d-4033-b227-5bb91e9d9725 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:07.815162 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f5bab-5ea5-4b84-a93f-3cda2e9f989f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:07.816386 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f5bab-5ea5-4b84-a93f-3cda2e9f989f None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:07.816720 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f775f0a-ff4d-4033-b227-5bb91e9d9725 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:07.817248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f775f0a-ff4d-4033-b227-5bb91e9d9725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:07.819347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f5bab-5ea5-4b84-a93f-3cda2e9f989f None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:07.819894 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f5bab-5ea5-4b84-a93f-3cda2e9f989f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:07.859278 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-7f775f0a-ff4d-4033-b227-5bb91e9d9725 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:07.864222 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-7f775f0a-ff4d-4033-b227-5bb91e9d9725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:07.916900 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:07.973565 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 405/822] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:07:07.997369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f5bab-5ea5-4b84-a93f-3cda2e9f989f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:07.999545 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f5bab-5ea5-4b84-a93f-3cda2e9f989f None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:08.002594 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:08.129706 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 418/823] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:07:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 20:07:08.135047 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f775f0a-ff4d-4033-b227-5bb91e9d9725 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:08.208318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9acebd-1e20-4904-b139-49c67352a956 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:08.209255 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9acebd-1e20-4904-b139-49c67352a956 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:08.209924 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9acebd-1e20-4904-b139-49c67352a956 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:08.211828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 419/824] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:07:08.223120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca587fd-a24f-4565-bbea-f08b59ba647c None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:08.223396 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca587fd-a24f-4565-bbea-f08b59ba647c None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:08.223705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca587fd-a24f-4565-bbea-f08b59ba647c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:08.262660 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-bca587fd-a24f-4565-bbea-f08b59ba647c None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:08.263915 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-bca587fd-a24f-4565-bbea-f08b59ba647c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:08.288370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f775f0a-ff4d-4033-b227-5bb91e9d9725 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:08.334986 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe207b-37ee-4807-8833-2bcaa405cdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:08.335680 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe207b-37ee-4807-8833-2bcaa405cdea None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:08.335964 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe207b-37ee-4807-8833-2bcaa405cdea None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:08.336245 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe207b-37ee-4807-8833-2bcaa405cdea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:08.348693 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe207b-37ee-4807-8833-2bcaa405cdea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:08.350316 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe207b-37ee-4807-8833-2bcaa405cdea None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:08.369474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-2bfe207b-37ee-4807-8833-2bcaa405cdea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:08.369474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:08.369474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:08.369474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:08.369474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:08.369474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:08.369474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:08.369474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:08.369474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:08.369474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:08.369474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:08.369474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:08.369474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:07:08.369474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:07:08.369474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:07:08.369474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:07:08.370779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:08.370779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:08.370779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:08.370779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:08.370779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:08.370779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:08.370779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:08.370779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:08.370779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:08.370779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:08.370779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:08.370779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:08.370779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:08.370779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:08.370779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:08.370779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:08.370779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:07:08.371721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:07:08.371721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:08.371721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:08.371721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 406/825] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:08.371949 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe207b-37ee-4807-8833-2bcaa405cdea None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:08.377373 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 420/826] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:07:08.378288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca587fd-a24f-4565-bbea-f08b59ba647c None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:08.408811 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:08.425999 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:08.532857 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca587fd-a24f-4565-bbea-f08b59ba647c None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:08.607079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b8b6e-9eca-40d6-9509-6f38f7ec6287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:08.607778 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b8b6e-9eca-40d6-9509-6f38f7ec6287 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:08.608610 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b8b6e-9eca-40d6-9509-6f38f7ec6287 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:08.608881 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b8b6e-9eca-40d6-9509-6f38f7ec6287 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:08.609531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b8b6e-9eca-40d6-9509-6f38f7ec6287 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:08.609828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b8b6e-9eca-40d6-9509-6f38f7ec6287 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:08.611247 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b8b6e-9eca-40d6-9509-6f38f7ec6287 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:08.620544 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe207b-37ee-4807-8833-2bcaa405cdea None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:08.639132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 421/827] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:08.644340 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b8b6e-9eca-40d6-9509-6f38f7ec6287 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:08.695157 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95eeaf7-332b-47c3-abe6-d7541ac5ad53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:08.697015 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95eeaf7-332b-47c3-abe6-d7541ac5ad53 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:08.698199 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95eeaf7-332b-47c3-abe6-d7541ac5ad53 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:08.698841 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95eeaf7-332b-47c3-abe6-d7541ac5ad53 None admin] PATH_INFO: `/v3/services/network` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:08.700757 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95eeaf7-332b-47c3-abe6-d7541ac5ad53 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:08.703893 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95eeaf7-332b-47c3-abe6-d7541ac5ad53 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:08.715677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-e95eeaf7-332b-47c3-abe6-d7541ac5ad53 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 20:07:08.715677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:08.715677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 20:07:08.715677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 20:07:08.715677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 20:07:08.715677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 20:07:08.715677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 20:07:08.715677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:08.715677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 20:07:08.715677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:08.715677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:07:08.715677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:08.715677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:08.715677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:08.715677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:08.715677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:08.715677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:08.716724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:08.716724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:08.716724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:08.716724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:08.716724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:08.716724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:08.716724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 20:07:08.716724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 20:07:08.716724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 20:07:08.716724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 20:07:08.716724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:08.716724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:08.716724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:08.716724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:08.716724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:08.716724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:08.717604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:08.717604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:08.717604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:08.717604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:08.717604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:08.717604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:08.717604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:08.717604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:08.717604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:08.717604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:08.717604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 20:07:08.717604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:08.717604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 20:07:08.717604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:08.721662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 407/828] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:07:08 2022] GET /identity/v3/services/network => generated 88 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:08.722587 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95eeaf7-332b-47c3-abe6-d7541ac5ad53 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:08.794935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:08.809479 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b8b6e-9eca-40d6-9509-6f38f7ec6287 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:08.817099 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:08.845662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95eeaf7-332b-47c3-abe6-d7541ac5ad53 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:08.860577 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cb0f7-72de-4311-842f-dc37dd51c7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:08.861692 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cb0f7-72de-4311-842f-dc37dd51c7ac None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:08.862129 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cb0f7-72de-4311-842f-dc37dd51c7ac None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:08.862964 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cb0f7-72de-4311-842f-dc37dd51c7ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:08.874470 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717cb0f7-72de-4311-842f-dc37dd51c7ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:08.876531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717cb0f7-72de-4311-842f-dc37dd51c7ac None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:08.888261 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab20811-f029-4d7b-872f-2b36981eaf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:08.889245 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab20811-f029-4d7b-872f-2b36981eaf3b None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:08.889730 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab20811-f029-4d7b-872f-2b36981eaf3b None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:08.890246 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab20811-f029-4d7b-872f-2b36981eaf3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:08.897991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-717cb0f7-72de-4311-842f-dc37dd51c7ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:08.897991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:08.897991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:08.897991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:08.897991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:08.897991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:08.897991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:08.897991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:08.897991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:08.897991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:08.897991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:08.897991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:08.897991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:07:08.897991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:07:08.897991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:07:08.899083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:07:08.899083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:08.899083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:08.899083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:08.899083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:08.899083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:08.899083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:08.899083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:08.899083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:08.899083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:08.899083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:08.899083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:08.899083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:08.899083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:08.899083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:08.899083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:08.899083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:08.900288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:07:08.900288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:07:08.900288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:07:08.900288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:07:08.900288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:07:08.900288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:07:08.900288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:08.900288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:08.902960 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 422/829] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:07:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:08.904068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cb0f7-72de-4311-842f-dc37dd51c7ac None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:08.907016 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab20811-f029-4d7b-872f-2b36981eaf3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:07:08.912520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-eab20811-f029-4d7b-872f-2b36981eaf3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:07:08.912520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:08.912520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:08.912520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:08.912520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:08.912520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:08.912520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:08.912520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:08.912520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:08.912520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:08.912520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:08.912520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:08.912520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:07:08.912520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:07:08.912520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:07:08.912520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:07:08.913675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:07:08.913675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:07:08.913675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:07:08.913675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:07:08.913675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:08.913675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:08.913675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:08.913675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:08.913675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:08.913675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:08.913675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:08.913675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:08.913675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:08.913675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:08.913675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:08.913675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:08.914704 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:08.914704 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:08.914704 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:08.914704 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:08.914704 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:07:08.914704 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:07:08.914704 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:07:08.914704 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:07:08.914704 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:07:08.914704 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:07:08.914704 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:07:08.914704 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:08.916574 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 408/830] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:07:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:08.922462 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab20811-f029-4d7b-872f-2b36981eaf3b None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:09.042624 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab20811-f029-4d7b-872f-2b36981eaf3b None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:09.049209 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cb0f7-72de-4311-842f-dc37dd51c7ac None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:09.079593 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b242702-8d2e-45da-bb1b-d4c833c9a037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:09.080644 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b242702-8d2e-45da-bb1b-d4c833c9a037 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:09.080925 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b242702-8d2e-45da-bb1b-d4c833c9a037 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:09.081196 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b242702-8d2e-45da-bb1b-d4c833c9a037 None admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:09.082219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b242702-8d2e-45da-bb1b-d4c833c9a037 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:09.082579 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b242702-8d2e-45da-bb1b-d4c833c9a037 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:09.084822 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b242702-8d2e-45da-bb1b-d4c833c9a037 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:09.094316 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a5d3e-c26c-43ff-950b-ca75405d3c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:09.095259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a5d3e-c26c-43ff-950b-ca75405d3c3e None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:09.095755 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a5d3e-c26c-43ff-950b-ca75405d3c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:09.096665 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a5d3e-c26c-43ff-950b-ca75405d3c3e None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:09.097805 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a5d3e-c26c-43ff-950b-ca75405d3c3e None admin] RBAC: Adding query filter params (name=network) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:09.098297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a5d3e-c26c-43ff-950b-ca75405d3c3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:09.099893 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a5d3e-c26c-43ff-950b-ca75405d3c3e None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:09.100547 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:09.103528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 409/831] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:07:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:09.104653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b242702-8d2e-45da-bb1b-d4c833c9a037 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:09.123086 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 423/832] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Sep 6 20:07:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:09.123086 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a5d3e-c26c-43ff-950b-ca75405d3c3e None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:09.140817 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:09.234981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a5d3e-c26c-43ff-950b-ca75405d3c3e None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:09.244527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b242702-8d2e-45da-bb1b-d4c833c9a037 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:09.275414 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b93b2-0573-4f9f-9afc-1ed31d78b3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:09.276398 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b93b2-0573-4f9f-9afc-1ed31d78b3b5 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:09.276896 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b93b2-0573-4f9f-9afc-1ed31d78b3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:09.277344 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b93b2-0573-4f9f-9afc-1ed31d78b3b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:09.278246 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b93b2-0573-4f9f-9afc-1ed31d78b3b5 None admin] RBAC: Adding query filter params (role.id=1e2ac44410664e6b8f42ab3c37e2643f, scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343, user.id=b09ce16da49b4af38491ad4eb6287d70) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:09.278818 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b93b2-0573-4f9f-9afc-1ed31d78b3b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:09.280512 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b93b2-0573-4f9f-9afc-1ed31d78b3b5 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:09.288061 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 424/833] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:07:09 2022] GET /identity/v3/role_assignments?user.id=b09ce16da49b4af38491ad4eb6287d70&scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343&role.id=1e2ac44410664e6b8f42ab3c37e2643f => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:09.289259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b93b2-0573-4f9f-9afc-1ed31d78b3b5 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:09.299502 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff30168-c2d8-4499-a984-cfeed0703792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:09.302332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff30168-c2d8-4499-a984-cfeed0703792 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:09.303462 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff30168-c2d8-4499-a984-cfeed0703792 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:09.305794 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff30168-c2d8-4499-a984-cfeed0703792 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:09.306818 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff30168-c2d8-4499-a984-cfeed0703792 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:09.307325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff30168-c2d8-4499-a984-cfeed0703792 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:09.309445 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff30168-c2d8-4499-a984-cfeed0703792 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:09.334882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 410/834] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:07:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:09.339140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff30168-c2d8-4499-a984-cfeed0703792 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:09.442762 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:09.468670 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:09.486221 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b93b2-0573-4f9f-9afc-1ed31d78b3b5 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:09.551434 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff30168-c2d8-4499-a984-cfeed0703792 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:09.555247 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8a93a-173e-4fd1-b3bd-f42c3f10adc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:09.557401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8a93a-173e-4fd1-b3bd-f42c3f10adc4 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:09.557901 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8a93a-173e-4fd1-b3bd-f42c3f10adc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:09.558379 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8a93a-173e-4fd1-b3bd-f42c3f10adc4 None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:09.559223 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8a93a-173e-4fd1-b3bd-f42c3f10adc4 None admin] RBAC: Adding query filter params (type=network) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:09.559779 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8a93a-173e-4fd1-b3bd-f42c3f10adc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:09.561466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8a93a-173e-4fd1-b3bd-f42c3f10adc4 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:09.574384 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 425/835] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Sep 6 20:07:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:09.576608 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8a93a-173e-4fd1-b3bd-f42c3f10adc4 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:09.606395 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589eb4a7-8353-4b3f-b809-8d785a348d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:09.607399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589eb4a7-8353-4b3f-b809-8d785a348d00 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:09.611253 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589eb4a7-8353-4b3f-b809-8d785a348d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:09.611766 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589eb4a7-8353-4b3f-b809-8d785a348d00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:09.628921 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589eb4a7-8353-4b3f-b809-8d785a348d00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:09.630738 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589eb4a7-8353-4b3f-b809-8d785a348d00 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:09.651662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-589eb4a7-8353-4b3f-b809-8d785a348d00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:09.651662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:09.651662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:09.651662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:09.651662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:09.651662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:09.651662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:09.651662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:09.651662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:09.651662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:09.651662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:09.651662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:09.651662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:07:09.651662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:07:09.651662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:07:09.651662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:07:09.652695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:09.652695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:09.652695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:09.652695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:09.652695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:09.652695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:09.652695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:09.652695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:09.652695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:09.652695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:09.652695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:09.652695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:09.652695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:09.652695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:09.652695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:09.652695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:09.652695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:07:09.653567 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:07:09.653567 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:09.653567 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:09.661077 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 411/836] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:09.662816 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589eb4a7-8353-4b3f-b809-8d785a348d00 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:09.722944 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8a93a-173e-4fd1-b3bd-f42c3f10adc4 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:09.774175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6796c2-f7aa-4775-b37c-49aa253f04b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:09.774837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6796c2-f7aa-4775-b37c-49aa253f04b0 None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:09.775120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6796c2-f7aa-4775-b37c-49aa253f04b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:09.775958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6796c2-f7aa-4775-b37c-49aa253f04b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:09.776659 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6796c2-f7aa-4775-b37c-49aa253f04b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:09.778529 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6796c2-f7aa-4775-b37c-49aa253f04b0 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:09.818842 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589eb4a7-8353-4b3f-b809-8d785a348d00 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:09.838484 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:09.860204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:09.872868 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 426/837] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:07:09 2022] POST /identity/v3/endpoints => generated 337 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:07:09.940085 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f059d5-46a0-4546-8021-f676c1fb06ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:09.941116 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f059d5-46a0-4546-8021-f676c1fb06ec None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:09.941605 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f059d5-46a0-4546-8021-f676c1fb06ec None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:09.942141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f059d5-46a0-4546-8021-f676c1fb06ec None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:09.943402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f059d5-46a0-4546-8021-f676c1fb06ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:09.943983 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f059d5-46a0-4546-8021-f676c1fb06ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:09.946751 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f059d5-46a0-4546-8021-f676c1fb06ec None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:09.971484 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 412/838] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:09.977835 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6796c2-f7aa-4775-b37c-49aa253f04b0 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:10.193102 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6796c2-f7aa-4775-b37c-49aa253f04b0 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:10.233025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929ae96-41d9-4470-bb96-32ca48c20085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:10.234040 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929ae96-41d9-4470-bb96-32ca48c20085 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:10.234552 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929ae96-41d9-4470-bb96-32ca48c20085 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:10.235025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929ae96-41d9-4470-bb96-32ca48c20085 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:10.253056 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929ae96-41d9-4470-bb96-32ca48c20085 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:10.254958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929ae96-41d9-4470-bb96-32ca48c20085 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:10.269844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-3929ae96-41d9-4470-bb96-32ca48c20085 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 20:07:10.269844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:10.269844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:10.269844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:10.269844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:10.269844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:10.269844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:10.269844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:10.269844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:10.269844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:10.269844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:10.269844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:10.269844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:07:10.269844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:07:10.269844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:07:10.269844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:07:10.270861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:10.270861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:10.270861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:07:10.270861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:10.270861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:07:10.270861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:10.270861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:10.270861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:10.270861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:10.270861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:10.270861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:10.270861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:10.270861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:10.270861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:10.270861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:10.270861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:10.270861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:10.270861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:10.272232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:10.272232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:10.272232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:07:10.272232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:07:10.272232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:07:10.272232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:07:10.272232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:07:10.272232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:07:10.272232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 20:07:10.272232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:10.282804 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 427/839] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:07:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:10.288603 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f059d5-46a0-4546-8021-f676c1fb06ec None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:10.316401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f585bb-010b-4e31-8668-fa706153c226 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:10.317026 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f585bb-010b-4e31-8668-fa706153c226 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:10.317593 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f585bb-010b-4e31-8668-fa706153c226 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:10.319527 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 428/840] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:10.327551 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6dde9-9157-476e-b7d9-96600ba2c8b6 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:10.328004 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6dde9-9157-476e-b7d9-96600ba2c8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:10.328495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6dde9-9157-476e-b7d9-96600ba2c8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:10.359593 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-3eb6dde9-9157-476e-b7d9-96600ba2c8b6 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:10.360867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-3eb6dde9-9157-476e-b7d9-96600ba2c8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:10.427515 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:10.428827 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f059d5-46a0-4546-8021-f676c1fb06ec None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:10.442304 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 429/841] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:07:10.475776 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8af2b4-7500-4870-af15-63b32e614939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:10.476831 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8af2b4-7500-4870-af15-63b32e614939 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:10.477324 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8af2b4-7500-4870-af15-63b32e614939 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:10.477805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8af2b4-7500-4870-af15-63b32e614939 None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:10.478875 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8af2b4-7500-4870-af15-63b32e614939 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:10.479397 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8af2b4-7500-4870-af15-63b32e614939 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:10.481242 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8af2b4-7500-4870-af15-63b32e614939 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:10.503275 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 413/842] 10.222.0.77 () {56 vars in 1135 bytes} [Tue Sep 6 20:07:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:10.508906 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6dde9-9157-476e-b7d9-96600ba2c8b6 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:10.586066 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01249368-49a6-40c1-bd28-322fa71571b6 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:10.586407 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01249368-49a6-40c1-bd28-322fa71571b6 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:10.586617 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01249368-49a6-40c1-bd28-322fa71571b6 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:10.588180 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 414/843] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:10.595473 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad695b0-0b84-4e75-a769-ec5838d258ed None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:10.595896 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad695b0-0b84-4e75-a769-ec5838d258ed None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:10.596394 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad695b0-0b84-4e75-a769-ec5838d258ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:10.632387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-cad695b0-0b84-4e75-a769-ec5838d258ed None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:10.634138 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-cad695b0-0b84-4e75-a769-ec5838d258ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:10.661523 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:10.662206 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6dde9-9157-476e-b7d9-96600ba2c8b6 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:10.719718 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178484d-66a9-470f-8f21-c60efdb1d509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:10.720519 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178484d-66a9-470f-8f21-c60efdb1d509 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:10.721010 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178484d-66a9-470f-8f21-c60efdb1d509 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:10.721363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178484d-66a9-470f-8f21-c60efdb1d509 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:10.739235 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 415/844] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 20:07:10.784785 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad695b0-0b84-4e75-a769-ec5838d258ed None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:10.790634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:10.803181 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f178484d-66a9-470f-8f21-c60efdb1d509 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:10.805304 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f178484d-66a9-470f-8f21-c60efdb1d509 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:10.938843 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad695b0-0b84-4e75-a769-ec5838d258ed None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:10.982475 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 430/845] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:07:10 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 20:07:10.992690 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178484d-66a9-470f-8f21-c60efdb1d509 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:11.012951 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b345bf6-c9a6-47b9-96a9-b96ebad2f582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:11.015385 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b345bf6-c9a6-47b9-96a9-b96ebad2f582 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:11.015894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b345bf6-c9a6-47b9-96a9-b96ebad2f582 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:11.016728 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b345bf6-c9a6-47b9-96a9-b96ebad2f582 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:11.018084 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b345bf6-c9a6-47b9-96a9-b96ebad2f582 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:11.020507 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b345bf6-c9a6-47b9-96a9-b96ebad2f582 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:11.031661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-4b345bf6-c9a6-47b9-96a9-b96ebad2f582 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 20:07:11.031661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:11.031661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 20:07:11.031661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 20:07:11.031661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 20:07:11.031661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 20:07:11.031661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 20:07:11.031661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:11.031661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 20:07:11.031661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:11.031661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:07:11.031661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:11.031661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:11.031661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:11.031661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:11.031661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:11.031661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:11.032734 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:11.032734 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:11.032734 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:11.032734 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:11.032734 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:11.032734 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:11.032734 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 20:07:11.032734 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 20:07:11.032734 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 20:07:11.032734 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 20:07:11.032734 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:11.032734 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:11.032734 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:11.032734 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:11.032734 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:11.032734 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:11.033625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:11.033625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:11.033625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:11.033625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:11.033625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:11.033625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:11.033625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:11.033625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:11.033625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:11.033625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:11.033625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 20:07:11.033625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:11.033625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 20:07:11.033625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:11.033625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 416/846] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Sep 6 20:07:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:07:11.040299 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b345bf6-c9a6-47b9-96a9-b96ebad2f582 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:11.067980 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:11.129005 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:11.145320 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178484d-66a9-470f-8f21-c60efdb1d509 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:11.174423 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b345bf6-c9a6-47b9-96a9-b96ebad2f582 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:11.183009 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdf78d-8b6b-49aa-90b7-e7bd57dcc3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:11.183724 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdf78d-8b6b-49aa-90b7-e7bd57dcc3a0 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:11.184000 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdf78d-8b6b-49aa-90b7-e7bd57dcc3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:11.184264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdf78d-8b6b-49aa-90b7-e7bd57dcc3a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:11.197302 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cdf78d-8b6b-49aa-90b7-e7bd57dcc3a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:11.198991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cdf78d-8b6b-49aa-90b7-e7bd57dcc3a0 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:11.217925 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-81cdf78d-8b6b-49aa-90b7-e7bd57dcc3a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:11.217925 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:11.217925 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:11.217925 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:11.217925 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:11.217925 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:11.217925 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:11.217925 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:11.217925 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:11.217925 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:11.217925 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:11.217925 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:11.217925 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:07:11.217925 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:07:11.217925 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:07:11.217925 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:07:11.219181 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:11.219181 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:11.219181 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:11.219181 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:11.219181 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:11.219181 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:11.219181 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:11.219181 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:11.219181 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:11.219181 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:11.219181 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:11.219181 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:11.219181 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:11.219181 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:11.219181 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:11.219181 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:11.219181 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:07:11.220355 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:07:11.220355 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:11.220355 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:11.221725 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524208e5-8fc8-4b29-a04a-c56fa21dd347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:11.222361 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524208e5-8fc8-4b29-a04a-c56fa21dd347 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:11.222643 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524208e5-8fc8-4b29-a04a-c56fa21dd347 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:11.222911 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524208e5-8fc8-4b29-a04a-c56fa21dd347 None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:11.223598 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524208e5-8fc8-4b29-a04a-c56fa21dd347 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:11.224161 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 431/847] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:11.224500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524208e5-8fc8-4b29-a04a-c56fa21dd347 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:11.224883 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdf78d-8b6b-49aa-90b7-e7bd57dcc3a0 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:11.225312 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524208e5-8fc8-4b29-a04a-c56fa21dd347 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:11.235902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 417/848] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Sep 6 20:07:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:11.235902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524208e5-8fc8-4b29-a04a-c56fa21dd347 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:11.334747 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:11.350861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdf78d-8b6b-49aa-90b7-e7bd57dcc3a0 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:11.356202 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524208e5-8fc8-4b29-a04a-c56fa21dd347 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:11.396088 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7e2c8-1d2b-49d9-896c-78b2414d48d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:11.396719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7e2c8-1d2b-49d9-896c-78b2414d48d5 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:11.399553 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7e2c8-1d2b-49d9-896c-78b2414d48d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:11.399553 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7e2c8-1d2b-49d9-896c-78b2414d48d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:11.399781 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130a778-d8b4-4b89-8ed5-9ab5b75f291a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:11.399781 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130a778-d8b4-4b89-8ed5-9ab5b75f291a None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:11.399781 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130a778-d8b4-4b89-8ed5-9ab5b75f291a None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:11.399781 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130a778-d8b4-4b89-8ed5-9ab5b75f291a None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:11.400055 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130a778-d8b4-4b89-8ed5-9ab5b75f291a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:11.400318 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130a778-d8b4-4b89-8ed5-9ab5b75f291a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:11.401690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130a778-d8b4-4b89-8ed5-9ab5b75f291a None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:11.412081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7e2c8-1d2b-49d9-896c-78b2414d48d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:07:11.423175 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 418/849] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:11.423372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-8cd7e2c8-1d2b-49d9-896c-78b2414d48d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:07:11.423372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:11.423372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:11.423372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:11.423372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:11.423372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:11.423372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:11.423372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:11.423372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:11.423372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:11.423372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:11.423372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:11.423372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:07:11.423372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:07:11.423372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:07:11.423372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:07:11.424395 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:07:11.424395 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:07:11.424395 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:07:11.424395 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:07:11.424395 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:11.424395 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:11.424395 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:11.424395 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:11.424395 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:11.424395 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:11.424395 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:11.424395 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:11.424395 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:11.424395 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:11.424395 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:11.424395 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:11.425227 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:11.425227 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:11.425227 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:11.425227 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:11.425227 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:07:11.425227 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:07:11.425227 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:07:11.425227 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:07:11.425227 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:07:11.425227 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:07:11.425227 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:07:11.425227 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:11.425875 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130a778-d8b4-4b89-8ed5-9ab5b75f291a None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:11.425975 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 432/850] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Sep 6 20:07:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:11.425975 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7e2c8-1d2b-49d9-896c-78b2414d48d5 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:11.429012 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:11.540553 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7e2c8-1d2b-49d9-896c-78b2414d48d5 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:11.541971 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130a778-d8b4-4b89-8ed5-9ab5b75f291a None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:11.579155 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad22f1-a447-40f0-823e-a216ed13cd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:11.579668 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4b318-43b2-4150-91af-70f388b7bde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:11.580293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4b318-43b2-4150-91af-70f388b7bde7 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:11.580573 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4b318-43b2-4150-91af-70f388b7bde7 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:11.580844 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4b318-43b2-4150-91af-70f388b7bde7 None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:11.581058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad22f1-a447-40f0-823e-a216ed13cd2e None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:11.581477 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4b318-43b2-4150-91af-70f388b7bde7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:11.581712 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad22f1-a447-40f0-823e-a216ed13cd2e None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:11.581815 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4b318-43b2-4150-91af-70f388b7bde7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:11.582245 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad22f1-a447-40f0-823e-a216ed13cd2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:11.583130 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4b318-43b2-4150-91af-70f388b7bde7 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:11.588617 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 419/851] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Sep 6 20:07:11 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:11.589380 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4b318-43b2-4150-91af-70f388b7bde7 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:11.601633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad22f1-a447-40f0-823e-a216ed13cd2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:11.603340 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad22f1-a447-40f0-823e-a216ed13cd2e None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:11.607885 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:11.618175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-86ad22f1-a447-40f0-823e-a216ed13cd2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:11.618175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:11.618175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:11.618175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:11.618175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:11.618175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:11.618175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:11.618175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:11.618175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:11.618175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:11.618175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:11.618175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:11.618175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:07:11.618175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:07:11.618175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:07:11.630618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:07:11.630618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:11.630618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:11.630618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:11.630618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:11.630618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:11.630618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:11.630618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:11.630618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:11.630618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:11.630618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:11.630618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:11.630618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:11.630618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:11.630618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:11.630618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:11.630618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:11.631545 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:07:11.631545 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:07:11.631545 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:07:11.631545 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:07:11.631545 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:07:11.631545 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:07:11.631545 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:11.631545 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:11.631545 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 433/852] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:07:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:11.631545 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad22f1-a447-40f0-823e-a216ed13cd2e None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:11.719339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:11.763115 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4b318-43b2-4150-91af-70f388b7bde7 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:11.776158 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad22f1-a447-40f0-823e-a216ed13cd2e None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:11.820469 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f7268-8b4d-4f90-8c6f-1c7b49af3c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:11.821101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f7268-8b4d-4f90-8c6f-1c7b49af3c1a None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:11.822130 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f7268-8b4d-4f90-8c6f-1c7b49af3c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:11.822130 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f7268-8b4d-4f90-8c6f-1c7b49af3c1a None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:11.822383 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f7268-8b4d-4f90-8c6f-1c7b49af3c1a None admin] RBAC: Adding query filter params (name=service) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:11.822661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f7268-8b4d-4f90-8c6f-1c7b49af3c1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:11.826033 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f7268-8b4d-4f90-8c6f-1c7b49af3c1a None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:11.828416 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577abbc-2b85-4abb-8cde-aabb22b0265e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:11.828881 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577abbc-2b85-4abb-8cde-aabb22b0265e None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:11.829164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577abbc-2b85-4abb-8cde-aabb22b0265e None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:11.829440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577abbc-2b85-4abb-8cde-aabb22b0265e None admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:11.830173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577abbc-2b85-4abb-8cde-aabb22b0265e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:11.835554 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577abbc-2b85-4abb-8cde-aabb22b0265e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:11.835554 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577abbc-2b85-4abb-8cde-aabb22b0265e None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:11.839490 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 420/853] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Sep 6 20:07:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:11.845769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f7268-8b4d-4f90-8c6f-1c7b49af3c1a None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:11.851544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 434/854] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:07:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:11.853693 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577abbc-2b85-4abb-8cde-aabb22b0265e None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:11.933648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:11.974770 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f7268-8b4d-4f90-8c6f-1c7b49af3c1a None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:11.997595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577abbc-2b85-4abb-8cde-aabb22b0265e None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:12.015116 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c08cb-99e8-49ca-84ed-2dc4a6001c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:12.016071 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c08cb-99e8-49ca-84ed-2dc4a6001c22 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:12.016594 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c08cb-99e8-49ca-84ed-2dc4a6001c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:12.016794 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c08cb-99e8-49ca-84ed-2dc4a6001c22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:12.028872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c08cb-99e8-49ca-84ed-2dc4a6001c22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:12.029903 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:12.030340 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c08cb-99e8-49ca-84ed-2dc4a6001c22 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:12.044711 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe7297-d556-4e89-87b1-7276fd52d55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:12.045353 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe7297-d556-4e89-87b1-7276fd52d55f None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:12.045640 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe7297-d556-4e89-87b1-7276fd52d55f None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:12.045919 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe7297-d556-4e89-87b1-7276fd52d55f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:12.046052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-c20c08cb-99e8-49ca-84ed-2dc4a6001c22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:12.046052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:12.046052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:12.046052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:12.046052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:12.046052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:12.046052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:12.046052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:12.046052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:12.046052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:12.046052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:12.046052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:12.046052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:07:12.046052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:07:12.046052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:07:12.046052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:07:12.047107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:12.047107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:12.047107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:12.047107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:12.047107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:12.047107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:12.047107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:12.047107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:12.047107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:12.047107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:12.047107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:12.047107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:12.047107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:12.047107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:12.047107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:12.047107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:12.047107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:07:12.048628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:07:12.048628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:12.048628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:12.048956 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe7297-d556-4e89-87b1-7276fd52d55f None admin] RBAC: Adding query filter params (role.id=1e2ac44410664e6b8f42ab3c37e2643f, scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343, user.id=5a6c4f91a59548fd979e7232a2afd6ec) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:12.048956 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe7297-d556-4e89-87b1-7276fd52d55f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:12.048956 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe7297-d556-4e89-87b1-7276fd52d55f None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:12.053307 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 421/855] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:07:12.054366 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab257a0c-6042-4602-b6da-0fe1c6e49ff5 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:12.054647 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab257a0c-6042-4602-b6da-0fe1c6e49ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:12.054911 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab257a0c-6042-4602-b6da-0fe1c6e49ff5 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:12.055686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 435/856] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:07:11 2022] GET /identity/v3/role_assignments?user.id=5a6c4f91a59548fd979e7232a2afd6ec&scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343&role.id=1e2ac44410664e6b8f42ab3c37e2643f => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:12.059589 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 422/857] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:12.064586 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe7297-d556-4e89-87b1-7276fd52d55f None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:12.065531 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283754c-5ba5-49f1-851c-26593672dc73 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:12.065914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283754c-5ba5-49f1-851c-26593672dc73 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:12.066309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283754c-5ba5-49f1-851c-26593672dc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:12.092693 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-7283754c-5ba5-49f1-851c-26593672dc73 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:12.095425 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-7283754c-5ba5-49f1-851c-26593672dc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:12.203213 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 423/858] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 20:07:12.206268 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe7297-d556-4e89-87b1-7276fd52d55f None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:12.246177 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e341d2-4e0e-43e7-a941-b52bce9be103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:12.246794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e341d2-4e0e-43e7-a941-b52bce9be103 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:12.247078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e341d2-4e0e-43e7-a941-b52bce9be103 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:12.247351 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e341d2-4e0e-43e7-a941-b52bce9be103 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:12.248031 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e341d2-4e0e-43e7-a941-b52bce9be103 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:12.248335 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e341d2-4e0e-43e7-a941-b52bce9be103 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:12.249802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e341d2-4e0e-43e7-a941-b52bce9be103 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:12.263533 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 436/859] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:12.269742 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283754c-5ba5-49f1-851c-26593672dc73 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:12.327664 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:12.398343 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283754c-5ba5-49f1-851c-26593672dc73 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:12.454293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea426b-bcb3-4dd0-90e5-a1d352822ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:12.454953 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea426b-bcb3-4dd0-90e5-a1d352822ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:12.455233 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea426b-bcb3-4dd0-90e5-a1d352822ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:12.455656 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea426b-bcb3-4dd0-90e5-a1d352822ea0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:12.466661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea426b-bcb3-4dd0-90e5-a1d352822ea0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:12.468963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea426b-bcb3-4dd0-90e5-a1d352822ea0 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:12.481970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-58ea426b-bcb3-4dd0-90e5-a1d352822ea0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 20:07:12.481970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:12.481970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:12.481970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:12.481970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:12.481970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:12.481970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:12.481970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:12.481970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:12.481970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:12.481970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:12.481970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:12.481970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:07:12.481970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:07:12.481970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:07:12.481970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:07:12.483046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:12.483046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:12.483046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:07:12.483046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:12.483046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:07:12.483046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:12.483046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:12.483046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:12.483046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:12.483046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:12.483046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:12.483046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:12.483046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:12.483046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:12.483046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:12.483046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:12.483046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:12.483046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:12.484023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:12.484023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:12.484023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:07:12.484023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:07:12.484023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:07:12.484023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:07:12.484023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:07:12.484023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:07:12.484023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 20:07:12.484023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:12.487558 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 424/860] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Sep 6 20:07:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:12.492998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e341d2-4e0e-43e7-a941-b52bce9be103 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:12.493482 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea426b-bcb3-4dd0-90e5-a1d352822ea0 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:12.561312 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:12.609700 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea426b-bcb3-4dd0-90e5-a1d352822ea0 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:12.621588 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:12.625032 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e341d2-4e0e-43e7-a941-b52bce9be103 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:12.665525 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2039d6c-08ba-4e88-9159-745dd944e8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:12.666127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2039d6c-08ba-4e88-9159-745dd944e8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:12.666401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2039d6c-08ba-4e88-9159-745dd944e8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:12.666835 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2039d6c-08ba-4e88-9159-745dd944e8e1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:12.667385 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af6dc7-734f-4248-a76f-ee6629e6e2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:12.667550 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2039d6c-08ba-4e88-9159-745dd944e8e1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:12.668035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af6dc7-734f-4248-a76f-ee6629e6e2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:12.668450 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af6dc7-734f-4248-a76f-ee6629e6e2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:12.668725 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af6dc7-734f-4248-a76f-ee6629e6e2e0 None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:12.669065 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2039d6c-08ba-4e88-9159-745dd944e8e1 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:12.669543 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af6dc7-734f-4248-a76f-ee6629e6e2e0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:12.669939 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af6dc7-734f-4248-a76f-ee6629e6e2e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:12.671400 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af6dc7-734f-4248-a76f-ee6629e6e2e0 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:12.680792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-d2039d6c-08ba-4e88-9159-745dd944e8e1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 20:07:12.680792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:12.680792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 20:07:12.680792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 20:07:12.680792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 20:07:12.680792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 20:07:12.680792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 20:07:12.680792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:12.680792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 20:07:12.680792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:12.680792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:07:12.680792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:12.680792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:12.680792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:12.680792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:12.680792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:12.681972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:12.681972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:12.681972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:12.681972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:12.681972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:12.681972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:12.681972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:12.681972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 20:07:12.681972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 20:07:12.681972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 20:07:12.681972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 20:07:12.681972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:12.681972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:12.681972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:12.681972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:12.681972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:12.681972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:12.683032 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:12.683032 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:12.683032 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:12.683032 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:12.683032 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:12.683032 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:12.683032 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:12.683032 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:12.683032 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:12.683032 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:12.683032 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 20:07:12.683032 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:12.683032 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 20:07:12.683032 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:12.684247 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 425/861] 10.222.0.77 () {56 vars in 1132 bytes} [Tue Sep 6 20:07:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:07:12.689498 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2039d6c-08ba-4e88-9159-745dd944e8e1 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:12.698274 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 437/862] 10.222.0.77 () {56 vars in 1149 bytes} [Tue Sep 6 20:07:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:12.704747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af6dc7-734f-4248-a76f-ee6629e6e2e0 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:12.816480 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2039d6c-08ba-4e88-9159-745dd944e8e1 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:12.860012 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af6dc7-734f-4248-a76f-ee6629e6e2e0 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:12.863885 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:12.871990 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa199aa2-6d54-44ef-aaa5-6af772879d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:12.873946 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa199aa2-6d54-44ef-aaa5-6af772879d83 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:12.874641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa199aa2-6d54-44ef-aaa5-6af772879d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:12.875425 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa199aa2-6d54-44ef-aaa5-6af772879d83 None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:12.877191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa199aa2-6d54-44ef-aaa5-6af772879d83 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:12.877938 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa199aa2-6d54-44ef-aaa5-6af772879d83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:12.880810 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa199aa2-6d54-44ef-aaa5-6af772879d83 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:12.895158 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 426/863] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Sep 6 20:07:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:12.899519 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa199aa2-6d54-44ef-aaa5-6af772879d83 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:12.903244 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c3093-0752-4950-bf19-a88cc7d35da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:12.903929 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c3093-0752-4950-bf19-a88cc7d35da2 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:12.904205 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c3093-0752-4950-bf19-a88cc7d35da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:12.904528 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c3093-0752-4950-bf19-a88cc7d35da2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:12.992386 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c3093-0752-4950-bf19-a88cc7d35da2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:12.994249 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c3093-0752-4950-bf19-a88cc7d35da2 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:13.015877 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:13.072339 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa199aa2-6d54-44ef-aaa5-6af772879d83 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:13.122811 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d1b5c-ebfc-4606-9c69-e21f5723e522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:13.124116 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d1b5c-ebfc-4606-9c69-e21f5723e522 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:13.124402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d1b5c-ebfc-4606-9c69-e21f5723e522 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:13.124681 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d1b5c-ebfc-4606-9c69-e21f5723e522 None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:13.125315 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d1b5c-ebfc-4606-9c69-e21f5723e522 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:13.125619 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d1b5c-ebfc-4606-9c69-e21f5723e522 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:13.127996 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d1b5c-ebfc-4606-9c69-e21f5723e522 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:13.139689 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 427/864] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Sep 6 20:07:12 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:13.147843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 438/865] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:07:12 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 06 20:07:13.153684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d1b5c-ebfc-4606-9c69-e21f5723e522 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:13.271914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d1b5c-ebfc-4606-9c69-e21f5723e522 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:13.273923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:13.319732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404c61a-8b81-4bf8-9ee9-1a2b8a1c0664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:13.320448 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404c61a-8b81-4bf8-9ee9-1a2b8a1c0664 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:13.320741 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404c61a-8b81-4bf8-9ee9-1a2b8a1c0664 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:13.320993 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404c61a-8b81-4bf8-9ee9-1a2b8a1c0664 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:13.334344 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404c61a-8b81-4bf8-9ee9-1a2b8a1c0664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:13.335848 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404c61a-8b81-4bf8-9ee9-1a2b8a1c0664 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:13.352721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-d404c61a-8b81-4bf8-9ee9-1a2b8a1c0664 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:13.352721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:13.352721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:13.352721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:13.352721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:13.352721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:13.352721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:13.352721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:13.352721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:13.352721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:13.352721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:13.352721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:13.352721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:07:13.352721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:07:13.352721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:07:13.352721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:07:13.354500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:13.354500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:13.354500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:13.354500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:13.354500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:13.354500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:13.354500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:13.354500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:13.354500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:13.354500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:13.354500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:13.354500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:13.354500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:13.354500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:13.354500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:13.354500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:13.354500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:07:13.356330 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:07:13.356330 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:13.356330 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:13.360837 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 428/866] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:13.361168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c3093-0752-4950-bf19-a88cc7d35da2 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:13.363890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:13.475686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c3093-0752-4950-bf19-a88cc7d35da2 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:13.513355 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e33b8-8b6d-4dcd-aeac-50c8efb349f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:13.514140 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e33b8-8b6d-4dcd-aeac-50c8efb349f3 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:13.514329 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e33b8-8b6d-4dcd-aeac-50c8efb349f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:13.514614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e33b8-8b6d-4dcd-aeac-50c8efb349f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:13.515283 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e33b8-8b6d-4dcd-aeac-50c8efb349f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:13.515616 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e33b8-8b6d-4dcd-aeac-50c8efb349f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:13.516997 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e33b8-8b6d-4dcd-aeac-50c8efb349f3 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:13.535567 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 439/867] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:13.536944 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404c61a-8b81-4bf8-9ee9-1a2b8a1c0664 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:13.650517 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404c61a-8b81-4bf8-9ee9-1a2b8a1c0664 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:13.689928 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce746a-4112-4eca-99b1-f4b16b6429a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:13.690570 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce746a-4112-4eca-99b1-f4b16b6429a7 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:13.690848 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce746a-4112-4eca-99b1-f4b16b6429a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:13.691122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce746a-4112-4eca-99b1-f4b16b6429a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:13.698979 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce746a-4112-4eca-99b1-f4b16b6429a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:13.700480 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce746a-4112-4eca-99b1-f4b16b6429a7 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:13.713523 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-f3ce746a-4112-4eca-99b1-f4b16b6429a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:13.713523 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:13.713523 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:13.713523 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:13.713523 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:13.713523 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:13.713523 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:13.713523 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:13.713523 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:13.713523 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:13.713523 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:13.713523 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:13.713523 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:07:13.713523 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:07:13.713523 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:07:13.715690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:07:13.715690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:13.715690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:13.715690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:13.715690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:13.715690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:13.715690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:13.715690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:13.715690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:13.715690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:13.715690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:13.715690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:13.715690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:13.715690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:13.715690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:13.715690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:13.715690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:13.718296 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:07:13.718296 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:07:13.718296 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:07:13.718296 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:07:13.718296 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:07:13.718296 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:07:13.718296 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:13.718296 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:13.722657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 429/868] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:07:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:13.722876 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e33b8-8b6d-4dcd-aeac-50c8efb349f3 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:13.797722 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:13.844106 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e33b8-8b6d-4dcd-aeac-50c8efb349f3 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:13.884102 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143f948-47dc-44d5-8fa6-f264fda9bb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:13.884721 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143f948-47dc-44d5-8fa6-f264fda9bb46 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:13.884994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143f948-47dc-44d5-8fa6-f264fda9bb46 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:13.885262 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143f948-47dc-44d5-8fa6-f264fda9bb46 None admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:13.886130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143f948-47dc-44d5-8fa6-f264fda9bb46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:13.886473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143f948-47dc-44d5-8fa6-f264fda9bb46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:13.888920 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143f948-47dc-44d5-8fa6-f264fda9bb46 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:13.904593 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 440/869] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:07:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:13.911010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce746a-4112-4eca-99b1-f4b16b6429a7 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:13.911621 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3a371-8248-4acb-bfd0-dbe83c5c6f34 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:13.911914 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3a371-8248-4acb-bfd0-dbe83c5c6f34 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:13.912193 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3a371-8248-4acb-bfd0-dbe83c5c6f34 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:13.913945 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 441/870] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:13.920118 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642cff4-3d22-4aad-9b6d-8a8927933f73 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:13.920931 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642cff4-3d22-4aad-9b6d-8a8927933f73 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:13.921219 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642cff4-3d22-4aad-9b6d-8a8927933f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:13.936787 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:13.941102 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-c642cff4-3d22-4aad-9b6d-8a8927933f73 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:13.942527 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-c642cff4-3d22-4aad-9b6d-8a8927933f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:14.056204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 442/871] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 20:07:14.081694 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce746a-4112-4eca-99b1-f4b16b6429a7 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:14.122078 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6b482-f9f6-4cb8-b94b-5590bf5b236f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:14.122972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6b482-f9f6-4cb8-b94b-5590bf5b236f None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:14.123433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6b482-f9f6-4cb8-b94b-5590bf5b236f None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:14.124444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6b482-f9f6-4cb8-b94b-5590bf5b236f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:14.125345 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6b482-f9f6-4cb8-b94b-5590bf5b236f None admin] RBAC: Adding query filter params (role.id=140b49dfcc2b489ca0504d2e7abfdbdb, scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343, user.id=c314372147b2491cb4481d538056472c) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:14.125814 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6b482-f9f6-4cb8-b94b-5590bf5b236f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:14.127748 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6b482-f9f6-4cb8-b94b-5590bf5b236f None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:14.135323 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 430/872] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:07:13 2022] GET /identity/v3/role_assignments?user.id=c314372147b2491cb4481d538056472c&scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343&role.id=140b49dfcc2b489ca0504d2e7abfdbdb => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:14.350046 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642cff4-3d22-4aad-9b6d-8a8927933f73 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:14.426499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:14.484407 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642cff4-3d22-4aad-9b6d-8a8927933f73 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:14.527572 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c3e43-8884-4bef-8fab-dabfe59135de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:14.528242 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c3e43-8884-4bef-8fab-dabfe59135de None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:14.528502 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c3e43-8884-4bef-8fab-dabfe59135de None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:14.528752 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c3e43-8884-4bef-8fab-dabfe59135de None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:14.529399 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c3e43-8884-4bef-8fab-dabfe59135de None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:14.531001 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c3e43-8884-4bef-8fab-dabfe59135de None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:14.536389 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a17cac-9aac-44e4-9b93-f204cc34e614 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:14.536728 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a17cac-9aac-44e4-9b93-f204cc34e614 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:14.537004 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a17cac-9aac-44e4-9b93-f204cc34e614 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:14.538283 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 431/873] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:07:14.544449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8875405-52f3-4049-bce7-dcb5af752687 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:14.544731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8875405-52f3-4049-bce7-dcb5af752687 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:14.545005 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8875405-52f3-4049-bce7-dcb5af752687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:14.566288 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-e8875405-52f3-4049-bce7-dcb5af752687 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:14.567779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-e8875405-52f3-4049-bce7-dcb5af752687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:14.627577 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 443/874] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Sep 6 20:07:14 2022] POST /identity/v3/services => generated 251 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:07:14.680640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 432/875] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:14 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 20:07:14.992725 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c3e43-8884-4bef-8fab-dabfe59135de None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:15.129149 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c3e43-8884-4bef-8fab-dabfe59135de None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:15.147421 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:15.184885 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e64f8-d3f6-4e4a-b6a1-2668207e149f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:15.186392 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e64f8-d3f6-4e4a-b6a1-2668207e149f None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:15.186904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e64f8-d3f6-4e4a-b6a1-2668207e149f None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:15.187420 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e64f8-d3f6-4e4a-b6a1-2668207e149f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:15.188267 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e64f8-d3f6-4e4a-b6a1-2668207e149f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:15.189880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e64f8-d3f6-4e4a-b6a1-2668207e149f None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:15.201966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-be4e64f8-d3f6-4e4a-b6a1-2668207e149f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 20:07:15.201966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:15.201966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 20:07:15.201966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 20:07:15.201966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 20:07:15.201966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 20:07:15.201966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 20:07:15.201966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:15.201966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 20:07:15.201966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:15.201966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:07:15.201966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:15.201966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:15.201966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:15.201966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:15.201966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:15.201966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:15.203387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:15.203387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:15.203387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:15.203387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:15.203387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:15.203387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:15.203387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 20:07:15.203387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 20:07:15.203387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 20:07:15.203387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 20:07:15.203387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:15.203387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:15.203387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:15.203387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:15.203387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:15.203387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:15.204328 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:15.204328 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:15.204328 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:15.204328 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:15.204328 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:15.204328 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:15.204328 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:15.204328 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:15.204328 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:15.204328 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:15.204328 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 20:07:15.204328 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:15.204328 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 20:07:15.204328 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:15.210733 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 444/876] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Sep 6 20:07:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:15.216713 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8875405-52f3-4049-bce7-dcb5af752687 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:15.221831 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:15.340234 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8875405-52f3-4049-bce7-dcb5af752687 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:15.378036 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b0e56-31e8-40df-9b80-30050b888279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:15.378996 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b0e56-31e8-40df-9b80-30050b888279 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:15.379497 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b0e56-31e8-40df-9b80-30050b888279 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:15.380149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b0e56-31e8-40df-9b80-30050b888279 None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:15.381131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b0e56-31e8-40df-9b80-30050b888279 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:15.381821 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b0e56-31e8-40df-9b80-30050b888279 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:15.384120 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b0e56-31e8-40df-9b80-30050b888279 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:15.392186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 433/877] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Sep 6 20:07:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:15.403593 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e64f8-d3f6-4e4a-b6a1-2668207e149f None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:15.532556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e64f8-d3f6-4e4a-b6a1-2668207e149f None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:15.575248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05a5d9-61e0-4c9f-8c09-a669ca6d6686 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:15.575787 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05a5d9-61e0-4c9f-8c09-a669ca6d6686 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:15.575877 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05a5d9-61e0-4c9f-8c09-a669ca6d6686 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:15.576802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd3cb5-9cf0-45f8-a4db-5ad4f71eb3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:15.577417 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd3cb5-9cf0-45f8-a4db-5ad4f71eb3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:15.577526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 434/878] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:07:15.577766 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd3cb5-9cf0-45f8-a4db-5ad4f71eb3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:15.578037 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd3cb5-9cf0-45f8-a4db-5ad4f71eb3f4 None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:15.578739 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd3cb5-9cf0-45f8-a4db-5ad4f71eb3f4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:15.579046 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd3cb5-9cf0-45f8-a4db-5ad4f71eb3f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:15.580473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd3cb5-9cf0-45f8-a4db-5ad4f71eb3f4 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:15.582889 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01908133-d91f-4fcc-994e-e7f7ab87827d None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:15.583177 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01908133-d91f-4fcc-994e-e7f7ab87827d None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:15.583469 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01908133-d91f-4fcc-994e-e7f7ab87827d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:15.586679 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 445/879] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Sep 6 20:07:15 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:15.606360 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-01908133-d91f-4fcc-994e-e7f7ab87827d None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:15.607578 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-01908133-d91f-4fcc-994e-e7f7ab87827d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:15.685031 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:15.691735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 435/880] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:15 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:07:15.963352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd3cb5-9cf0-45f8-a4db-5ad4f71eb3f4 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:16.024256 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:16.094513 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd3cb5-9cf0-45f8-a4db-5ad4f71eb3f4 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:16.138065 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a5178-96c4-4a2b-81a3-17401e5bead8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:16.138686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a5178-96c4-4a2b-81a3-17401e5bead8 None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:16.138963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a5178-96c4-4a2b-81a3-17401e5bead8 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:16.139932 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a5178-96c4-4a2b-81a3-17401e5bead8 None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:16.140612 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a5178-96c4-4a2b-81a3-17401e5bead8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:16.142001 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a5178-96c4-4a2b-81a3-17401e5bead8 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:16.230104 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 446/881] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Sep 6 20:07:15 2022] POST /identity/v3/services => generated 269 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:07:16.569380 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8825a6a-c9e3-43b0-a3fa-93f24f1ae11b None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:16.569662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8825a6a-c9e3-43b0-a3fa-93f24f1ae11b None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:16.570182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8825a6a-c9e3-43b0-a3fa-93f24f1ae11b None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:16.572104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 436/882] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:16.578488 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa383353-3d21-4548-92fa-4b7b9efd15d9 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:16.579386 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa383353-3d21-4548-92fa-4b7b9efd15d9 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:16.579865 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa383353-3d21-4548-92fa-4b7b9efd15d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:16.599429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-aa383353-3d21-4548-92fa-4b7b9efd15d9 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:16.600918 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-aa383353-3d21-4548-92fa-4b7b9efd15d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:16.687948 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 447/883] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:16 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 20:07:16.959392 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8825a6a-c9e3-43b0-a3fa-93f24f1ae11b None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:17.093268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8825a6a-c9e3-43b0-a3fa-93f24f1ae11b None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:17.131299 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa0493-afce-4942-ae0c-d5e3637513fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:17.131972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa0493-afce-4942-ae0c-d5e3637513fb None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:17.132252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa0493-afce-4942-ae0c-d5e3637513fb None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:17.132524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa0493-afce-4942-ae0c-d5e3637513fb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:17.145513 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa0493-afce-4942-ae0c-d5e3637513fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:07:17.150604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-8dfa0493-afce-4942-ae0c-d5e3637513fb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 20:07:17.150604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:17.150604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:17.150604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:17.150604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:17.150604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:17.150604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:17.150604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:17.150604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:17.150604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:17.150604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:17.150604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:17.150604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:07:17.150604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:07:17.150604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:07:17.150604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:07:17.151609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:07:17.151609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:07:17.151609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:07:17.151609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:07:17.151609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:17.151609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:17.151609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:17.151609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:17.151609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:17.151609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:17.151609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:17.151609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:17.151609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:17.151609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:17.151609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:17.151609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:17.152433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:17.152433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:17.152433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:17.152433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:17.152433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:07:17.152433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:07:17.152433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:07:17.152433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:07:17.152433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:07:17.152433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:07:17.152433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 20:07:17.152433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:17.152433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 437/884] 10.222.0.77 () {56 vars in 1120 bytes} [Tue Sep 6 20:07:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:17.159674 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa383353-3d21-4548-92fa-4b7b9efd15d9 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:17.197447 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:17.217862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66151582-3ea3-46f0-b5ff-69b2f38120d6 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:17.217862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66151582-3ea3-46f0-b5ff-69b2f38120d6 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:17.218114 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66151582-3ea3-46f0-b5ff-69b2f38120d6 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:17.222698 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 438/885] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:07:17.228180 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16a03b-2028-455d-9c25-2c880076de41 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:17.228513 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16a03b-2028-455d-9c25-2c880076de41 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:17.228729 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16a03b-2028-455d-9c25-2c880076de41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:17.251852 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-4a16a03b-2028-455d-9c25-2c880076de41 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:17.253421 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-4a16a03b-2028-455d-9c25-2c880076de41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:17.300353 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa383353-3d21-4548-92fa-4b7b9efd15d9 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:17.330811 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:17.344133 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d86db4-d881-4f63-b9d5-9af4b76ffab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:17.344766 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d86db4-d881-4f63-b9d5-9af4b76ffab9 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:17.345089 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d86db4-d881-4f63-b9d5-9af4b76ffab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:17.345426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d86db4-d881-4f63-b9d5-9af4b76ffab9 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:17.346526 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d86db4-d881-4f63-b9d5-9af4b76ffab9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:17.346994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d86db4-d881-4f63-b9d5-9af4b76ffab9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:17.348586 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d86db4-d881-4f63-b9d5-9af4b76ffab9 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:17.355860 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 439/886] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:07:17.360214 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 448/887] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Sep 6 20:07:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:17.366373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16a03b-2028-455d-9c25-2c880076de41 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:17.497146 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16a03b-2028-455d-9c25-2c880076de41 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:17.544312 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5f05d-2789-4690-8588-db8f31e14474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:17.545007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5f05d-2789-4690-8588-db8f31e14474 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:17.545318 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5f05d-2789-4690-8588-db8f31e14474 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:17.545582 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5f05d-2789-4690-8588-db8f31e14474 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:17.558243 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5f05d-2789-4690-8588-db8f31e14474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:17.559832 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5f05d-2789-4690-8588-db8f31e14474 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:17.577984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-5fd5f05d-2789-4690-8588-db8f31e14474 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:17.577984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:17.577984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:17.577984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:17.577984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:17.577984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:17.577984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:17.577984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:17.577984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:17.577984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:17.577984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:17.577984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:17.577984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:07:17.577984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:07:17.577984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:07:17.577984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:07:17.579020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:17.579020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:17.579020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:17.579020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:17.579020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:17.579020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:17.579020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:17.579020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:17.579020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:17.579020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:17.579020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:17.579020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:17.579020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:17.579020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:17.579020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:17.579020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:17.579020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:07:17.579983 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:07:17.579983 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:17.579983 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:17.579983 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 440/888] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:17.588994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d86db4-d881-4f63-b9d5-9af4b76ffab9 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:17.702829 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5f05d-2789-4690-8588-db8f31e14474 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:17.716998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:17.729823 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d86db4-d881-4f63-b9d5-9af4b76ffab9 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:17.753047 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:17.772652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18ebbd-566a-4594-b25a-b3981de4aaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:17.773270 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18ebbd-566a-4594-b25a-b3981de4aaf4 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:17.773553 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18ebbd-566a-4594-b25a-b3981de4aaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:17.773828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18ebbd-566a-4594-b25a-b3981de4aaf4 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:17.774543 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18ebbd-566a-4594-b25a-b3981de4aaf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:17.774850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18ebbd-566a-4594-b25a-b3981de4aaf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:17.776332 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18ebbd-566a-4594-b25a-b3981de4aaf4 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:17.794334 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 449/889] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:17.795979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18ebbd-566a-4594-b25a-b3981de4aaf4 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:17.846077 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5f05d-2789-4690-8588-db8f31e14474 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:17.885563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5449d0e-6d0d-4106-9e75-2a3161847c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:17.886512 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5449d0e-6d0d-4106-9e75-2a3161847c10 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:17.886970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5449d0e-6d0d-4106-9e75-2a3161847c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:17.887420 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5449d0e-6d0d-4106-9e75-2a3161847c10 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:17.888178 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5449d0e-6d0d-4106-9e75-2a3161847c10 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:17.890359 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5449d0e-6d0d-4106-9e75-2a3161847c10 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:17.900814 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-a5449d0e-6d0d-4106-9e75-2a3161847c10 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 20:07:17.900814 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:17.900814 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 20:07:17.900814 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 20:07:17.900814 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 20:07:17.900814 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 20:07:17.900814 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 20:07:17.900814 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:17.900814 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 20:07:17.900814 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:17.900814 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:07:17.900814 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:17.900814 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:17.900814 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:17.900814 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:17.900814 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:17.900814 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:17.902122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:17.902122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:17.902122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:17.902122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:17.902122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:17.902122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:17.902122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 20:07:17.902122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 20:07:17.902122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 20:07:17.902122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 20:07:17.902122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:17.902122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:17.902122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:17.902122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:17.902122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:17.902122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:17.903057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:17.903057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:17.903057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:17.903057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:17.903057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:17.903057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:17.903057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:17.903057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:17.903057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:17.903057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:17.903057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 20:07:17.903057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:17.903057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 20:07:17.903057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:17.906098 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 441/890] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Sep 6 20:07:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:17.913184 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5449d0e-6d0d-4106-9e75-2a3161847c10 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:17.930641 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18ebbd-566a-4594-b25a-b3981de4aaf4 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:17.978551 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f7553-3519-489f-bc75-04423fbca7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:17.979277 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f7553-3519-489f-bc75-04423fbca7be None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:17.979495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f7553-3519-489f-bc75-04423fbca7be None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:17.979766 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f7553-3519-489f-bc75-04423fbca7be None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:17.988116 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f7553-3519-489f-bc75-04423fbca7be None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:17.989647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f7553-3519-489f-bc75-04423fbca7be None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:18.002781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-be4f7553-3519-489f-bc75-04423fbca7be None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 20:07:18.002781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:18.002781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:18.002781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:18.002781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:18.002781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:18.002781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:18.002781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:18.002781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:18.002781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:18.002781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:18.002781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:18.002781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:07:18.002781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:07:18.002781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:07:18.002781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:07:18.003938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:18.003938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:18.003938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:07:18.003938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:18.003938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:07:18.003938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:18.003938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:18.003938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:18.003938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:18.003938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:18.003938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:18.003938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:18.003938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:18.003938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:18.003938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:18.003938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:18.003938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:18.003938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:18.009943 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:18.009943 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:18.009943 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:07:18.009943 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:07:18.009943 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:07:18.009943 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:07:18.009943 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:07:18.009943 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:07:18.009943 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 20:07:18.009943 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:18.009943 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 450/891] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Sep 6 20:07:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:07:18.009943 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6acef-13e4-4dbb-b6b0-dbaf75fdc177 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:18.009943 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6acef-13e4-4dbb-b6b0-dbaf75fdc177 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:18.010646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6acef-13e4-4dbb-b6b0-dbaf75fdc177 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:18.010646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 451/892] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:18.012279 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6acef-13e4-4dbb-b6b0-dbaf75fdc177 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:18.034184 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:18.064398 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5449d0e-6d0d-4106-9e75-2a3161847c10 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:18.068028 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:18.110883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ba193-b630-462e-9e8c-cff5f7c67a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:18.111530 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ba193-b630-462e-9e8c-cff5f7c67a5b None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:18.111806 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ba193-b630-462e-9e8c-cff5f7c67a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:18.112074 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ba193-b630-462e-9e8c-cff5f7c67a5b None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:18.112707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ba193-b630-462e-9e8c-cff5f7c67a5b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:18.113007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ba193-b630-462e-9e8c-cff5f7c67a5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:18.114375 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ba193-b630-462e-9e8c-cff5f7c67a5b None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:18.120081 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 442/893] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Sep 6 20:07:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:18.121553 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaf3ee-5c08-461f-93f8-3788fa2fb626 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:18.121920 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaf3ee-5c08-461f-93f8-3788fa2fb626 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:18.122214 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaf3ee-5c08-461f-93f8-3788fa2fb626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:18.145671 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-17aaf3ee-5c08-461f-93f8-3788fa2fb626 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:18.146983 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-17aaf3ee-5c08-461f-93f8-3788fa2fb626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:18.164053 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6acef-13e4-4dbb-b6b0-dbaf75fdc177 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:18.211457 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85206fde-bdf6-46c0-b808-b598f4e34300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:18.212074 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85206fde-bdf6-46c0-b808-b598f4e34300 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:18.212346 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85206fde-bdf6-46c0-b808-b598f4e34300 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:18.212609 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85206fde-bdf6-46c0-b808-b598f4e34300 None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:18.213337 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85206fde-bdf6-46c0-b808-b598f4e34300 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:18.213638 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85206fde-bdf6-46c0-b808-b598f4e34300 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:18.215084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85206fde-bdf6-46c0-b808-b598f4e34300 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:18.246982 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 452/894] 10.222.0.77 () {56 vars in 1149 bytes} [Tue Sep 6 20:07:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:18.247184 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 443/895] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:18 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:07:18.247267 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85206fde-bdf6-46c0-b808-b598f4e34300 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:18.247369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aaf3ee-5c08-461f-93f8-3788fa2fb626 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:18.353924 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:18.368187 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:18.372470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aaf3ee-5c08-461f-93f8-3788fa2fb626 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:18.401270 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85206fde-bdf6-46c0-b808-b598f4e34300 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:18.414730 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372399d-6e70-4add-8a13-dcb554b1fc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:18.415349 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372399d-6e70-4add-8a13-dcb554b1fc21 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:18.415669 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372399d-6e70-4add-8a13-dcb554b1fc21 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:18.416259 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372399d-6e70-4add-8a13-dcb554b1fc21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:18.447711 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc0b30-b4ea-49cb-adce-8ef813a362d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:18.448599 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc0b30-b4ea-49cb-adce-8ef813a362d6 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:18.449216 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc0b30-b4ea-49cb-adce-8ef813a362d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:18.450024 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc0b30-b4ea-49cb-adce-8ef813a362d6 None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:18.451102 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc0b30-b4ea-49cb-adce-8ef813a362d6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:18.451684 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc0b30-b4ea-49cb-adce-8ef813a362d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:18.453977 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc0b30-b4ea-49cb-adce-8ef813a362d6 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:18.499681 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372399d-6e70-4add-8a13-dcb554b1fc21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:18.501134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372399d-6e70-4add-8a13-dcb554b1fc21 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:18.538405 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 453/896] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Sep 6 20:07:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:18.539558 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc0b30-b4ea-49cb-adce-8ef813a362d6 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:18.603472 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:18.614819 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 444/897] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:07:18 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 06 20:07:18.614819 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372399d-6e70-4add-8a13-dcb554b1fc21 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:18.648309 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc0b30-b4ea-49cb-adce-8ef813a362d6 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:18.678935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:18.683828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b487af1-a6de-4e02-8f9d-9fb7db3c0eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:18.684437 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b487af1-a6de-4e02-8f9d-9fb7db3c0eb7 None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:18.684714 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b487af1-a6de-4e02-8f9d-9fb7db3c0eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:18.684985 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b487af1-a6de-4e02-8f9d-9fb7db3c0eb7 None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:18.685641 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b487af1-a6de-4e02-8f9d-9fb7db3c0eb7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:18.687027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b487af1-a6de-4e02-8f9d-9fb7db3c0eb7 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:18.712608 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372399d-6e70-4add-8a13-dcb554b1fc21 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:18.748411 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832137ee-2668-4a4d-acaa-e2b1c5015330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:18.749583 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832137ee-2668-4a4d-acaa-e2b1c5015330 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:18.749583 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832137ee-2668-4a4d-acaa-e2b1c5015330 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:18.749789 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832137ee-2668-4a4d-acaa-e2b1c5015330 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:18.751081 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832137ee-2668-4a4d-acaa-e2b1c5015330 None admin] RBAC: Adding query filter params (interface=public, service_id=f3ee6899a0e547b282fd6d37c34468e0, region_id=RegionOne) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:18.751081 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832137ee-2668-4a4d-acaa-e2b1c5015330 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:18.752277 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832137ee-2668-4a4d-acaa-e2b1c5015330 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:18.758206 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 445/898] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Sep 6 20:07:18 2022] GET /identity/v3/endpoints?service_id=f3ee6899a0e547b282fd6d37c34468e0&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:18.759457 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6879bf5-7d3b-41f3-8f6f-be9810cfed3e None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:18.759731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6879bf5-7d3b-41f3-8f6f-be9810cfed3e None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:18.760001 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6879bf5-7d3b-41f3-8f6f-be9810cfed3e None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:18.761228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 446/899] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:18.761935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6879bf5-7d3b-41f3-8f6f-be9810cfed3e None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:18.771529 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 454/900] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Sep 6 20:07:18 2022] POST /identity/v3/services => generated 241 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:07:18.771529 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b487af1-a6de-4e02-8f9d-9fb7db3c0eb7 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:18.869209 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:18.916352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b487af1-a6de-4e02-8f9d-9fb7db3c0eb7 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:18.918321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6879bf5-7d3b-41f3-8f6f-be9810cfed3e None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:18.956655 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed91194-1c02-4f30-85bb-cd95315bdc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:18.957334 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed91194-1c02-4f30-85bb-cd95315bdc11 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:18.957959 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed91194-1c02-4f30-85bb-cd95315bdc11 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:18.958095 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed91194-1c02-4f30-85bb-cd95315bdc11 None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:18.958764 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed91194-1c02-4f30-85bb-cd95315bdc11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:18.960207 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed91194-1c02-4f30-85bb-cd95315bdc11 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:18.965305 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cbff4-0eab-48c7-908e-cb4e6f47020d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:18.965942 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cbff4-0eab-48c7-908e-cb4e6f47020d None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:18.966304 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cbff4-0eab-48c7-908e-cb4e6f47020d None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:18.966541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cbff4-0eab-48c7-908e-cb4e6f47020d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:18.967638 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 455/901] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Sep 6 20:07:18 2022] GET /identity/v3/services => generated 1497 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:07:18.970129 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d5c3e-f553-4955-948a-155148843826 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:18.970129 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d5c3e-f553-4955-948a-155148843826 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:18.970350 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d5c3e-f553-4955-948a-155148843826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:18.983595 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cbff4-0eab-48c7-908e-cb4e6f47020d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:18.986011 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cbff4-0eab-48c7-908e-cb4e6f47020d None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:18.993437 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-ee9d5c3e-f553-4955-948a-155148843826 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:18.993437 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ee9d5c3e-f553-4955-948a-155148843826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:19.012045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-b69cbff4-0eab-48c7-908e-cb4e6f47020d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:19.012045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:19.012045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:19.012045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:19.012045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:19.012045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:19.012045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:19.012045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:19.012045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:19.012045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:19.012045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:19.012045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:19.012045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:07:19.012045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:07:19.012045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:07:19.012045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:07:19.013104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:19.013104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:19.013104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:19.013104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:19.013104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:19.013104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:19.013104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:19.013104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:19.013104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:19.013104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:19.013104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:19.013104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:19.013104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:19.013104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:19.013104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:19.013104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:19.013104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:07:19.014528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:07:19.014528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:19.014528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:19.016583 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 447/902] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:19.022689 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cbff4-0eab-48c7-908e-cb4e6f47020d None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:19.060163 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:19.085623 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 456/903] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:07:19.148989 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cbff4-0eab-48c7-908e-cb4e6f47020d None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:19.167777 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:19.189927 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82889628-966c-40ec-99f2-b9660b9cf348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:19.190550 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82889628-966c-40ec-99f2-b9660b9cf348 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:19.190831 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82889628-966c-40ec-99f2-b9660b9cf348 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:19.191113 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82889628-966c-40ec-99f2-b9660b9cf348 None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:19.191800 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82889628-966c-40ec-99f2-b9660b9cf348 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:19.192107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82889628-966c-40ec-99f2-b9660b9cf348 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:19.193531 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82889628-966c-40ec-99f2-b9660b9cf348 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:19.209722 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 448/904] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:19.217006 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d5c3e-f553-4955-948a-155148843826 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:19.333989 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d5c3e-f553-4955-948a-155148843826 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:19.373989 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db098e4-1546-4307-8bcd-ab9ee89d2781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:19.375069 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db098e4-1546-4307-8bcd-ab9ee89d2781 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:19.375541 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db098e4-1546-4307-8bcd-ab9ee89d2781 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:19.375961 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db098e4-1546-4307-8bcd-ab9ee89d2781 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:19.383085 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82889628-966c-40ec-99f2-b9660b9cf348 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:19.384825 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db098e4-1546-4307-8bcd-ab9ee89d2781 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:19.386739 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db098e4-1546-4307-8bcd-ab9ee89d2781 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:19.404203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-0db098e4-1546-4307-8bcd-ab9ee89d2781 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:19.404203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:19.404203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:19.404203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:19.404203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:19.404203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:19.404203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:19.404203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:19.404203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:19.404203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:19.404203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:19.404203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:19.404203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:07:19.404203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:07:19.404203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:07:19.405880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:07:19.405880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:19.405880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:19.405880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:19.405880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:19.405880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:19.405880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:19.405880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:19.405880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:19.405880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:19.405880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:19.405880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:19.405880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:19.405880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:19.405880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:19.405880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:19.405880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:19.406987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:07:19.406987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:07:19.406987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:07:19.406987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:07:19.406987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:07:19.406987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:07:19.406987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:19.406987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:19.409614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 457/905] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:07:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:19.418022 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db098e4-1546-4307-8bcd-ab9ee89d2781 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:19.468804 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:19.533072 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db098e4-1546-4307-8bcd-ab9ee89d2781 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:19.537441 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82889628-966c-40ec-99f2-b9660b9cf348 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:19.576233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6b62f-e4e5-4fa2-9145-032abb2ccffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:19.577482 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6b62f-e4e5-4fa2-9145-032abb2ccffc None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:19.577907 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6b62f-e4e5-4fa2-9145-032abb2ccffc None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:19.578305 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6b62f-e4e5-4fa2-9145-032abb2ccffc None admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:19.579113 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6b62f-e4e5-4fa2-9145-032abb2ccffc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:19.579570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6b62f-e4e5-4fa2-9145-032abb2ccffc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:19.581277 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6b62f-e4e5-4fa2-9145-032abb2ccffc None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:19.595795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67462b43-bea0-4bce-bf31-e9ba8908e721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:19.596731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67462b43-bea0-4bce-bf31-e9ba8908e721 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:19.601833 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67462b43-bea0-4bce-bf31-e9ba8908e721 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:19.601977 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 458/906] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:07:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:19.602059 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67462b43-bea0-4bce-bf31-e9ba8908e721 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:19.602059 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67462b43-bea0-4bce-bf31-e9ba8908e721 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:19.602187 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67462b43-bea0-4bce-bf31-e9ba8908e721 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:19.603660 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6b62f-e4e5-4fa2-9145-032abb2ccffc None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:19.615743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-67462b43-bea0-4bce-bf31-e9ba8908e721 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 20:07:19.615743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:19.615743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 20:07:19.615743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 20:07:19.615743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 20:07:19.615743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 20:07:19.615743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 20:07:19.615743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:19.615743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 20:07:19.615743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:19.615743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:07:19.615743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:19.615743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:19.615743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:19.615743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:19.615743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:19.616780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:19.616780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:19.616780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:19.616780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:19.616780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:19.616780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:19.616780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:19.616780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 20:07:19.616780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 20:07:19.616780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 20:07:19.616780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 20:07:19.616780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:19.616780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:19.616780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:19.616780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:19.616780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:19.616780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:19.617651 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:19.617651 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:19.617651 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:19.617651 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:19.617651 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:19.617651 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:19.617651 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:19.617651 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:19.617651 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:19.617651 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:19.617651 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 20:07:19.617651 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:19.617651 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 20:07:19.617651 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:19.620673 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 449/907] 10.222.0.77 () {56 vars in 1132 bytes} [Tue Sep 6 20:07:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:07:19.627728 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67462b43-bea0-4bce-bf31-e9ba8908e721 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:19.676921 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:19.743419 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67462b43-bea0-4bce-bf31-e9ba8908e721 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:19.754431 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6b62f-e4e5-4fa2-9145-032abb2ccffc None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:19.756597 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:19.795843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6011a6-696e-42db-a5dd-ce75a0ccc816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:19.796532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6011a6-696e-42db-a5dd-ce75a0ccc816 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:19.796825 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6011a6-696e-42db-a5dd-ce75a0ccc816 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:19.797089 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6011a6-696e-42db-a5dd-ce75a0ccc816 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:19.797832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6011a6-696e-42db-a5dd-ce75a0ccc816 None admin] RBAC: Adding query filter params (role.id=82691a07001644e48564ddf52dcdfb89, scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343, user.id=c314372147b2491cb4481d538056472c) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:19.798144 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6011a6-696e-42db-a5dd-ce75a0ccc816 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:19.799907 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6011a6-696e-42db-a5dd-ce75a0ccc816 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:19.800527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e341da-c19d-4f47-8512-9086caf1d4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:19.801371 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e341da-c19d-4f47-8512-9086caf1d4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:19.802196 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e341da-c19d-4f47-8512-9086caf1d4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:19.802693 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e341da-c19d-4f47-8512-9086caf1d4c5 None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:19.804181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e341da-c19d-4f47-8512-9086caf1d4c5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:19.804942 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e341da-c19d-4f47-8512-9086caf1d4c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:19.811537 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 459/908] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:07:19 2022] GET /identity/v3/role_assignments?user.id=c314372147b2491cb4481d538056472c&scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343&role.id=82691a07001644e48564ddf52dcdfb89 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:19.811747 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e341da-c19d-4f47-8512-9086caf1d4c5 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:19.826424 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 450/909] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Sep 6 20:07:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:19.828422 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6011a6-696e-42db-a5dd-ce75a0ccc816 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:19.950187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6011a6-696e-42db-a5dd-ce75a0ccc816 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:19.994473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b0b05-bd6d-44ef-a607-1a0912a5b676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:19.995547 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b0b05-bd6d-44ef-a607-1a0912a5b676 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:19.996036 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b0b05-bd6d-44ef-a607-1a0912a5b676 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:19.996515 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b0b05-bd6d-44ef-a607-1a0912a5b676 None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:19.997413 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b0b05-bd6d-44ef-a607-1a0912a5b676 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:19.997952 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b0b05-bd6d-44ef-a607-1a0912a5b676 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:20.000212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b0b05-bd6d-44ef-a607-1a0912a5b676 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:20.007235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 460/910] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Sep 6 20:07:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:20.016375 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e341da-c19d-4f47-8512-9086caf1d4c5 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:20.136109 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e341da-c19d-4f47-8512-9086caf1d4c5 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:20.138122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:20.174326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce973fa1-81c1-4915-ac85-e8a417b6d416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:20.176075 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce973fa1-81c1-4915-ac85-e8a417b6d416 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:20.176356 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce973fa1-81c1-4915-ac85-e8a417b6d416 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:20.176630 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce973fa1-81c1-4915-ac85-e8a417b6d416 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:20.177334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce973fa1-81c1-4915-ac85-e8a417b6d416 None admin] RBAC: Adding query filter params (interface=public, service_id=97016d0e30cd4e5fa3d864d9549fa64a, region_id=RegionOne) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:20.177642 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce973fa1-81c1-4915-ac85-e8a417b6d416 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:20.179017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce973fa1-81c1-4915-ac85-e8a417b6d416 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:20.185037 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 451/911] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Sep 6 20:07:20 2022] GET /identity/v3/endpoints?service_id=97016d0e30cd4e5fa3d864d9549fa64a&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:20.190995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b0b05-bd6d-44ef-a607-1a0912a5b676 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:20.225196 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:20.301759 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b0b05-bd6d-44ef-a607-1a0912a5b676 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:20.339705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c51eb-bf7e-40c3-95a6-c8f9ef0ebe91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:20.340765 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c51eb-bf7e-40c3-95a6-c8f9ef0ebe91 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:20.341293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c51eb-bf7e-40c3-95a6-c8f9ef0ebe91 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:20.341771 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c51eb-bf7e-40c3-95a6-c8f9ef0ebe91 None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:20.343109 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c51eb-bf7e-40c3-95a6-c8f9ef0ebe91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:20.344733 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c51eb-bf7e-40c3-95a6-c8f9ef0ebe91 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:20.358599 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 461/912] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Sep 6 20:07:20 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:07:21.079769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d54ec0-dc8e-4dc7-b97e-2cb5af90a45e None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:21.080082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d54ec0-dc8e-4dc7-b97e-2cb5af90a45e None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:21.080263 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d54ec0-dc8e-4dc7-b97e-2cb5af90a45e None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:21.081758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 452/913] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:21.087703 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cdd74-9fb6-46a7-9aa8-19051bab5b3a None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:21.088639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cdd74-9fb6-46a7-9aa8-19051bab5b3a None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:21.089164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cdd74-9fb6-46a7-9aa8-19051bab5b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:21.108194 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-2b6cdd74-9fb6-46a7-9aa8-19051bab5b3a None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:21.109819 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-2b6cdd74-9fb6-46a7-9aa8-19051bab5b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:21.183244 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 462/914] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:07:21.308095 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31139046-3b91-445a-829e-300198d1a4b9 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:21.309104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31139046-3b91-445a-829e-300198d1a4b9 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:21.309636 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31139046-3b91-445a-829e-300198d1a4b9 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:21.312370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 453/915] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:21.318051 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e3ad1-d139-41e4-8c8c-53c135f56203 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:21.318356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e3ad1-d139-41e4-8c8c-53c135f56203 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:21.318635 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e3ad1-d139-41e4-8c8c-53c135f56203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:21.338489 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-2b1e3ad1-d139-41e4-8c8c-53c135f56203 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:21.339708 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-2b1e3ad1-d139-41e4-8c8c-53c135f56203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:21.358719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:21.413526 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 463/916] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 20:07:21.467921 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31139046-3b91-445a-829e-300198d1a4b9 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:21.580541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31139046-3b91-445a-829e-300198d1a4b9 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:21.616966 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee8422-d94b-45ba-9001-bb6857042a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:21.617933 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee8422-d94b-45ba-9001-bb6857042a9b None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:21.618416 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee8422-d94b-45ba-9001-bb6857042a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:21.618887 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee8422-d94b-45ba-9001-bb6857042a9b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:21.619715 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee8422-d94b-45ba-9001-bb6857042a9b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:21.621313 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee8422-d94b-45ba-9001-bb6857042a9b None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:21.631495 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-45ee8422-d94b-45ba-9001-bb6857042a9b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 20:07:21.631495 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:21.631495 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 20:07:21.631495 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 20:07:21.631495 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 20:07:21.631495 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 20:07:21.631495 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 20:07:21.631495 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:21.631495 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 20:07:21.631495 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:21.631495 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:07:21.631495 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:21.631495 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:21.631495 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:21.631495 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:21.631495 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:21.631495 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:21.632522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:21.632522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:21.632522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:21.632522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:21.632522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:21.632522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:21.632522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 20:07:21.632522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 20:07:21.632522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 20:07:21.632522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 20:07:21.632522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:21.632522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:21.632522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:21.632522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:21.632522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:21.632522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:21.633375 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:21.633375 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:21.633375 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:21.633375 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:21.633375 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:21.633375 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:21.633375 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:21.633375 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:21.633375 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:21.633375 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:21.633375 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 20:07:21.633375 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:21.633375 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 20:07:21.633375 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:21.636136 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 454/917] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Sep 6 20:07:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:21.642302 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e3ad1-d139-41e4-8c8c-53c135f56203 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:21.691956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee8422-d94b-45ba-9001-bb6857042a9b None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:21.728162 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:21.773304 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e3ad1-d139-41e4-8c8c-53c135f56203 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:21.823459 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee8422-d94b-45ba-9001-bb6857042a9b None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:21.834681 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e624c6-6711-4522-8ae6-a4ae015b1e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:21.836795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e624c6-6711-4522-8ae6-a4ae015b1e9a None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:21.837301 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e624c6-6711-4522-8ae6-a4ae015b1e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:21.838198 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e624c6-6711-4522-8ae6-a4ae015b1e9a None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:21.839337 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e624c6-6711-4522-8ae6-a4ae015b1e9a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:21.839856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e624c6-6711-4522-8ae6-a4ae015b1e9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:21.841692 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e624c6-6711-4522-8ae6-a4ae015b1e9a None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:21.854784 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 464/918] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Sep 6 20:07:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:21.855262 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e624c6-6711-4522-8ae6-a4ae015b1e9a None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:21.873190 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784619b4-a5df-41de-8282-ac918d601666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:21.873792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784619b4-a5df-41de-8282-ac918d601666 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:21.874072 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784619b4-a5df-41de-8282-ac918d601666 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:21.874397 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784619b4-a5df-41de-8282-ac918d601666 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:21.875544 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784619b4-a5df-41de-8282-ac918d601666 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:21.878309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784619b4-a5df-41de-8282-ac918d601666 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:21.885545 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:21.889038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-784619b4-a5df-41de-8282-ac918d601666 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 20:07:21.889038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:21.889038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 20:07:21.889038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 20:07:21.889038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 20:07:21.889038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 20:07:21.889038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 20:07:21.889038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:21.889038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 20:07:21.889038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:21.889038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:07:21.889038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:21.889038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:21.889038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:21.889038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:21.889038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:21.889038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:21.890020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:21.890020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:21.890020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:21.890020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:21.890020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:21.890020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:21.890020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 20:07:21.890020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 20:07:21.890020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 20:07:21.890020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 20:07:21.890020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:21.890020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:21.890020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:21.890020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:21.890020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:21.890020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:21.890862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:21.890862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:21.890862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:21.890862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:21.890862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:21.890862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:21.890862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:21.890862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:21.890862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:21.890862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:21.890862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 20:07:21.890862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:21.890862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 20:07:21.890862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:21.895563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 455/919] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Sep 6 20:07:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:07:21.896476 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784619b4-a5df-41de-8282-ac918d601666 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:21.998441 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e624c6-6711-4522-8ae6-a4ae015b1e9a None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:22.017435 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:22.025009 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784619b4-a5df-41de-8282-ac918d601666 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:22.036676 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b573c51-0f05-42b7-a434-03772712f289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:22.037699 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b573c51-0f05-42b7-a434-03772712f289 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:22.038341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b573c51-0f05-42b7-a434-03772712f289 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:22.038904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b573c51-0f05-42b7-a434-03772712f289 None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:22.039779 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b573c51-0f05-42b7-a434-03772712f289 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:22.040318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b573c51-0f05-42b7-a434-03772712f289 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:22.041897 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b573c51-0f05-42b7-a434-03772712f289 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:22.047904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 465/920] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Sep 6 20:07:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:22.055042 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b573c51-0f05-42b7-a434-03772712f289 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:22.071732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32329d1e-c7ec-42ef-9f53-fede8e9b3d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:22.072376 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32329d1e-c7ec-42ef-9f53-fede8e9b3d3a None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:22.072656 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32329d1e-c7ec-42ef-9f53-fede8e9b3d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:22.072922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32329d1e-c7ec-42ef-9f53-fede8e9b3d3a None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:22.073583 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32329d1e-c7ec-42ef-9f53-fede8e9b3d3a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:22.073886 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32329d1e-c7ec-42ef-9f53-fede8e9b3d3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:22.076244 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32329d1e-c7ec-42ef-9f53-fede8e9b3d3a None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:22.087651 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 456/921] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Sep 6 20:07:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:22.090253 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32329d1e-c7ec-42ef-9f53-fede8e9b3d3a None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:22.170483 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:22.196289 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b573c51-0f05-42b7-a434-03772712f289 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:22.221189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32329d1e-c7ec-42ef-9f53-fede8e9b3d3a None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:22.235835 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45afda-b91f-4582-ad41-a1b196f23c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:22.236446 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45afda-b91f-4582-ad41-a1b196f23c72 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:22.237049 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45afda-b91f-4582-ad41-a1b196f23c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:22.237049 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45afda-b91f-4582-ad41-a1b196f23c72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:22.237671 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45afda-b91f-4582-ad41-a1b196f23c72 None admin] RBAC: Adding query filter params (interface=public, service_id=f9ec1ac9840e476281ebdaac59842fca, region_id=RegionOne) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:22.238055 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45afda-b91f-4582-ad41-a1b196f23c72 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:22.239343 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45afda-b91f-4582-ad41-a1b196f23c72 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:22.244946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 466/922] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Sep 6 20:07:22 2022] GET /identity/v3/endpoints?service_id=f9ec1ac9840e476281ebdaac59842fca&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:22.248792 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628677b2-2a09-424c-8197-bfb365bf7df6 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:22.249072 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628677b2-2a09-424c-8197-bfb365bf7df6 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:22.249346 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628677b2-2a09-424c-8197-bfb365bf7df6 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:22.250634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 467/923] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:22.251336 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628677b2-2a09-424c-8197-bfb365bf7df6 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:22.263242 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe1827-bbcf-4e80-a83b-21c4b64870b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:22.264485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe1827-bbcf-4e80-a83b-21c4b64870b6 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:22.264697 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe1827-bbcf-4e80-a83b-21c4b64870b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:22.264967 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe1827-bbcf-4e80-a83b-21c4b64870b6 None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:22.265593 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe1827-bbcf-4e80-a83b-21c4b64870b6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:22.265895 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe1827-bbcf-4e80-a83b-21c4b64870b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:22.267329 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe1827-bbcf-4e80-a83b-21c4b64870b6 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:22.275650 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 457/924] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Sep 6 20:07:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:22.275650 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd867f-5590-4e7f-8676-87f4d93a993b None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:22.275650 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd867f-5590-4e7f-8676-87f4d93a993b None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:22.275650 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd867f-5590-4e7f-8676-87f4d93a993b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:22.295840 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-57bd867f-5590-4e7f-8676-87f4d93a993b None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:22.297875 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-57bd867f-5590-4e7f-8676-87f4d93a993b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:22.316133 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:22.372622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 458/925] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:07:22.373716 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd867f-5590-4e7f-8676-87f4d93a993b None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:22.385590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628677b2-2a09-424c-8197-bfb365bf7df6 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:22.431872 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205a9f7-3a2c-4dd7-8e12-e6acf4779a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:22.433694 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205a9f7-3a2c-4dd7-8e12-e6acf4779a85 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:22.433969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205a9f7-3a2c-4dd7-8e12-e6acf4779a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:22.434241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205a9f7-3a2c-4dd7-8e12-e6acf4779a85 None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:22.434849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205a9f7-3a2c-4dd7-8e12-e6acf4779a85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:22.436767 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205a9f7-3a2c-4dd7-8e12-e6acf4779a85 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:22.443947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 468/926] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Sep 6 20:07:22 2022] GET /identity/v3/services => generated 1497 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:07:22.504753 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd867f-5590-4e7f-8676-87f4d93a993b None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:22.546585 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e88225-6ca7-41d9-93c5-7362036da3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:22.547547 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e88225-6ca7-41d9-93c5-7362036da3cd None admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:22.548022 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e88225-6ca7-41d9-93c5-7362036da3cd None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:22.548457 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e88225-6ca7-41d9-93c5-7362036da3cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:22.549392 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e88225-6ca7-41d9-93c5-7362036da3cd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:22.551064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e88225-6ca7-41d9-93c5-7362036da3cd None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:22.631472 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 459/927] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:07:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:07:22.677042 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bf9ec-1033-4a81-a6cb-244939acdc54 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:22.677477 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bf9ec-1033-4a81-a6cb-244939acdc54 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:22.677853 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bf9ec-1033-4a81-a6cb-244939acdc54 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:22.679573 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 469/928] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:22.686470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c48c52-8517-4d18-af4c-3addfb66ec3f None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:22.686710 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c48c52-8517-4d18-af4c-3addfb66ec3f None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:22.687006 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c48c52-8517-4d18-af4c-3addfb66ec3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:22.688289 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bf9ec-1033-4a81-a6cb-244939acdc54 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:22.705210 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:22.707383 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-73c48c52-8517-4d18-af4c-3addfb66ec3f None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:22.708685 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-73c48c52-8517-4d18-af4c-3addfb66ec3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:22.710986 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:22.807591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 460/929] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:07:22.835925 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bf9ec-1033-4a81-a6cb-244939acdc54 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:22.877817 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6aab7-3495-4468-9fc0-04ab69653cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:22.878458 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6aab7-3495-4468-9fc0-04ab69653cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:22.878733 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6aab7-3495-4468-9fc0-04ab69653cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:22.879008 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6aab7-3495-4468-9fc0-04ab69653cc7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:22.892251 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6aab7-3495-4468-9fc0-04ab69653cc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:07:22.898190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-49c6aab7-3495-4468-9fc0-04ab69653cc7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 20:07:22.898190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:22.898190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:22.898190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:22.898190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:22.898190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:22.898190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:22.898190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:22.898190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:22.898190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:22.898190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:22.898190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:22.898190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:07:22.898190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:07:22.898190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:07:22.898190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:07:22.899378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:07:22.899378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:07:22.899378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:07:22.899378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:07:22.899378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:22.899378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:22.899378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:22.899378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:22.899378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:22.899378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:22.899378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:22.899378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:22.899378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:22.899378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:22.899378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:22.899378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:22.900859 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:22.900859 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:22.900859 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:22.900859 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:22.900859 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:07:22.900859 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:07:22.900859 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:07:22.900859 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:07:22.900859 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:07:22.900859 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:07:22.900859 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 20:07:22.900859 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:22.900859 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 470/930] 10.222.0.77 () {56 vars in 1120 bytes} [Tue Sep 6 20:07:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:22.912663 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c48c52-8517-4d18-af4c-3addfb66ec3f None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:23.042205 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c48c52-8517-4d18-af4c-3addfb66ec3f None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:23.080995 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc78585-d693-4096-ba65-fe3e37394099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:23.081888 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc78585-d693-4096-ba65-fe3e37394099 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:23.082317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc78585-d693-4096-ba65-fe3e37394099 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:23.082739 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc78585-d693-4096-ba65-fe3e37394099 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:23.083625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc78585-d693-4096-ba65-fe3e37394099 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:23.084087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc78585-d693-4096-ba65-fe3e37394099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:23.085704 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc78585-d693-4096-ba65-fe3e37394099 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:23.087601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:23.091805 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6aab7-3495-4468-9fc0-04ab69653cc7 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:23.098156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 461/931] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Sep 6 20:07:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:23.104477 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc78585-d693-4096-ba65-fe3e37394099 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:23.173008 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:23.208782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6aab7-3495-4468-9fc0-04ab69653cc7 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:23.217013 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc78585-d693-4096-ba65-fe3e37394099 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:23.271627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c8a23-018c-4e1e-8d55-3ff94e430850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:23.272973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c8a23-018c-4e1e-8d55-3ff94e430850 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:23.272973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c8a23-018c-4e1e-8d55-3ff94e430850 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:23.273402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c8a23-018c-4e1e-8d55-3ff94e430850 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:23.274314 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c8a23-018c-4e1e-8d55-3ff94e430850 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:23.275207 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ac25b-29f8-457c-9cb9-fa857a0acbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:23.275887 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ac25b-29f8-457c-9cb9-fa857a0acbb5 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:23.276165 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ac25b-29f8-457c-9cb9-fa857a0acbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:23.276433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ac25b-29f8-457c-9cb9-fa857a0acbb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:23.276634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c8a23-018c-4e1e-8d55-3ff94e430850 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:23.291428 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ac25b-29f8-457c-9cb9-fa857a0acbb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:23.293023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ac25b-29f8-457c-9cb9-fa857a0acbb5 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:23.297747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-d01c8a23-018c-4e1e-8d55-3ff94e430850 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 20:07:23.297747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:23.297747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 20:07:23.297747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 20:07:23.297747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 20:07:23.297747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 20:07:23.297747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 20:07:23.297747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:23.297747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 20:07:23.297747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:23.297747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:07:23.297747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:23.297747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:23.297747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:23.297747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:23.297747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:23.298753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:23.298753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:23.298753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:23.298753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:23.298753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:23.298753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:23.298753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:23.298753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 20:07:23.298753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 20:07:23.298753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 20:07:23.298753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 20:07:23.298753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:23.298753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:23.298753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:23.298753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:23.298753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:23.298753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:23.299713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:23.299713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:23.299713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:23.299713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:23.299713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:23.299713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:23.299713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:23.299713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:23.299713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:23.299713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:23.299713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 20:07:23.299713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:23.299713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 20:07:23.299713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:23.303645 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 471/932] 10.222.0.77 () {56 vars in 1132 bytes} [Tue Sep 6 20:07:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:23.308799 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c8a23-018c-4e1e-8d55-3ff94e430850 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:23.317317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-874ac25b-29f8-457c-9cb9-fa857a0acbb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:23.317317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:23.317317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:23.317317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:23.317317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:23.317317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:23.317317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:23.317317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:23.317317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:23.317317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:23.317317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:23.317317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:23.317317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:07:23.317317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:07:23.317317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:07:23.317317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:07:23.318641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:23.318641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:23.318641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:23.318641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:23.318641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:23.318641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:23.318641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:23.318641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:23.318641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:23.318641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:23.318641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:23.318641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:23.318641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:23.318641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:23.318641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:23.318641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:23.318641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:07:23.319962 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:07:23.319962 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:23.319962 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:23.321854 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 462/933] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:23.331724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ac25b-29f8-457c-9cb9-fa857a0acbb5 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:23.385282 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:23.442769 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c8a23-018c-4e1e-8d55-3ff94e430850 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:23.445072 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ac25b-29f8-457c-9cb9-fa857a0acbb5 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:23.485718 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ddea0-b022-41e6-bfea-43cbcd3b758c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:23.486367 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ddea0-b022-41e6-bfea-43cbcd3b758c None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:23.486655 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ddea0-b022-41e6-bfea-43cbcd3b758c None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:23.486946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ddea0-b022-41e6-bfea-43cbcd3b758c None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:23.487702 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ddea0-b022-41e6-bfea-43cbcd3b758c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:23.488005 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ddea0-b022-41e6-bfea-43cbcd3b758c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:23.488669 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5904f-37c1-4e9a-9e41-ddaaebf748dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:23.489397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ddea0-b022-41e6-bfea-43cbcd3b758c None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:23.489644 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5904f-37c1-4e9a-9e41-ddaaebf748dd None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:23.490085 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5904f-37c1-4e9a-9e41-ddaaebf748dd None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:23.490880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:23.491057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5904f-37c1-4e9a-9e41-ddaaebf748dd None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:23.492731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5904f-37c1-4e9a-9e41-ddaaebf748dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:23.493197 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5904f-37c1-4e9a-9e41-ddaaebf748dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:23.494758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5904f-37c1-4e9a-9e41-ddaaebf748dd None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:23.495625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 472/934] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Sep 6 20:07:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:23.508205 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ddea0-b022-41e6-bfea-43cbcd3b758c None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:23.514552 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 463/935] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:23.516494 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5904f-37c1-4e9a-9e41-ddaaebf748dd None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:23.634852 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5904f-37c1-4e9a-9e41-ddaaebf748dd None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:23.645600 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ddea0-b022-41e6-bfea-43cbcd3b758c None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:23.647247 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:23.682429 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348aaae0-aed2-4f3f-8255-a3495bb9b215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:23.683727 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348aaae0-aed2-4f3f-8255-a3495bb9b215 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:23.684678 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348aaae0-aed2-4f3f-8255-a3495bb9b215 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:23.685300 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348aaae0-aed2-4f3f-8255-a3495bb9b215 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:23.693152 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ea0d7-46a8-4f06-b2df-7d6fcf26a4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:23.693868 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ea0d7-46a8-4f06-b2df-7d6fcf26a4ee None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:23.694222 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ea0d7-46a8-4f06-b2df-7d6fcf26a4ee None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:23.694555 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ea0d7-46a8-4f06-b2df-7d6fcf26a4ee None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:23.695271 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ea0d7-46a8-4f06-b2df-7d6fcf26a4ee None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:23.695682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ea0d7-46a8-4f06-b2df-7d6fcf26a4ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:23.696665 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348aaae0-aed2-4f3f-8255-a3495bb9b215 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:23.697298 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ea0d7-46a8-4f06-b2df-7d6fcf26a4ee None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:23.698547 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348aaae0-aed2-4f3f-8255-a3495bb9b215 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:23.709392 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 473/936] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Sep 6 20:07:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:23.710956 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ea0d7-46a8-4f06-b2df-7d6fcf26a4ee None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:23.715902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-348aaae0-aed2-4f3f-8255-a3495bb9b215 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 20:07:23.715902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:23.715902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:23.715902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:23.715902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:23.715902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:23.715902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:23.715902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:23.715902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:23.715902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:23.715902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:23.715902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:23.715902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:07:23.715902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:07:23.715902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:07:23.715902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:07:23.716862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:23.716862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:23.716862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:07:23.716862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:23.716862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:07:23.716862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:23.716862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:23.716862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:23.716862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:23.716862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:23.716862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:23.716862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:23.716862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:23.716862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:23.716862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:23.716862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:23.716862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:23.716862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:23.718354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:23.718354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:23.718354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:07:23.718354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:07:23.718354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:07:23.718354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:07:23.718354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:07:23.718354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:07:23.718354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 20:07:23.718354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:23.725580 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 464/937] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Sep 6 20:07:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:23.726080 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348aaae0-aed2-4f3f-8255-a3495bb9b215 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:23.788155 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:23.835562 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ea0d7-46a8-4f06-b2df-7d6fcf26a4ee None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:23.864331 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348aaae0-aed2-4f3f-8255-a3495bb9b215 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:23.883071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad91ae-55fd-4e7c-ad57-477743822aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:23.883744 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad91ae-55fd-4e7c-ad57-477743822aa7 None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:23.884255 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad91ae-55fd-4e7c-ad57-477743822aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:23.884549 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad91ae-55fd-4e7c-ad57-477743822aa7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:23.885257 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad91ae-55fd-4e7c-ad57-477743822aa7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:23.887019 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad91ae-55fd-4e7c-ad57-477743822aa7 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:23.905750 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2c3ad-58f8-495a-9855-61558bbb4a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:23.906546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2c3ad-58f8-495a-9855-61558bbb4a9a None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:23.906893 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2c3ad-58f8-495a-9855-61558bbb4a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:23.907250 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2c3ad-58f8-495a-9855-61558bbb4a9a None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:23.908078 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2c3ad-58f8-495a-9855-61558bbb4a9a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:23.908488 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2c3ad-58f8-495a-9855-61558bbb4a9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:23.909978 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2c3ad-58f8-495a-9855-61558bbb4a9a None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:23.929465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 465/938] 10.222.0.77 () {56 vars in 1149 bytes} [Tue Sep 6 20:07:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:23.939099 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2c3ad-58f8-495a-9855-61558bbb4a9a None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:23.969025 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:24.007119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 474/939] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:07:23 2022] POST /identity/v3/endpoints => generated 347 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:07:24.072063 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2c3ad-58f8-495a-9855-61558bbb4a9a None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:24.128383 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6781b-02e4-4f8e-b6e9-d4110ee4164a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:24.129156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6781b-02e4-4f8e-b6e9-d4110ee4164a None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:24.129439 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6781b-02e4-4f8e-b6e9-d4110ee4164a None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:24.129711 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6781b-02e4-4f8e-b6e9-d4110ee4164a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:24.142311 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6781b-02e4-4f8e-b6e9-d4110ee4164a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:24.143735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6781b-02e4-4f8e-b6e9-d4110ee4164a None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:24.160692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-9bb6781b-02e4-4f8e-b6e9-d4110ee4164a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:24.160692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:24.160692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:24.160692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:24.160692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:24.160692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:24.160692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:24.160692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:24.160692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:24.160692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:24.160692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:24.160692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:24.160692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:07:24.160692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:07:24.160692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:07:24.160692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:07:24.161706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:24.161706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:24.161706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:24.161706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:24.161706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:24.161706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:24.161706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:24.161706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:24.161706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:24.161706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:24.161706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:24.161706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:24.161706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:24.161706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:24.161706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:24.161706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:24.161706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:07:24.162576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:07:24.162576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:24.162576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:24.162576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 466/940] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:24.169511 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad91ae-55fd-4e7c-ad57-477743822aa7 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:24.286813 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad91ae-55fd-4e7c-ad57-477743822aa7 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:24.306187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:24.324444 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c0af5-4c4b-44a2-90fc-ea0f546a1f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:24.325067 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c0af5-4c4b-44a2-90fc-ea0f546a1f96 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:24.325351 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c0af5-4c4b-44a2-90fc-ea0f546a1f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:24.325627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c0af5-4c4b-44a2-90fc-ea0f546a1f96 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:24.326278 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c0af5-4c4b-44a2-90fc-ea0f546a1f96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:24.326614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c0af5-4c4b-44a2-90fc-ea0f546a1f96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:24.328026 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c0af5-4c4b-44a2-90fc-ea0f546a1f96 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:24.345041 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 475/941] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:24.346899 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6781b-02e4-4f8e-b6e9-d4110ee4164a None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:24.442575 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:24.470005 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6781b-02e4-4f8e-b6e9-d4110ee4164a None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:24.508394 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3e730-bbd0-4805-a150-ce2d898dc9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:24.509037 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3e730-bbd0-4805-a150-ce2d898dc9a0 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:24.509316 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3e730-bbd0-4805-a150-ce2d898dc9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:24.509589 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3e730-bbd0-4805-a150-ce2d898dc9a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:24.517163 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3e730-bbd0-4805-a150-ce2d898dc9a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:24.518694 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3e730-bbd0-4805-a150-ce2d898dc9a0 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:24.530619 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-85e3e730-bbd0-4805-a150-ce2d898dc9a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:24.530619 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:24.530619 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:24.530619 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:24.530619 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:24.530619 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:24.530619 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:24.530619 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:24.530619 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:24.530619 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:24.530619 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:24.530619 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:24.530619 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:07:24.530619 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:07:24.530619 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:07:24.531564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:07:24.531564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:24.531564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:24.531564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:24.531564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:24.531564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:24.531564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:24.531564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:24.531564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:24.531564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:24.531564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:24.531564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:24.531564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:24.531564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:24.531564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:24.531564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:24.531564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:24.532608 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:07:24.532608 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:07:24.532608 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:07:24.532608 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:07:24.532608 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:07:24.532608 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:07:24.532608 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:24.532608 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:24.532608 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 467/942] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:07:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:24.537593 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c0af5-4c4b-44a2-90fc-ea0f546a1f96 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:24.650102 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c0af5-4c4b-44a2-90fc-ea0f546a1f96 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:24.691418 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953179b2-18e9-40eb-9ffc-c75848bec127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:24.692068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953179b2-18e9-40eb-9ffc-c75848bec127 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:24.692349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953179b2-18e9-40eb-9ffc-c75848bec127 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:24.692676 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953179b2-18e9-40eb-9ffc-c75848bec127 None admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:24.693321 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953179b2-18e9-40eb-9ffc-c75848bec127 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:24.693630 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953179b2-18e9-40eb-9ffc-c75848bec127 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:24.695065 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953179b2-18e9-40eb-9ffc-c75848bec127 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:24.708085 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 476/943] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:07:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:24.716550 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3e730-bbd0-4805-a150-ce2d898dc9a0 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:24.835235 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3e730-bbd0-4805-a150-ce2d898dc9a0 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:24.874375 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ebf92-58eb-4853-9884-57a3b1be3d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:24.875519 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ebf92-58eb-4853-9884-57a3b1be3d88 None admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:24.876019 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ebf92-58eb-4853-9884-57a3b1be3d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:24.876750 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ebf92-58eb-4853-9884-57a3b1be3d88 None admin] PATH_INFO: `/v3/projects/1b4323c35aef456b90ba9f1b7eb2b343/users/c314372147b2491cb4481d538056472c/roles/82691a07001644e48564ddf52dcdfb89` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:24.879190 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ebf92-58eb-4853-9884-57a3b1be3d88 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b4323c35aef456b90ba9f1b7eb2b343, user_id=c314372147b2491cb4481d538056472c, role_id=82691a07001644e48564ddf52dcdfb89)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:24.880947 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ebf92-58eb-4853-9884-57a3b1be3d88 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:24.883728 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:24.885841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae51128-8cea-4a20-af5f-5d416f2d6051 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:24.886134 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae51128-8cea-4a20-af5f-5d416f2d6051 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:24.886414 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae51128-8cea-4a20-af5f-5d416f2d6051 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:24.888072 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 477/944] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:24.893375 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82208ca-21b1-4c37-b6e3-b16141d4b01d None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:24.893669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82208ca-21b1-4c37-b6e3-b16141d4b01d None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:24.893939 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82208ca-21b1-4c37-b6e3-b16141d4b01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:24.923479 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-d82208ca-21b1-4c37-b6e3-b16141d4b01d None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:24.924829 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-d82208ca-21b1-4c37-b6e3-b16141d4b01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:24.966900 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 468/945] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Sep 6 20:07:24 2022] PUT /identity/v3/projects/1b4323c35aef456b90ba9f1b7eb2b343/users/c314372147b2491cb4481d538056472c/roles/82691a07001644e48564ddf52dcdfb89 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:07:24.972646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:25.026425 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 478/946] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 20:07:25.080737 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334d18a-9ad5-4638-9f13-80efc9194253 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:25.081091 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334d18a-9ad5-4638-9f13-80efc9194253 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:25.081283 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334d18a-9ad5-4638-9f13-80efc9194253 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:25.082754 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 469/947] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:25.088657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b222a8-8660-4f5a-a9dd-10a6c20cbc7e None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:25.089262 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b222a8-8660-4f5a-a9dd-10a6c20cbc7e None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:25.089737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b222a8-8660-4f5a-a9dd-10a6c20cbc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:25.113784 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-70b222a8-8660-4f5a-a9dd-10a6c20cbc7e None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:25.115139 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-70b222a8-8660-4f5a-a9dd-10a6c20cbc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:25.195567 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 479/948] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:07:25.316135 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334d18a-9ad5-4638-9f13-80efc9194253 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:25.442234 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334d18a-9ad5-4638-9f13-80efc9194253 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:25.478858 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d378b21-5b67-49b7-a194-e950e8eecc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:25.479519 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d378b21-5b67-49b7-a194-e950e8eecc95 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:25.479799 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d378b21-5b67-49b7-a194-e950e8eecc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:25.480081 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d378b21-5b67-49b7-a194-e950e8eecc95 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:25.480651 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d378b21-5b67-49b7-a194-e950e8eecc95 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:25.482013 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d378b21-5b67-49b7-a194-e950e8eecc95 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:25.492626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-9d378b21-5b67-49b7-a194-e950e8eecc95 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 20:07:25.492626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:25.492626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 20:07:25.492626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 20:07:25.492626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 20:07:25.492626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 20:07:25.492626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 20:07:25.492626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:25.492626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 20:07:25.492626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:25.492626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:07:25.492626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:25.492626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:25.492626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:25.492626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:25.492626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:25.492626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:25.493648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:25.493648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:25.493648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:25.493648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:25.493648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:25.493648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:25.493648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 20:07:25.493648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 20:07:25.493648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 20:07:25.493648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 20:07:25.493648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:25.493648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:25.493648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:25.493648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:25.493648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:25.493648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:25.494485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:25.494485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:25.494485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:25.494485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:25.494485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:25.494485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:25.494485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:25.494485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:25.494485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:25.494485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:25.494485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 20:07:25.494485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:25.494485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 20:07:25.494485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:25.494485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 470/949] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Sep 6 20:07:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:25.496678 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b222a8-8660-4f5a-a9dd-10a6c20cbc7e None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:25.500831 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d378b21-5b67-49b7-a194-e950e8eecc95 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:25.567630 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:25.616820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d378b21-5b67-49b7-a194-e950e8eecc95 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:25.627704 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:25.633985 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b222a8-8660-4f5a-a9dd-10a6c20cbc7e None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:25.657581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9dea2-3135-48ca-b430-415d2463c7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:25.658206 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9dea2-3135-48ca-b430-415d2463c7dd None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:25.658484 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9dea2-3135-48ca-b430-415d2463c7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:25.658756 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9dea2-3135-48ca-b430-415d2463c7dd None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:25.659387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9dea2-3135-48ca-b430-415d2463c7dd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:25.659719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9dea2-3135-48ca-b430-415d2463c7dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:25.661088 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9dea2-3135-48ca-b430-415d2463c7dd None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:25.672967 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 471/950] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Sep 6 20:07:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:25.673884 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9dea2-3135-48ca-b430-415d2463c7dd None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:25.685113 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0e4b4-d8ed-4ded-978d-33032c32312e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:25.687311 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0e4b4-d8ed-4ded-978d-33032c32312e None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:25.687847 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0e4b4-d8ed-4ded-978d-33032c32312e None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:25.688738 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0e4b4-d8ed-4ded-978d-33032c32312e None admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:25.689935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0e4b4-d8ed-4ded-978d-33032c32312e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:25.692374 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0e4b4-d8ed-4ded-978d-33032c32312e None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:25.696312 dv-cinder-847732-4-smb devstack@keystone.service[81846]: WARNING keystone.server.flask.common [None req-6fb0e4b4-d8ed-4ded-978d-33032c32312e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 06 20:07:25.749421 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.sql.core [None req-6fb0e4b4-d8ed-4ded-978d-33032c32312e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 06 20:07:25.749421 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 06 20:07:25.749421 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [parameters: {'id': 'a22b634931f74e15abf25063d902e22b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 06 20:07:25.749421 dv-cinder-847732-4-smb devstack@keystone.service[81846]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81846) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 06 20:07:25.760652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-6fb0e4b4-d8ed-4ded-978d-33032c32312e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a22b634931f74e15abf25063d902e22b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a22b634931f74e15abf25063d902e22b. Sep 06 20:07:25.760652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:25.760652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 20:07:25.760652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 20:07:25.760652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 20:07:25.760652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 20:07:25.760652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 20:07:25.760652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 20:07:25.760652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 20:07:25.760652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application conn.query(q) Sep 06 20:07:25.760652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 20:07:25.760652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 20:07:25.760652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 20:07:25.761504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application result.read() Sep 06 20:07:25.761504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 20:07:25.761504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 20:07:25.761504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 20:07:25.761504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 20:07:25.761504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 20:07:25.761504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 20:07:25.761504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 20:07:25.761504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 20:07:25.761504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 06 20:07:25.761504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:25.761504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 06 20:07:25.761504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:25.761504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:25.761504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 06 20:07:25.761504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 06 20:07:25.761504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 06 20:07:25.761504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 06 20:07:25.762427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 20:07:25.762427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application next(self.gen) Sep 06 20:07:25.762427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 06 20:07:25.762427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application yield resource Sep 06 20:07:25.762427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 20:07:25.762427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application next(self.gen) Sep 06 20:07:25.762427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 06 20:07:25.762427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self.session.rollback() Sep 06 20:07:25.762427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 20:07:25.762427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self.force_reraise() Sep 06 20:07:25.762427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 20:07:25.762427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise self.value Sep 06 20:07:25.762427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 06 20:07:25.762427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 06 20:07:25.762427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 06 20:07:25.762427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application session.commit() Sep 06 20:07:25.762427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 06 20:07:25.763319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 06 20:07:25.763319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 06 20:07:25.763319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._prepare_impl() Sep 06 20:07:25.763319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 06 20:07:25.763319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self.session.flush() Sep 06 20:07:25.763319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 06 20:07:25.763319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._flush(objects) Sep 06 20:07:25.763319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 06 20:07:25.763319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 06 20:07:25.763319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 06 20:07:25.763319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application compat.raise_( Sep 06 20:07:25.763319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 20:07:25.763319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception Sep 06 20:07:25.763319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 06 20:07:25.763319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application flush_context.execute() Sep 06 20:07:25.763319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 06 20:07:25.763319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rec.execute(self) Sep 06 20:07:25.771078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 06 20:07:25.771078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 06 20:07:25.771078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 06 20:07:25.771078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 06 20:07:25.771078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 06 20:07:25.771078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 06 20:07:25.771078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 06 20:07:25.771078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 06 20:07:25.771078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 06 20:07:25.771078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 06 20:07:25.771078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 06 20:07:25.771078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 06 20:07:25.771078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 06 20:07:25.771078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 06 20:07:25.771078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 06 20:07:25.771990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 06 20:07:25.771990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 20:07:25.771990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception Sep 06 20:07:25.771990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 20:07:25.771990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 20:07:25.771990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 20:07:25.771990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 20:07:25.771990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 20:07:25.771990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 20:07:25.771990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 20:07:25.771990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application conn.query(q) Sep 06 20:07:25.771990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 20:07:25.771990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 20:07:25.771990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 20:07:25.771990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application result.read() Sep 06 20:07:25.771990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 20:07:25.771990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 20:07:25.773016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 20:07:25.773016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 20:07:25.773016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 20:07:25.773016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 20:07:25.773016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 20:07:25.773016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 20:07:25.773016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 06 20:07:25.773016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 06 20:07:25.773016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [parameters: {'id': 'a22b634931f74e15abf25063d902e22b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 06 20:07:25.773016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 06 20:07:25.773016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:25.773016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:07:25.773016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:25.773016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:25.773016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 06 20:07:25.773995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 06 20:07:25.773995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 06 20:07:25.773995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 06 20:07:25.773995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 06 20:07:25.773995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:25.773995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:07:25.773995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:25.773995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:25.773995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:25.773995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:25.773995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:25.773995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:25.773995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:25.773995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:25.773995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:25.773995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:25.773995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:25.775282 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:25.775282 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 06 20:07:25.775282 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 06 20:07:25.775282 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:25.775282 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:25.775282 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 06 20:07:25.775282 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 06 20:07:25.775282 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a22b634931f74e15abf25063d902e22b. Sep 06 20:07:25.775282 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:25.775282 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 480/951] 10.222.0.77 () {60 vars in 1140 bytes} [Tue Sep 6 20:07:25 2022] POST /identity/v3/projects => generated 262 bytes in 273 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:25.778301 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0e4b4-d8ed-4ded-978d-33032c32312e None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:25.803595 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9dea2-3135-48ca-b430-415d2463c7dd None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:25.831724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:25.845454 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a90947-9043-4b69-86cf-b060db3af229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:25.846434 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a90947-9043-4b69-86cf-b060db3af229 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:25.846939 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a90947-9043-4b69-86cf-b060db3af229 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:25.847382 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a90947-9043-4b69-86cf-b060db3af229 None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:25.848219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a90947-9043-4b69-86cf-b060db3af229 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:25.860857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a90947-9043-4b69-86cf-b060db3af229 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:25.860857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a90947-9043-4b69-86cf-b060db3af229 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:25.860857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 472/952] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Sep 6 20:07:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:25.862225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a90947-9043-4b69-86cf-b060db3af229 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:25.911747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0e4b4-d8ed-4ded-978d-33032c32312e None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:25.962051 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706cfa4-9f21-4a78-b076-3b64576496b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:25.962710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706cfa4-9f21-4a78-b076-3b64576496b5 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:25.962994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706cfa4-9f21-4a78-b076-3b64576496b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:25.963257 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706cfa4-9f21-4a78-b076-3b64576496b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:25.972674 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706cfa4-9f21-4a78-b076-3b64576496b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:25.974774 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706cfa4-9f21-4a78-b076-3b64576496b5 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:25.981744 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a90947-9043-4b69-86cf-b060db3af229 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:25.989800 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-8706cfa4-9f21-4a78-b076-3b64576496b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:25.989800 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:25.989800 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:25.989800 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:25.989800 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:25.989800 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:25.989800 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:25.989800 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:25.989800 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:25.989800 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:25.989800 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:25.989800 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:25.989800 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:07:25.989800 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:07:25.989800 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:07:25.990802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:07:25.990802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:25.990802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:25.990802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:25.990802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:25.990802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:25.990802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:25.990802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:25.990802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:25.990802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:25.990802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:25.990802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:25.990802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:25.990802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:25.990802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:25.990802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:25.990802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:25.991910 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:07:25.991910 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:07:25.991910 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:07:25.991910 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:07:25.991910 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:07:25.991910 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:07:25.991910 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:25.991910 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:25.996276 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 481/953] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:07:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:25.997174 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706cfa4-9f21-4a78-b076-3b64576496b5 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:26.019934 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:26.032540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b54a5d-0562-4557-80f2-d36d587577f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:26.036587 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b54a5d-0562-4557-80f2-d36d587577f4 None admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:26.036587 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b54a5d-0562-4557-80f2-d36d587577f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:26.036587 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b54a5d-0562-4557-80f2-d36d587577f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:26.036587 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b54a5d-0562-4557-80f2-d36d587577f4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:26.037403 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b54a5d-0562-4557-80f2-d36d587577f4 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:26.115369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 473/954] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:07:25 2022] POST /identity/v3/endpoints => generated 349 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:07:26.140879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706cfa4-9f21-4a78-b076-3b64576496b5 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:26.192874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97561113-efb1-4958-91c0-6ae7a1bbe2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:26.193773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97561113-efb1-4958-91c0-6ae7a1bbe2a4 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:26.194209 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97561113-efb1-4958-91c0-6ae7a1bbe2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:26.194716 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97561113-efb1-4958-91c0-6ae7a1bbe2a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:26.195652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97561113-efb1-4958-91c0-6ae7a1bbe2a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:26.196138 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97561113-efb1-4958-91c0-6ae7a1bbe2a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:26.197791 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97561113-efb1-4958-91c0-6ae7a1bbe2a4 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:26.219160 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 482/955] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Sep 6 20:07:25 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:26.431677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d2ed7-7b19-4983-916b-05cc632ce9b0 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:26.431677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d2ed7-7b19-4983-916b-05cc632ce9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:26.431677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d2ed7-7b19-4983-916b-05cc632ce9b0 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:26.431677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 474/956] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:26.432476 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f008d-c628-4003-8602-dd484a59ec32 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:26.432665 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f008d-c628-4003-8602-dd484a59ec32 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:26.432895 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f008d-c628-4003-8602-dd484a59ec32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:26.456165 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-7b1f008d-c628-4003-8602-dd484a59ec32 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:26.458107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-7b1f008d-c628-4003-8602-dd484a59ec32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:26.531496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:26.537926 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 483/957] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:07:26.807033 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d2ed7-7b19-4983-916b-05cc632ce9b0 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:26.861349 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:26.932885 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d2ed7-7b19-4983-916b-05cc632ce9b0 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:26.969368 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a1d61-c663-4a1f-b19b-9572af67e8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:26.970493 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a1d61-c663-4a1f-b19b-9572af67e8cb None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:26.970988 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a1d61-c663-4a1f-b19b-9572af67e8cb None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:26.971485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a1d61-c663-4a1f-b19b-9572af67e8cb None admin] PATH_INFO: `/v3/services/compute` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:26.972286 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a1d61-c663-4a1f-b19b-9572af67e8cb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:26.973858 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a1d61-c663-4a1f-b19b-9572af67e8cb None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:26.984127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-f21a1d61-c663-4a1f-b19b-9572af67e8cb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 20:07:26.984127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:26.984127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 20:07:26.984127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 20:07:26.984127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 20:07:26.984127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 20:07:26.984127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 20:07:26.984127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:26.984127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 20:07:26.984127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:26.984127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:07:26.984127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:26.984127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:26.984127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:26.984127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:26.984127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:26.984127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:26.985204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:26.985204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:26.985204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:26.985204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:26.985204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:26.985204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:26.985204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 20:07:26.985204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 20:07:26.985204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 20:07:26.985204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 20:07:26.985204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:26.985204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:26.985204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:26.985204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:26.985204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:26.985204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:26.986048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:26.986048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:26.986048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:26.986048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:26.986048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:26.986048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:26.986048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:26.986048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:26.986048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:26.986048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:26.986048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 20:07:26.986048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:26.986048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 20:07:26.986048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:26.989009 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 475/958] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:07:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:26.997223 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f008d-c628-4003-8602-dd484a59ec32 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:27.118874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f008d-c628-4003-8602-dd484a59ec32 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:27.162238 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff771b-c972-4366-a9ee-22a54e398822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:27.163189 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff771b-c972-4366-a9ee-22a54e398822 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:27.163674 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff771b-c972-4366-a9ee-22a54e398822 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:27.164147 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff771b-c972-4366-a9ee-22a54e398822 None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:27.165151 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff771b-c972-4366-a9ee-22a54e398822 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:27.165710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff771b-c972-4366-a9ee-22a54e398822 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:27.167302 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff771b-c972-4366-a9ee-22a54e398822 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:27.173871 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 484/959] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Sep 6 20:07:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:27.184772 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a1d61-c663-4a1f-b19b-9572af67e8cb None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:27.260000 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3ac15-666b-4e5b-b9e6-91ff288ceade None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:27.260330 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3ac15-666b-4e5b-b9e6-91ff288ceade None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:27.260591 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3ac15-666b-4e5b-b9e6-91ff288ceade None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:27.262218 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 485/960] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:07:27.268038 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cea669-4188-4b99-a0ae-b893742c7282 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:27.268313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cea669-4188-4b99-a0ae-b893742c7282 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:27.268588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cea669-4188-4b99-a0ae-b893742c7282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:27.292907 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-62cea669-4188-4b99-a0ae-b893742c7282 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:27.294144 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-62cea669-4188-4b99-a0ae-b893742c7282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:27.310580 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a1d61-c663-4a1f-b19b-9572af67e8cb None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:27.319786 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:27.354513 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a231b7-6bfe-4da6-ad39-0b5a310eae1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:27.356272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a231b7-6bfe-4da6-ad39-0b5a310eae1c None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:27.357031 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a231b7-6bfe-4da6-ad39-0b5a310eae1c None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:27.357532 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a231b7-6bfe-4da6-ad39-0b5a310eae1c None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:27.359326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a231b7-6bfe-4da6-ad39-0b5a310eae1c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:27.360186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a231b7-6bfe-4da6-ad39-0b5a310eae1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:27.361532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:27.363973 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a231b7-6bfe-4da6-ad39-0b5a310eae1c None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:27.375212 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 476/961] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Sep 6 20:07:27 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:27.376233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 486/962] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 20:07:27.647390 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a231b7-6bfe-4da6-ad39-0b5a310eae1c None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:27.762055 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a231b7-6bfe-4da6-ad39-0b5a310eae1c None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:27.815301 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a5028-d724-4df7-96c5-238a8f24839e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:27.817332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a5028-d724-4df7-96c5-238a8f24839e None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:27.818104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a5028-d724-4df7-96c5-238a8f24839e None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:27.818607 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a5028-d724-4df7-96c5-238a8f24839e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:27.835798 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a5028-d724-4df7-96c5-238a8f24839e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:07:27.843546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-eb2a5028-d724-4df7-96c5-238a8f24839e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 20:07:27.843546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:27.843546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:27.843546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:27.843546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:27.843546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:27.843546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:27.843546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:27.843546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:27.843546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:27.843546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:27.843546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:27.843546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:07:27.843546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:07:27.843546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:07:27.843546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:07:27.844540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:07:27.844540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:07:27.844540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:07:27.844540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:07:27.844540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:27.844540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:27.844540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:27.844540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:27.844540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:27.844540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:27.844540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:27.844540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:27.844540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:27.844540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:27.844540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:27.844540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:27.845368 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:27.845368 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:27.845368 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:27.845368 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:27.845368 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:07:27.845368 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:07:27.845368 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:07:27.845368 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:07:27.845368 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:07:27.845368 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:07:27.845368 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 20:07:27.845368 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:27.846523 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 477/963] 10.222.0.77 () {56 vars in 1120 bytes} [Tue Sep 6 20:07:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:27.852998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cea669-4188-4b99-a0ae-b893742c7282 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:27.969489 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cea669-4188-4b99-a0ae-b893742c7282 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:28.007265 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60042d5-428f-47af-bf9b-e265fb49e0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:28.007908 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60042d5-428f-47af-bf9b-e265fb49e0c4 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:28.008189 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60042d5-428f-47af-bf9b-e265fb49e0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:28.008461 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60042d5-428f-47af-bf9b-e265fb49e0c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:28.009128 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60042d5-428f-47af-bf9b-e265fb49e0c4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:28.009431 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60042d5-428f-47af-bf9b-e265fb49e0c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:28.010799 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60042d5-428f-47af-bf9b-e265fb49e0c4 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:28.021081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 487/964] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Sep 6 20:07:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:28.027065 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a5028-d724-4df7-96c5-238a8f24839e None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:28.062187 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:28.160168 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a5028-d724-4df7-96c5-238a8f24839e None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:28.204905 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e76e4-20c0-4803-aaee-66ed34af2ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:28.205555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e76e4-20c0-4803-aaee-66ed34af2ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:28.205907 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e76e4-20c0-4803-aaee-66ed34af2ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:28.206306 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e76e4-20c0-4803-aaee-66ed34af2ea3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:28.218494 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e76e4-20c0-4803-aaee-66ed34af2ea3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:28.220118 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e76e4-20c0-4803-aaee-66ed34af2ea3 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:28.236402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-505e76e4-20c0-4803-aaee-66ed34af2ea3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:28.236402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:28.236402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:28.236402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:28.236402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:28.236402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:28.236402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:28.236402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:28.236402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:28.236402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:28.236402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:28.236402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:28.236402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:07:28.236402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:07:28.236402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:07:28.236402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:07:28.237405 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:28.237405 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:28.237405 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:28.237405 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:28.237405 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:28.237405 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:28.237405 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:28.237405 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:28.237405 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:28.237405 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:28.237405 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:28.237405 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:28.237405 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:28.237405 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:28.237405 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:28.237405 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:28.237405 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:07:28.238491 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:07:28.238491 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:28.238491 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:28.238491 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 478/965] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:28.244888 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60042d5-428f-47af-bf9b-e265fb49e0c4 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:28.314252 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:28.364067 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60042d5-428f-47af-bf9b-e265fb49e0c4 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:28.403420 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a2989-061b-487b-a1ef-e5932f9ceac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:28.404160 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a2989-061b-487b-a1ef-e5932f9ceac5 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:28.405103 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a2989-061b-487b-a1ef-e5932f9ceac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:28.405378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a2989-061b-487b-a1ef-e5932f9ceac5 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:28.406029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a2989-061b-487b-a1ef-e5932f9ceac5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:28.406334 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a2989-061b-487b-a1ef-e5932f9ceac5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:28.407746 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a2989-061b-487b-a1ef-e5932f9ceac5 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:28.411139 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a4639-be58-447c-88fc-6ca5e678099b None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:28.411420 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a4639-be58-447c-88fc-6ca5e678099b None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:28.411727 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a4639-be58-447c-88fc-6ca5e678099b None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:28.413953 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 479/966] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:07:28.418490 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f003bb-46ed-40b0-8201-32e7f2edefb9 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:28.418771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f003bb-46ed-40b0-8201-32e7f2edefb9 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:28.419044 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f003bb-46ed-40b0-8201-32e7f2edefb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:28.423238 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 488/967] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:28.429326 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a2989-061b-487b-a1ef-e5932f9ceac5 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:28.439691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-a1f003bb-46ed-40b0-8201-32e7f2edefb9 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:28.441096 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-a1f003bb-46ed-40b0-8201-32e7f2edefb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:28.527938 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 480/968] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 20:07:28.564403 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a2989-061b-487b-a1ef-e5932f9ceac5 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:28.582588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:28.601497 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91914e-51f1-40ba-b59d-edc7aff3ecde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:28.602137 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91914e-51f1-40ba-b59d-edc7aff3ecde None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:28.602418 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91914e-51f1-40ba-b59d-edc7aff3ecde None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:28.602692 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91914e-51f1-40ba-b59d-edc7aff3ecde None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:28.611055 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f91914e-51f1-40ba-b59d-edc7aff3ecde None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:28.612619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f91914e-51f1-40ba-b59d-edc7aff3ecde None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:28.625307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-8f91914e-51f1-40ba-b59d-edc7aff3ecde None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 20:07:28.625307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:28.625307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:28.625307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:28.625307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:28.625307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:28.625307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:28.625307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:28.625307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:28.625307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:28.625307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:28.625307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:28.625307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:07:28.625307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:07:28.625307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:07:28.625307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:07:28.626322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:28.626322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:28.626322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:07:28.626322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:28.626322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:07:28.626322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:28.626322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:28.626322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:28.626322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:28.626322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:28.626322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:28.626322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:28.626322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:28.626322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:28.626322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:28.626322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:28.626322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:28.626322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:28.627578 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:28.627578 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:28.627578 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:07:28.627578 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:07:28.627578 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:07:28.627578 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:07:28.627578 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:07:28.627578 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:07:28.627578 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 20:07:28.627578 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:28.627578 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 489/969] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Sep 6 20:07:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:07:28.632660 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f003bb-46ed-40b0-8201-32e7f2edefb9 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:28.648374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:28.658815 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbf4a8-b1f9-498a-a46c-8de39097999a None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:28.659100 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbf4a8-b1f9-498a-a46c-8de39097999a None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:28.659380 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbf4a8-b1f9-498a-a46c-8de39097999a None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:28.663660 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 490/970] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:07:28.666132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215c31e-0126-4b0d-aef0-17f7350260b5 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:28.666412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215c31e-0126-4b0d-aef0-17f7350260b5 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:28.666675 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215c31e-0126-4b0d-aef0-17f7350260b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:28.686391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-8215c31e-0126-4b0d-aef0-17f7350260b5 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:28.687645 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-8215c31e-0126-4b0d-aef0-17f7350260b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:28.751816 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f003bb-46ed-40b0-8201-32e7f2edefb9 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:28.769483 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 491/971] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 20:07:28.796873 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c19109-4ad1-4ab1-8d4e-6041a3c7724f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:28.797789 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c19109-4ad1-4ab1-8d4e-6041a3c7724f None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:28.798323 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c19109-4ad1-4ab1-8d4e-6041a3c7724f None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:28.798767 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c19109-4ad1-4ab1-8d4e-6041a3c7724f None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:28.799749 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c19109-4ad1-4ab1-8d4e-6041a3c7724f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:28.800229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c19109-4ad1-4ab1-8d4e-6041a3c7724f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:28.801889 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c19109-4ad1-4ab1-8d4e-6041a3c7724f None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:28.822219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 481/972] 10.222.0.77 () {56 vars in 1149 bytes} [Tue Sep 6 20:07:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:28.836581 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215c31e-0126-4b0d-aef0-17f7350260b5 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:28.836764 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c19109-4ad1-4ab1-8d4e-6041a3c7724f None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:28.919792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:28.949741 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c19109-4ad1-4ab1-8d4e-6041a3c7724f None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:28.958905 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215c31e-0126-4b0d-aef0-17f7350260b5 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:28.967495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:28.986952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad53132-fb1b-418e-b59e-af8df3ab949a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:28.987609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad53132-fb1b-418e-b59e-af8df3ab949a None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:28.987886 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad53132-fb1b-418e-b59e-af8df3ab949a None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:28.988151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad53132-fb1b-418e-b59e-af8df3ab949a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:28.988726 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad53132-fb1b-418e-b59e-af8df3ab949a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:28.990159 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad53132-fb1b-418e-b59e-af8df3ab949a None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:28.996725 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451ebbc-b267-4081-9b4d-61a1d954a650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:28.997520 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451ebbc-b267-4081-9b4d-61a1d954a650 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:28.997970 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451ebbc-b267-4081-9b4d-61a1d954a650 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:28.998416 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451ebbc-b267-4081-9b4d-61a1d954a650 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:29.000057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-fad53132-fb1b-418e-b59e-af8df3ab949a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 20:07:29.000057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:29.000057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 20:07:29.000057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 20:07:29.000057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 20:07:29.000057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 20:07:29.000057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 20:07:29.000057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:29.000057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 20:07:29.000057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:29.000057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:07:29.000057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:29.000057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:29.000057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:29.000057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:29.000057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:29.000057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:29.001271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:29.001271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:29.001271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:29.001271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:29.001271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:29.001271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:29.001271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 20:07:29.001271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 20:07:29.001271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 20:07:29.001271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 20:07:29.001271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:29.001271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:29.001271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:29.001271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:29.001271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:29.001271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:29.002806 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:29.002806 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:29.002806 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:29.002806 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:29.002806 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:29.002806 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:29.002806 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:29.002806 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:29.002806 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:29.002806 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:29.002806 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 20:07:29.002806 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:29.002806 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 20:07:29.002806 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:29.002806 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 482/973] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Sep 6 20:07:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:29.007685 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad53132-fb1b-418e-b59e-af8df3ab949a None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:29.088363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e451ebbc-b267-4081-9b4d-61a1d954a650 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:29.089744 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e451ebbc-b267-4081-9b4d-61a1d954a650 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:29.117381 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad53132-fb1b-418e-b59e-af8df3ab949a None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:29.153923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d51757-995b-4474-ade3-76835b8a5d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:29.155097 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d51757-995b-4474-ade3-76835b8a5d86 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:29.155377 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d51757-995b-4474-ade3-76835b8a5d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:29.155679 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d51757-995b-4474-ade3-76835b8a5d86 None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:29.156305 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d51757-995b-4474-ade3-76835b8a5d86 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:29.156609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d51757-995b-4474-ade3-76835b8a5d86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:29.157971 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d51757-995b-4474-ade3-76835b8a5d86 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:29.159068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:29.166889 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 483/974] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Sep 6 20:07:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:29.166889 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d51757-995b-4474-ade3-76835b8a5d86 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:29.209606 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 492/975] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:07:28 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 20:07:29.209606 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451ebbc-b267-4081-9b4d-61a1d954a650 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:29.217767 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:29.276962 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d51757-995b-4474-ade3-76835b8a5d86 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:29.317185 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06596948-1341-413c-a5b4-bb78eef26daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:29.317864 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06596948-1341-413c-a5b4-bb78eef26daf None admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:29.318153 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06596948-1341-413c-a5b4-bb78eef26daf None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:29.318425 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06596948-1341-413c-a5b4-bb78eef26daf None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:29.318943 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451ebbc-b267-4081-9b4d-61a1d954a650 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:29.319057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06596948-1341-413c-a5b4-bb78eef26daf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:29.320761 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06596948-1341-413c-a5b4-bb78eef26daf None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:29.324193 dv-cinder-847732-4-smb devstack@keystone.service[81847]: WARNING keystone.server.flask.common [None req-06596948-1341-413c-a5b4-bb78eef26daf None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 06 20:07:29.359076 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d198cc-5313-4a49-8089-ee3e68f11ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:29.359559 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d198cc-5313-4a49-8089-ee3e68f11ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:29.359844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d198cc-5313-4a49-8089-ee3e68f11ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:29.360104 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d198cc-5313-4a49-8089-ee3e68f11ba9 None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:29.360728 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d198cc-5313-4a49-8089-ee3e68f11ba9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:29.361029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d198cc-5313-4a49-8089-ee3e68f11ba9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:29.362391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d198cc-5313-4a49-8089-ee3e68f11ba9 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:29.365325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.sql.core [None req-06596948-1341-413c-a5b4-bb78eef26daf None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 06 20:07:29.365325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 06 20:07:29.365325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [parameters: {'user_id': '02f29fb2a7464d40b8af6610ed7b842b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 06 20:07:29.365325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81847) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 06 20:07:29.373280 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 493/976] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Sep 6 20:07:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:29.373280 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d198cc-5313-4a49-8089-ee3e68f11ba9 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:29.384166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-06596948-1341-413c-a5b4-bb78eef26daf None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 06 20:07:29.384166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:29.384166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 20:07:29.384166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 20:07:29.384166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 20:07:29.384166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 20:07:29.384166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 20:07:29.384166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 20:07:29.384166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 20:07:29.384166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application conn.query(q) Sep 06 20:07:29.384166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 20:07:29.384166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 20:07:29.384166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 20:07:29.384166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application result.read() Sep 06 20:07:29.384166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 20:07:29.385127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 20:07:29.385127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 20:07:29.385127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 20:07:29.385127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 20:07:29.385127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 20:07:29.385127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 20:07:29.385127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 20:07:29.385127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 06 20:07:29.385127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:29.385127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 06 20:07:29.385127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:29.385127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:29.385127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 06 20:07:29.385127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 06 20:07:29.385127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 06 20:07:29.385127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 06 20:07:29.385127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 20:07:29.385127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application next(self.gen) Sep 06 20:07:29.386104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 06 20:07:29.386104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application yield resource Sep 06 20:07:29.386104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 20:07:29.386104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application next(self.gen) Sep 06 20:07:29.386104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 06 20:07:29.386104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self.session.rollback() Sep 06 20:07:29.386104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 20:07:29.386104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self.force_reraise() Sep 06 20:07:29.386104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 20:07:29.386104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise self.value Sep 06 20:07:29.386104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 06 20:07:29.386104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 06 20:07:29.386104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 06 20:07:29.386104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application session.commit() Sep 06 20:07:29.386104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 06 20:07:29.386104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 06 20:07:29.386104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 06 20:07:29.391992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self._prepare_impl() Sep 06 20:07:29.391992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 06 20:07:29.391992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self.session.flush() Sep 06 20:07:29.391992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 06 20:07:29.391992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self._flush(objects) Sep 06 20:07:29.391992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 06 20:07:29.391992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 06 20:07:29.391992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 06 20:07:29.391992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application compat.raise_( Sep 06 20:07:29.391992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 20:07:29.391992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception Sep 06 20:07:29.391992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 06 20:07:29.391992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application flush_context.execute() Sep 06 20:07:29.391992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 06 20:07:29.391992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rec.execute(self) Sep 06 20:07:29.391992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 06 20:07:29.391992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 06 20:07:29.393151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 06 20:07:29.393151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 06 20:07:29.393151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 06 20:07:29.393151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 06 20:07:29.393151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 06 20:07:29.393151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 06 20:07:29.393151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 06 20:07:29.393151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 06 20:07:29.393151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 06 20:07:29.393151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 06 20:07:29.393151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 06 20:07:29.393151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 06 20:07:29.393151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 06 20:07:29.393151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 06 20:07:29.393151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 20:07:29.393151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception Sep 06 20:07:29.394218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 20:07:29.394218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 20:07:29.394218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 20:07:29.394218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 20:07:29.394218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 20:07:29.394218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 20:07:29.394218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 20:07:29.394218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application conn.query(q) Sep 06 20:07:29.394218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 20:07:29.394218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 20:07:29.394218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 20:07:29.394218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application result.read() Sep 06 20:07:29.394218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 20:07:29.394218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 20:07:29.394218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 20:07:29.394218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 20:07:29.395182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 20:07:29.395182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 20:07:29.395182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 20:07:29.395182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 20:07:29.395182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 06 20:07:29.395182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 06 20:07:29.395182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [parameters: {'user_id': '02f29fb2a7464d40b8af6610ed7b842b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 06 20:07:29.395182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 06 20:07:29.395182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:29.395182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:07:29.395182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:29.395182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:29.395182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:29.395182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:29.395182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:29.396132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:29.396132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:29.396132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:29.396132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:29.396132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:29.396132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:29.396132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:29.396132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 06 20:07:29.396132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 06 20:07:29.396132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:29.396132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:29.396132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:07:29.396132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:29.396132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:07:29.396132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:29.396132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 06 20:07:29.396132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 06 20:07:29.397260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 06 20:07:29.397260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 06 20:07:29.397260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 06 20:07:29.397260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 06 20:07:29.397260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 06 20:07:29.397260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:29.397260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 484/977] 10.222.0.77 () {60 vars in 1131 bytes} [Tue Sep 6 20:07:29 2022] POST /identity/v3/users => generated 160 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:29.397260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06596948-1341-413c-a5b4-bb78eef26daf None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:29.460187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:29.464944 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:29.496073 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d198cc-5313-4a49-8089-ee3e68f11ba9 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:29.512845 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06596948-1341-413c-a5b4-bb78eef26daf None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:29.542523 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0796d-85d7-445a-9dfe-ca2f47425b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:29.543277 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0796d-85d7-445a-9dfe-ca2f47425b13 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:29.543659 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0796d-85d7-445a-9dfe-ca2f47425b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:29.544030 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0796d-85d7-445a-9dfe-ca2f47425b13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:29.556185 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0796d-85d7-445a-9dfe-ca2f47425b13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:29.557847 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0796d-85d7-445a-9dfe-ca2f47425b13 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:29.567045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d996220-96a1-488a-bbb2-fac65a36dfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:29.567742 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d996220-96a1-488a-bbb2-fac65a36dfa9 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:29.568064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d996220-96a1-488a-bbb2-fac65a36dfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:29.568340 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d996220-96a1-488a-bbb2-fac65a36dfa9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:29.569048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d996220-96a1-488a-bbb2-fac65a36dfa9 None admin] RBAC: Adding query filter params (interface=admin, service_id=f9ec1ac9840e476281ebdaac59842fca, region_id=RegionOne) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:29.569362 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d996220-96a1-488a-bbb2-fac65a36dfa9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:29.570987 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d996220-96a1-488a-bbb2-fac65a36dfa9 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:29.578201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-daa0796d-85d7-445a-9dfe-ca2f47425b13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:29.578201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:29.578201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:29.578201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:29.578201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:29.578201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:29.578201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:29.578201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:29.578201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:29.578201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:29.578201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:29.578201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:29.578201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:07:29.578201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:07:29.578201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:07:29.578201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:07:29.579232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:29.579232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:29.579232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:29.579232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:29.579232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:29.579232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:29.579232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:29.579232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:29.579232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:29.579232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:29.579232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:29.579232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:29.579232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:29.579232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:29.579232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:29.579232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:29.579232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:07:29.580171 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:07:29.580171 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:29.580171 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:29.583611 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 494/978] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:29.584702 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 485/979] 10.222.0.77 () {56 vars in 1249 bytes} [Tue Sep 6 20:07:29 2022] GET /identity/v3/endpoints?service_id=f9ec1ac9840e476281ebdaac59842fca&interface=admin®ion_id=RegionOne => generated 193 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:29.584989 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0796d-85d7-445a-9dfe-ca2f47425b13 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:29.585643 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d996220-96a1-488a-bbb2-fac65a36dfa9 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:29.728289 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d996220-96a1-488a-bbb2-fac65a36dfa9 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:29.729879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0796d-85d7-445a-9dfe-ca2f47425b13 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:29.753106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:29.757175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:29.764458 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f0bbd-9c8a-44c1-a5dc-54b98562c3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:29.765165 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f0bbd-9c8a-44c1-a5dc-54b98562c3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:29.765439 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f0bbd-9c8a-44c1-a5dc-54b98562c3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:29.767087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f0bbd-9c8a-44c1-a5dc-54b98562c3e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:29.767087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f0bbd-9c8a-44c1-a5dc-54b98562c3e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:29.767087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f0bbd-9c8a-44c1-a5dc-54b98562c3e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:29.768009 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f0bbd-9c8a-44c1-a5dc-54b98562c3e7 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:29.769354 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73038aa-87f6-4c49-8c05-b9f6e44304e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:29.769985 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73038aa-87f6-4c49-8c05-b9f6e44304e6 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:29.770263 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73038aa-87f6-4c49-8c05-b9f6e44304e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:29.770527 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73038aa-87f6-4c49-8c05-b9f6e44304e6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:29.778149 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73038aa-87f6-4c49-8c05-b9f6e44304e6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:29.780211 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73038aa-87f6-4c49-8c05-b9f6e44304e6 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:29.780811 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 486/980] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:29.781627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f0bbd-9c8a-44c1-a5dc-54b98562c3e7 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:29.801689 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-b73038aa-87f6-4c49-8c05-b9f6e44304e6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 20:07:29.801689 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:29.801689 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:29.801689 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:29.801689 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:29.801689 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:29.801689 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:29.801689 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:29.801689 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:29.801689 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:29.801689 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:29.801689 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:29.801689 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:07:29.801689 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:07:29.801689 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:07:29.801689 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:07:29.802913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:29.802913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:29.802913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:07:29.802913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:29.802913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:07:29.802913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:29.802913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:29.802913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:29.802913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:29.802913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:29.802913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:29.802913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:29.802913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:29.802913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:29.802913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:29.802913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:29.802913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:29.802913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:29.804081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:29.804081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:29.804081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:07:29.804081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:07:29.804081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:07:29.804081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:07:29.804081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:07:29.804081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:07:29.804081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 20:07:29.804081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:29.804081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 495/981] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:07:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:29.804702 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276c1d9-4f57-4273-a582-64d00b588c4d None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:29.804702 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276c1d9-4f57-4273-a582-64d00b588c4d None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:29.804702 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276c1d9-4f57-4273-a582-64d00b588c4d None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:29.806147 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 496/982] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:29.806676 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276c1d9-4f57-4273-a582-64d00b588c4d None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:29.916722 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f0bbd-9c8a-44c1-a5dc-54b98562c3e7 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:29.927549 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276c1d9-4f57-4273-a582-64d00b588c4d None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:29.954873 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500ba02-4afc-4d76-913b-730034b3a70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:29.955512 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500ba02-4afc-4d76-913b-730034b3a70f None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:29.955799 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500ba02-4afc-4d76-913b-730034b3a70f None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:29.956135 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500ba02-4afc-4d76-913b-730034b3a70f None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:29.956732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500ba02-4afc-4d76-913b-730034b3a70f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:29.958103 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500ba02-4afc-4d76-913b-730034b3a70f None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:29.964451 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 487/983] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Sep 6 20:07:29 2022] GET /identity/v3/services => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:07:29.965058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a051912-8630-4fc1-a7ca-bc365c31bdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:29.965596 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500ba02-4afc-4d76-913b-730034b3a70f None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:29.965689 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a051912-8630-4fc1-a7ca-bc365c31bdc5 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:29.965969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a051912-8630-4fc1-a7ca-bc365c31bdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:29.966245 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a051912-8630-4fc1-a7ca-bc365c31bdc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:29.985961 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a051912-8630-4fc1-a7ca-bc365c31bdc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:29.987392 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a051912-8630-4fc1-a7ca-bc365c31bdc5 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:30.002356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-9a051912-8630-4fc1-a7ca-bc365c31bdc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:30.002356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:30.002356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:30.002356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:30.002356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:30.002356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:30.002356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:30.002356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:30.002356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:30.002356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:30.002356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:30.002356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:30.002356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:07:30.002356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:07:30.002356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:07:30.003657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:07:30.003657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:30.003657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:30.003657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:30.003657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:30.003657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:30.003657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:30.003657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:30.003657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:30.003657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:30.003657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:30.003657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:30.003657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:30.003657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:30.003657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:30.003657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:30.003657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:30.004622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:07:30.004622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:07:30.004622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:07:30.004622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:07:30.004622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:07:30.004622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:07:30.004622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:30.004622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:30.004622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 497/984] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:07:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:30.005196 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f829ace-c38e-49d0-9db3-926d2f91e7b9 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:30.005863 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f829ace-c38e-49d0-9db3-926d2f91e7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:30.005863 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f829ace-c38e-49d0-9db3-926d2f91e7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:30.028018 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-2f829ace-c38e-49d0-9db3-926d2f91e7b9 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:30.029352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-2f829ace-c38e-49d0-9db3-926d2f91e7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:30.035711 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:30.092272 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:30.128698 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500ba02-4afc-4d76-913b-730034b3a70f None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:30.144818 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 498/985] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:07:30.145736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f829ace-c38e-49d0-9db3-926d2f91e7b9 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:30.195196 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1af4c-039d-46c1-9c3b-eeb0da2847a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:30.195612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1af4c-039d-46c1-9c3b-eeb0da2847a3 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:30.195877 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1af4c-039d-46c1-9c3b-eeb0da2847a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:30.196144 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1af4c-039d-46c1-9c3b-eeb0da2847a3 None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:30.196841 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1af4c-039d-46c1-9c3b-eeb0da2847a3 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:30.197148 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1af4c-039d-46c1-9c3b-eeb0da2847a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:30.198568 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1af4c-039d-46c1-9c3b-eeb0da2847a3 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:30.246320 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 488/986] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Sep 6 20:07:29 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:30.296543 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f829ace-c38e-49d0-9db3-926d2f91e7b9 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:30.341491 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64568e89-acc4-4f4f-b127-8999fa067902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:30.342697 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64568e89-acc4-4f4f-b127-8999fa067902 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:30.342975 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64568e89-acc4-4f4f-b127-8999fa067902 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:30.343287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64568e89-acc4-4f4f-b127-8999fa067902 None admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:30.343990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64568e89-acc4-4f4f-b127-8999fa067902 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:30.344294 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64568e89-acc4-4f4f-b127-8999fa067902 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:30.345782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64568e89-acc4-4f4f-b127-8999fa067902 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:30.360945 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 499/987] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:07:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:30.367348 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1af4c-039d-46c1-9c3b-eeb0da2847a3 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:30.504760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1af4c-039d-46c1-9c3b-eeb0da2847a3 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:30.515544 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:30.556449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a973e-6d34-4fcd-ab57-b2ff194ec88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:30.557074 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a973e-6d34-4fcd-ab57-b2ff194ec88e None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:30.557354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a973e-6d34-4fcd-ab57-b2ff194ec88e None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:30.557632 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a973e-6d34-4fcd-ab57-b2ff194ec88e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:30.558382 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a973e-6d34-4fcd-ab57-b2ff194ec88e None admin] RBAC: Adding query filter params (role.id=82691a07001644e48564ddf52dcdfb89, scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343, user.id=c314372147b2491cb4481d538056472c) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:30.558709 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a973e-6d34-4fcd-ab57-b2ff194ec88e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:30.560333 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a973e-6d34-4fcd-ab57-b2ff194ec88e None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:30.572324 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 489/988] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:07:30 2022] GET /identity/v3/role_assignments?user.id=c314372147b2491cb4481d538056472c&scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343&role.id=82691a07001644e48564ddf52dcdfb89 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:30.634747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64568e89-acc4-4f4f-b127-8999fa067902 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:30.676192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:30.767164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64568e89-acc4-4f4f-b127-8999fa067902 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:30.810193 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce4567-ef39-4ee2-b5e0-68e533268551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:30.810822 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce4567-ef39-4ee2-b5e0-68e533268551 None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:30.811097 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce4567-ef39-4ee2-b5e0-68e533268551 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:30.811365 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce4567-ef39-4ee2-b5e0-68e533268551 None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:30.812118 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce4567-ef39-4ee2-b5e0-68e533268551 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:30.813500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce4567-ef39-4ee2-b5e0-68e533268551 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:30.887688 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 500/989] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Sep 6 20:07:30 2022] POST /identity/v3/services => generated 242 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:07:32.400389 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783af662-a314-46a7-aee7-02048bed2885 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:32.400923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783af662-a314-46a7-aee7-02048bed2885 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:32.401034 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783af662-a314-46a7-aee7-02048bed2885 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:32.402591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 490/990] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:32.408922 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e80b12-7dac-40e9-9cb0-ad09b2b22f94 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:32.409374 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e80b12-7dac-40e9-9cb0-ad09b2b22f94 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:32.409457 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e80b12-7dac-40e9-9cb0-ad09b2b22f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:32.428803 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-88e80b12-7dac-40e9-9cb0-ad09b2b22f94 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:32.429995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-88e80b12-7dac-40e9-9cb0-ad09b2b22f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:32.518880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 501/991] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:07:32.785989 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783af662-a314-46a7-aee7-02048bed2885 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:32.837648 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634d55f-645a-4fdb-991e-65f7eb1633f4 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:32.837963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634d55f-645a-4fdb-991e-65f7eb1633f4 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:32.838197 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634d55f-645a-4fdb-991e-65f7eb1633f4 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:32.839713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 502/992] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:32.844838 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98271-0568-4e5e-a48c-495bfe305afc None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:32.845122 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98271-0568-4e5e-a48c-495bfe305afc None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:32.845396 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98271-0568-4e5e-a48c-495bfe305afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:32.866520 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-56b98271-0568-4e5e-a48c-495bfe305afc None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:32.867757 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-56b98271-0568-4e5e-a48c-495bfe305afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:32.883997 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:32.905278 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783af662-a314-46a7-aee7-02048bed2885 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:32.945533 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 503/993] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:07:32.952315 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fb007-8c2d-482b-947d-660f91a47d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:32.952952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fb007-8c2d-482b-947d-660f91a47d84 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:32.953294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fb007-8c2d-482b-947d-660f91a47d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:32.953566 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fb007-8c2d-482b-947d-660f91a47d84 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:32.954175 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fb007-8c2d-482b-947d-660f91a47d84 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:32.955583 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fb007-8c2d-482b-947d-660f91a47d84 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:32.965068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-bc4fb007-8c2d-482b-947d-660f91a47d84 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 20:07:32.965068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:32.965068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 20:07:32.965068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 20:07:32.965068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 20:07:32.965068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 20:07:32.965068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 20:07:32.965068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:32.965068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 20:07:32.965068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:32.965068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:07:32.965068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:32.965068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:32.965068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:32.965068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:32.965068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:32.965068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:32.966213 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:32.966213 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:32.966213 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:32.966213 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:32.966213 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:32.966213 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:32.966213 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 20:07:32.966213 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 20:07:32.966213 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 20:07:32.966213 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 20:07:32.966213 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:32.966213 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:32.966213 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:32.966213 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:32.966213 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:32.966213 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:32.967640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:32.967640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:32.967640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:32.967640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:32.967640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:32.967640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:32.967640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:32.967640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:32.967640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:32.967640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:32.967640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 20:07:32.967640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:32.967640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 20:07:32.967640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:32.967640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 491/994] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Sep 6 20:07:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:32.972854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b98271-0568-4e5e-a48c-495bfe305afc None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:33.096841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b98271-0568-4e5e-a48c-495bfe305afc None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:33.126847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc625ba5-4194-4f81-98c9-fbce48495174 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:33.127169 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc625ba5-4194-4f81-98c9-fbce48495174 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:33.127367 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc625ba5-4194-4f81-98c9-fbce48495174 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:33.128960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 492/995] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:07:33.134174 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa7635-b793-46d3-81be-b0f853a2d723 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:33.134464 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa7635-b793-46d3-81be-b0f853a2d723 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:33.135343 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa7635-b793-46d3-81be-b0f853a2d723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:33.145726 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c855173-294e-441f-bc6e-25f4140e7f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:33.146514 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c855173-294e-441f-bc6e-25f4140e7f74 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:33.146922 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c855173-294e-441f-bc6e-25f4140e7f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:33.147329 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c855173-294e-441f-bc6e-25f4140e7f74 None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:33.148185 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c855173-294e-441f-bc6e-25f4140e7f74 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:33.148705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c855173-294e-441f-bc6e-25f4140e7f74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:33.150404 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c855173-294e-441f-bc6e-25f4140e7f74 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:33.155294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-07aa7635-b793-46d3-81be-b0f853a2d723 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:33.156763 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 504/996] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Sep 6 20:07:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:33.157229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-07aa7635-b793-46d3-81be-b0f853a2d723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:33.162801 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c855173-294e-441f-bc6e-25f4140e7f74 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:33.189781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:33.199413 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:33.245050 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 493/997] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 20:07:33.246120 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa7635-b793-46d3-81be-b0f853a2d723 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:33.286038 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c855173-294e-441f-bc6e-25f4140e7f74 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:33.325405 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb51b6-ab61-4baf-8cb4-46811e66663a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:33.326020 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb51b6-ab61-4baf-8cb4-46811e66663a None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:33.326879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb51b6-ab61-4baf-8cb4-46811e66663a None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:33.327154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb51b6-ab61-4baf-8cb4-46811e66663a None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:33.327849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb51b6-ab61-4baf-8cb4-46811e66663a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:33.328158 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb51b6-ab61-4baf-8cb4-46811e66663a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:33.329539 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb51b6-ab61-4baf-8cb4-46811e66663a None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:33.335760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 505/998] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Sep 6 20:07:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:33.341421 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb51b6-ab61-4baf-8cb4-46811e66663a None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:33.363713 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa7635-b793-46d3-81be-b0f853a2d723 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:33.407255 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b401d-2aa0-437c-b3e1-30823c94d705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:33.408356 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b401d-2aa0-437c-b3e1-30823c94d705 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:33.408821 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b401d-2aa0-437c-b3e1-30823c94d705 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:33.409305 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b401d-2aa0-437c-b3e1-30823c94d705 None admin] PATH_INFO: `/v3/services/image` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:33.410418 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b401d-2aa0-437c-b3e1-30823c94d705 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:33.412998 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b401d-2aa0-437c-b3e1-30823c94d705 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:33.427793 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-7b9b401d-2aa0-437c-b3e1-30823c94d705 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 20:07:33.427793 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:33.427793 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 20:07:33.427793 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 20:07:33.427793 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 20:07:33.427793 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 20:07:33.427793 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 20:07:33.427793 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:33.427793 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 20:07:33.427793 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:33.427793 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:07:33.427793 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:33.427793 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:33.427793 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:33.427793 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:33.427793 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:33.427793 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:33.429527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:33.429527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:33.429527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:33.429527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:33.429527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:33.429527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:33.429527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 20:07:33.429527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 20:07:33.429527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 20:07:33.429527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 20:07:33.429527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:33.429527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:33.429527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:33.429527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:33.429527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:33.429527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:33.430598 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:33.430598 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:33.430598 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:33.430598 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:33.430598 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:33.430598 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:33.430598 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:33.430598 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:33.430598 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:33.430598 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:33.430598 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 20:07:33.430598 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:33.430598 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 20:07:33.430598 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:33.433959 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 494/999] 10.222.0.77 () {56 vars in 1105 bytes} [Tue Sep 6 20:07:33 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:33.434865 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b401d-2aa0-437c-b3e1-30823c94d705 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:33.449155 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:33.469679 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:33.476308 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb51b6-ab61-4baf-8cb4-46811e66663a None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:33.520080 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cdff8-6293-4211-a14c-75f009972871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:33.520693 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cdff8-6293-4211-a14c-75f009972871 None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:33.520972 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cdff8-6293-4211-a14c-75f009972871 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:33.521244 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cdff8-6293-4211-a14c-75f009972871 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:33.521928 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cdff8-6293-4211-a14c-75f009972871 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:33.523292 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cdff8-6293-4211-a14c-75f009972871 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:33.563504 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b401d-2aa0-437c-b3e1-30823c94d705 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:33.577283 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 506/1000] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:07:33 2022] POST /identity/v3/endpoints => generated 325 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:07:33.578105 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cdff8-6293-4211-a14c-75f009972871 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:33.627099 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675eef6a-d760-4bba-8bfb-a28fd9cac67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:33.628343 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675eef6a-d760-4bba-8bfb-a28fd9cac67d None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:33.628848 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675eef6a-d760-4bba-8bfb-a28fd9cac67d None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:33.629335 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675eef6a-d760-4bba-8bfb-a28fd9cac67d None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:33.630535 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675eef6a-d760-4bba-8bfb-a28fd9cac67d None admin] RBAC: Adding query filter params (name=image) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:33.631076 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675eef6a-d760-4bba-8bfb-a28fd9cac67d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:33.633774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675eef6a-d760-4bba-8bfb-a28fd9cac67d None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:33.643398 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 495/1001] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:33.649470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675eef6a-d760-4bba-8bfb-a28fd9cac67d None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:33.724548 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cdff8-6293-4211-a14c-75f009972871 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:33.771389 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:33.779702 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6396651-67e4-4d54-8c43-aa64b3be2140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:33.780417 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6396651-67e4-4d54-8c43-aa64b3be2140 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:33.780699 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6396651-67e4-4d54-8c43-aa64b3be2140 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:33.789296 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6396651-67e4-4d54-8c43-aa64b3be2140 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:33.789296 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6396651-67e4-4d54-8c43-aa64b3be2140 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:33.789296 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6396651-67e4-4d54-8c43-aa64b3be2140 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:33.789296 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:33.791211 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675eef6a-d760-4bba-8bfb-a28fd9cac67d None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:33.793080 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-d6396651-67e4-4d54-8c43-aa64b3be2140 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 20:07:33.793080 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:33.793080 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 20:07:33.793080 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 20:07:33.793080 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 20:07:33.793080 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 20:07:33.793080 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 20:07:33.793080 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:33.793080 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 20:07:33.793080 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:33.793080 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:07:33.793080 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:33.793080 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:33.793080 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:33.793080 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:33.793080 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:33.793080 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:33.794229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:33.794229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:33.794229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:33.794229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:33.794229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:33.794229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:33.794229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 20:07:33.794229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 20:07:33.794229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 20:07:33.794229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 20:07:33.794229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:33.794229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:33.794229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:33.794229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:33.794229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:33.794229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:33.795079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:33.795079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:33.795079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:33.795079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:33.795079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:33.795079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:33.795079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:33.795079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:33.795079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:33.795079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:33.795079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 20:07:33.795079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:33.795079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 20:07:33.795079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:33.795079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 507/1002] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:07:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:33.803033 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6396651-67e4-4d54-8c43-aa64b3be2140 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:33.870630 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8bf87-76f8-44d9-b714-d2157e92878e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:33.871273 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8bf87-76f8-44d9-b714-d2157e92878e None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:33.871600 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8bf87-76f8-44d9-b714-d2157e92878e None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:33.871873 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8bf87-76f8-44d9-b714-d2157e92878e None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:33.872502 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8bf87-76f8-44d9-b714-d2157e92878e None admin] RBAC: Adding query filter params (type=image) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:33.872801 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8bf87-76f8-44d9-b714-d2157e92878e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:33.874730 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8bf87-76f8-44d9-b714-d2157e92878e None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:33.880858 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 496/1003] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:33.949091 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6396651-67e4-4d54-8c43-aa64b3be2140 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:34.002179 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05c235-e30f-4b6e-ad19-78e60c4ff886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:34.003164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05c235-e30f-4b6e-ad19-78e60c4ff886 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:34.003724 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05c235-e30f-4b6e-ad19-78e60c4ff886 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:34.004339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05c235-e30f-4b6e-ad19-78e60c4ff886 None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:34.005411 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05c235-e30f-4b6e-ad19-78e60c4ff886 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:34.005977 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05c235-e30f-4b6e-ad19-78e60c4ff886 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:34.008731 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05c235-e30f-4b6e-ad19-78e60c4ff886 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:34.024391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 508/1004] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Sep 6 20:07:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:34.026850 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8bf87-76f8-44d9-b714-d2157e92878e None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:34.169772 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8bf87-76f8-44d9-b714-d2157e92878e None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:34.207303 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47e5a2-6304-46da-84b1-b52797e738f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:34.207951 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47e5a2-6304-46da-84b1-b52797e738f3 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:34.208233 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47e5a2-6304-46da-84b1-b52797e738f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:34.208506 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47e5a2-6304-46da-84b1-b52797e738f3 None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:34.209135 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47e5a2-6304-46da-84b1-b52797e738f3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:34.209439 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47e5a2-6304-46da-84b1-b52797e738f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:34.210805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47e5a2-6304-46da-84b1-b52797e738f3 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:34.216358 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 497/1005] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Sep 6 20:07:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:34.222873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05c235-e30f-4b6e-ad19-78e60c4ff886 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:34.291211 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:34.331532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05c235-e30f-4b6e-ad19-78e60c4ff886 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:34.368098 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85770d-bec8-4868-9166-3abbfcdc620f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:34.368714 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85770d-bec8-4868-9166-3abbfcdc620f None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:34.368987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85770d-bec8-4868-9166-3abbfcdc620f None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:34.369257 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85770d-bec8-4868-9166-3abbfcdc620f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:34.369955 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85770d-bec8-4868-9166-3abbfcdc620f None admin] RBAC: Adding query filter params (interface=public, service_id=349dc276f56448168639934a5e87d954, region_id=RegionOne) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:34.370264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85770d-bec8-4868-9166-3abbfcdc620f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:34.371656 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85770d-bec8-4868-9166-3abbfcdc620f None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:34.379374 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 509/1006] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Sep 6 20:07:34 2022] GET /identity/v3/endpoints?service_id=349dc276f56448168639934a5e87d954&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:34.384223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47e5a2-6304-46da-84b1-b52797e738f3 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:34.408278 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:34.497130 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47e5a2-6304-46da-84b1-b52797e738f3 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:34.537279 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75ca0a-822f-44bf-bf7d-dfca1fe28bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:34.537952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75ca0a-822f-44bf-bf7d-dfca1fe28bcc None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:34.538228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75ca0a-822f-44bf-bf7d-dfca1fe28bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:34.538504 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75ca0a-822f-44bf-bf7d-dfca1fe28bcc None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:34.539117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75ca0a-822f-44bf-bf7d-dfca1fe28bcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:34.540519 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75ca0a-822f-44bf-bf7d-dfca1fe28bcc None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:34.547548 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 498/1007] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Sep 6 20:07:34 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:07:35.829935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412b63e-b148-4e8a-a09b-04a929a04a68 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:35.830478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412b63e-b148-4e8a-a09b-04a929a04a68 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:35.830478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412b63e-b148-4e8a-a09b-04a929a04a68 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:35.832302 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 510/1008] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:35.837811 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad4e6e-3c91-4c50-ac3c-579d267c448e None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:35.838290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad4e6e-3c91-4c50-ac3c-579d267c448e None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:35.838541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad4e6e-3c91-4c50-ac3c-579d267c448e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:35.858437 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-93ad4e6e-3c91-4c50-ac3c-579d267c448e None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:35.859733 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-93ad4e6e-3c91-4c50-ac3c-579d267c448e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:35.937103 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 499/1009] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:35 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:07:36.100349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a8e77-54c3-4fc1-bccb-129181bc87b8 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:36.100544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a8e77-54c3-4fc1-bccb-129181bc87b8 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:36.100797 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a8e77-54c3-4fc1-bccb-129181bc87b8 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:36.102336 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 511/1010] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:36.108370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c233ecc-4738-40b8-9fc1-b2fbada8a7f7 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:36.108653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c233ecc-4738-40b8-9fc1-b2fbada8a7f7 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:36.108925 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c233ecc-4738-40b8-9fc1-b2fbada8a7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:36.133008 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-5c233ecc-4738-40b8-9fc1-b2fbada8a7f7 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:36.134266 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-5c233ecc-4738-40b8-9fc1-b2fbada8a7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:36.137472 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:36.205068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a8e77-54c3-4fc1-bccb-129181bc87b8 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:36.223790 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 500/1011] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:36 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:07:36.333894 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a8e77-54c3-4fc1-bccb-129181bc87b8 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:36.371351 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:36.379989 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040466ad-2ccd-43c1-a75e-db2cf20b8ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:36.380642 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040466ad-2ccd-43c1-a75e-db2cf20b8ade None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:36.380917 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040466ad-2ccd-43c1-a75e-db2cf20b8ade None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:36.381191 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040466ad-2ccd-43c1-a75e-db2cf20b8ade None admin] PATH_INFO: `/v3/domains/default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:36.382331 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040466ad-2ccd-43c1-a75e-db2cf20b8ade None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:36.383874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040466ad-2ccd-43c1-a75e-db2cf20b8ade None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:36.390702 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 512/1012] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:36.392728 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c233ecc-4738-40b8-9fc1-b2fbada8a7f7 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:36.491764 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040466ad-2ccd-43c1-a75e-db2cf20b8ade None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:36.516688 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c233ecc-4738-40b8-9fc1-b2fbada8a7f7 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:36.556799 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e2c6b-bee7-487a-a2cc-8ad6840fbbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:36.558015 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e2c6b-bee7-487a-a2cc-8ad6840fbbdc None admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:36.558568 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e2c6b-bee7-487a-a2cc-8ad6840fbbdc None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:36.559123 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e2c6b-bee7-487a-a2cc-8ad6840fbbdc None admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:36.560109 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e2c6b-bee7-487a-a2cc-8ad6840fbbdc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:36.562645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e2c6b-bee7-487a-a2cc-8ad6840fbbdc None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:36.576357 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:36.625675 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040466ad-2ccd-43c1-a75e-db2cf20b8ade None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:36.672091 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 501/1013] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Sep 6 20:07:36 2022] POST /identity/v3/projects => generated 311 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:07:36.675546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5a64a-981e-4b0d-9eed-f0a09e6eca3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:36.676251 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5a64a-981e-4b0d-9eed-f0a09e6eca3f None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:36.676539 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5a64a-981e-4b0d-9eed-f0a09e6eca3f None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:36.676810 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5a64a-981e-4b0d-9eed-f0a09e6eca3f None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:36.677512 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5a64a-981e-4b0d-9eed-f0a09e6eca3f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:36.679196 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5a64a-981e-4b0d-9eed-f0a09e6eca3f None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:36.774495 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dd791-e02f-436f-8066-10f83e49a37b None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:36.774810 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dd791-e02f-436f-8066-10f83e49a37b None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:36.775049 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dd791-e02f-436f-8066-10f83e49a37b None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:36.776689 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 502/1014] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:07:36.784078 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e39fc-d8da-4226-89dc-0ecb25d9fd97 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:36.784435 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e39fc-d8da-4226-89dc-0ecb25d9fd97 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:36.784745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e39fc-d8da-4226-89dc-0ecb25d9fd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:36.805460 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-986e39fc-d8da-4226-89dc-0ecb25d9fd97 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:36.806729 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-986e39fc-d8da-4226-89dc-0ecb25d9fd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:36.884473 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 503/1015] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:36 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 20:07:36.960954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 513/1016] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Sep 6 20:07:36 2022] POST /identity/v3/services => generated 242 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:07:37.166269 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e39fc-d8da-4226-89dc-0ecb25d9fd97 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:37.274865 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e39fc-d8da-4226-89dc-0ecb25d9fd97 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:37.300802 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:37.321557 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5944d8-10ab-48ad-b66e-49666651ad82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:37.322206 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5944d8-10ab-48ad-b66e-49666651ad82 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:37.322483 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5944d8-10ab-48ad-b66e-49666651ad82 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:37.322754 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5944d8-10ab-48ad-b66e-49666651ad82 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:37.323348 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5944d8-10ab-48ad-b66e-49666651ad82 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:37.324802 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5944d8-10ab-48ad-b66e-49666651ad82 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:37.334951 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-6d5944d8-10ab-48ad-b66e-49666651ad82 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 20:07:37.334951 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:37.334951 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 20:07:37.334951 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 20:07:37.334951 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 20:07:37.334951 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 20:07:37.334951 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 20:07:37.334951 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:37.334951 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 20:07:37.334951 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:37.334951 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:07:37.334951 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:37.334951 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:37.334951 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:37.334951 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:37.334951 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:37.334951 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:37.336378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:37.336378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:37.336378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:37.336378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:37.336378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:37.336378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:37.336378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 20:07:37.336378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 20:07:37.336378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 20:07:37.336378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 20:07:37.336378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:37.336378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:37.336378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:37.336378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:37.336378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:37.336378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:37.337325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:37.337325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:37.337325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:37.337325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:37.337325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:37.337325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:37.337325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:37.337325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:37.337325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:37.337325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:37.337325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 20:07:37.337325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:37.337325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 20:07:37.337325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:37.337325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 504/1017] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:07:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:37.345687 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5a64a-981e-4b0d-9eed-f0a09e6eca3f None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:37.415902 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:37.470139 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5a64a-981e-4b0d-9eed-f0a09e6eca3f None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:37.509625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95654395-1065-4f80-9fcc-94e19932d259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:37.510248 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95654395-1065-4f80-9fcc-94e19932d259 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:37.510525 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95654395-1065-4f80-9fcc-94e19932d259 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:37.510797 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95654395-1065-4f80-9fcc-94e19932d259 None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:37.511455 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95654395-1065-4f80-9fcc-94e19932d259 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:37.511985 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95654395-1065-4f80-9fcc-94e19932d259 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:37.513256 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95654395-1065-4f80-9fcc-94e19932d259 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:37.524416 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 514/1018] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Sep 6 20:07:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:37.525438 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5944d8-10ab-48ad-b66e-49666651ad82 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:37.637827 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5944d8-10ab-48ad-b66e-49666651ad82 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:37.673263 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3efee1-b4d2-40cf-b31e-704777b86986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:37.673874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3efee1-b4d2-40cf-b31e-704777b86986 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:37.674152 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3efee1-b4d2-40cf-b31e-704777b86986 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:37.674421 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3efee1-b4d2-40cf-b31e-704777b86986 None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:37.675050 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3efee1-b4d2-40cf-b31e-704777b86986 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:37.675353 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3efee1-b4d2-40cf-b31e-704777b86986 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:37.676744 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3efee1-b4d2-40cf-b31e-704777b86986 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:37.687186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 505/1019] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Sep 6 20:07:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:37.688248 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95654395-1065-4f80-9fcc-94e19932d259 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:37.803601 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95654395-1065-4f80-9fcc-94e19932d259 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:37.832395 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:37.846960 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2b10f-1223-4af5-ac90-a3a43b849eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:37.856978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2b10f-1223-4af5-ac90-a3a43b849eb7 None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:37.856978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2b10f-1223-4af5-ac90-a3a43b849eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:37.856978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2b10f-1223-4af5-ac90-a3a43b849eb7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:37.856978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2b10f-1223-4af5-ac90-a3a43b849eb7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:37.856978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2b10f-1223-4af5-ac90-a3a43b849eb7 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:37.960638 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 515/1020] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:07:37 2022] POST /identity/v3/endpoints => generated 334 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:07:38.964220 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda624a0-e8d9-49f1-af51-13ba1c76ac56 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:38.964781 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda624a0-e8d9-49f1-af51-13ba1c76ac56 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:38.965100 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda624a0-e8d9-49f1-af51-13ba1c76ac56 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:38.967479 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 506/1021] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:38.975554 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca97932-3890-4b35-8e57-48440b9d22bd None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:38.976105 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca97932-3890-4b35-8e57-48440b9d22bd None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:38.976378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca97932-3890-4b35-8e57-48440b9d22bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:39.001794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-8ca97932-3890-4b35-8e57-48440b9d22bd None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:39.004322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-8ca97932-3890-4b35-8e57-48440b9d22bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:39.111560 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 516/1022] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:07:39.179737 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b52a5c-e0cc-4253-a5e7-668a6851cec9 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:39.180085 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b52a5c-e0cc-4253-a5e7-668a6851cec9 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:39.180278 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b52a5c-e0cc-4253-a5e7-668a6851cec9 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:39.181758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 507/1023] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:39.187601 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1493f6-db97-4d12-bd43-c1e3bb7f4dcd None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:39.187892 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1493f6-db97-4d12-bd43-c1e3bb7f4dcd None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:39.188164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1493f6-db97-4d12-bd43-c1e3bb7f4dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:39.207263 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-6d1493f6-db97-4d12-bd43-c1e3bb7f4dcd None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:39.208933 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-6d1493f6-db97-4d12-bd43-c1e3bb7f4dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:39.307580 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 517/1024] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:07:39.385323 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b52a5c-e0cc-4253-a5e7-668a6851cec9 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:39.447145 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:39.503397 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b52a5c-e0cc-4253-a5e7-668a6851cec9 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:39.537494 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0142bd7-03ec-4ab1-9e20-3eeee678445b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:39.538122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0142bd7-03ec-4ab1-9e20-3eeee678445b None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:39.538398 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0142bd7-03ec-4ab1-9e20-3eeee678445b None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:39.538665 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0142bd7-03ec-4ab1-9e20-3eeee678445b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:39.539798 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0142bd7-03ec-4ab1-9e20-3eeee678445b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:39.541219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0142bd7-03ec-4ab1-9e20-3eeee678445b None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:39.542940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 508/1025] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:39.549286 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1493f6-db97-4d12-bd43-c1e3bb7f4dcd None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:39.582817 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0142bd7-03ec-4ab1-9e20-3eeee678445b None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:39.584595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:39.664599 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1493f6-db97-4d12-bd43-c1e3bb7f4dcd None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:39.692468 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0142bd7-03ec-4ab1-9e20-3eeee678445b None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:39.705527 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9128f-db79-40d2-a857-d2cf061b3c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:39.706137 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9128f-db79-40d2-a857-d2cf061b3c1f None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:39.706413 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9128f-db79-40d2-a857-d2cf061b3c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:39.706679 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9128f-db79-40d2-a857-d2cf061b3c1f None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:39.707394 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9128f-db79-40d2-a857-d2cf061b3c1f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:39.708838 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9128f-db79-40d2-a857-d2cf061b3c1f None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:39.710911 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:39.733370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbd7f6-cd2b-47f7-97f2-9b4ac41960f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:39.734003 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbd7f6-cd2b-47f7-97f2-9b4ac41960f2 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:39.734273 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbd7f6-cd2b-47f7-97f2-9b4ac41960f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:39.734537 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbd7f6-cd2b-47f7-97f2-9b4ac41960f2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:39.735111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbd7f6-cd2b-47f7-97f2-9b4ac41960f2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:39.736496 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbd7f6-cd2b-47f7-97f2-9b4ac41960f2 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:39.745581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-16cbd7f6-cd2b-47f7-97f2-9b4ac41960f2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 20:07:39.745581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:39.745581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 20:07:39.745581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 20:07:39.745581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 20:07:39.745581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 20:07:39.745581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 20:07:39.745581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:39.745581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 20:07:39.745581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:39.745581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:07:39.745581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:39.745581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:39.745581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:39.745581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:39.745581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:39.745581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:39.746758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:39.746758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:39.746758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:39.746758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:39.746758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:39.746758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:39.746758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 20:07:39.746758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 20:07:39.746758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 20:07:39.746758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 20:07:39.746758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:39.746758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:39.746758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:39.746758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:39.746758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:39.746758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:39.751117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:39.751117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:39.751117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:39.751117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:39.751117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:39.751117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:39.751117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:39.751117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:39.751117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:39.751117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:39.751117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 20:07:39.751117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:39.751117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 20:07:39.751117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:39.751117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 509/1026] 10.222.0.77 () {56 vars in 1105 bytes} [Tue Sep 6 20:07:39 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:07:39.752883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbd7f6-cd2b-47f7-97f2-9b4ac41960f2 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:39.867602 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 518/1027] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Sep 6 20:07:39 2022] POST /identity/v3/users => generated 285 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:07:39.867847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbd7f6-cd2b-47f7-97f2-9b4ac41960f2 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:39.909457 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f44b4b-583f-432e-8608-b90c6c703d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:39.910094 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f44b4b-583f-432e-8608-b90c6c703d9b None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:39.910371 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f44b4b-583f-432e-8608-b90c6c703d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:39.910670 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f44b4b-583f-432e-8608-b90c6c703d9b None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:39.911406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f44b4b-583f-432e-8608-b90c6c703d9b None admin] RBAC: Adding query filter params (name=image) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:39.911762 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f44b4b-583f-432e-8608-b90c6c703d9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:39.913364 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f44b4b-583f-432e-8608-b90c6c703d9b None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:39.919418 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 510/1028] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:39.925845 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9128f-db79-40d2-a857-d2cf061b3c1f None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:40.033759 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:40.050290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9128f-db79-40d2-a857-d2cf061b3c1f None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:40.088459 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e101d7-2bad-49eb-8441-c0b98b294113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:40.089076 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e101d7-2bad-49eb-8441-c0b98b294113 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:40.089345 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e101d7-2bad-49eb-8441-c0b98b294113 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:40.089612 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e101d7-2bad-49eb-8441-c0b98b294113 None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:40.090238 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e101d7-2bad-49eb-8441-c0b98b294113 None admin] RBAC: Adding query filter params (type=image) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:40.090540 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e101d7-2bad-49eb-8441-c0b98b294113 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:40.091990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e101d7-2bad-49eb-8441-c0b98b294113 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:40.097611 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 519/1029] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:40.103302 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f44b4b-583f-432e-8608-b90c6c703d9b None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:40.153106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:40.217344 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f44b4b-583f-432e-8608-b90c6c703d9b None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:40.254347 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8eaf0-429b-4968-a8ca-6bbd36cc0c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:40.255146 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8eaf0-429b-4968-a8ca-6bbd36cc0c06 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:40.255589 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8eaf0-429b-4968-a8ca-6bbd36cc0c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:40.255989 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8eaf0-429b-4968-a8ca-6bbd36cc0c06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:40.256876 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8eaf0-429b-4968-a8ca-6bbd36cc0c06 None admin] RBAC: Adding query filter params (interface=public, service_id=d520e230aa434f4e880e86a9dd0129d2, region_id=RegionOne) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:40.257311 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8eaf0-429b-4968-a8ca-6bbd36cc0c06 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:40.268262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8eaf0-429b-4968-a8ca-6bbd36cc0c06 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:40.274457 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 511/1030] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Sep 6 20:07:40 2022] GET /identity/v3/endpoints?service_id=d520e230aa434f4e880e86a9dd0129d2&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:40.279920 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e101d7-2bad-49eb-8441-c0b98b294113 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:40.310309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a40b1b-822e-40fc-99df-cf9b03bf3b07 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:40.311243 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a40b1b-822e-40fc-99df-cf9b03bf3b07 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:40.311422 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a40b1b-822e-40fc-99df-cf9b03bf3b07 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:40.312830 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 512/1031] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:07:40.318255 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2089268-ae7a-494e-9394-3600248a0916 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:40.318544 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2089268-ae7a-494e-9394-3600248a0916 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:40.318758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2089268-ae7a-494e-9394-3600248a0916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:40.338061 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-b2089268-ae7a-494e-9394-3600248a0916 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:40.339289 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-b2089268-ae7a-494e-9394-3600248a0916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:40.393886 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e101d7-2bad-49eb-8441-c0b98b294113 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:40.427825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 513/1032] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 20:07:40.433689 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3c855-f066-4a2e-a210-5c5256b7230f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:40.434395 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3c855-f066-4a2e-a210-5c5256b7230f None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:40.434838 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3c855-f066-4a2e-a210-5c5256b7230f None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:40.435214 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3c855-f066-4a2e-a210-5c5256b7230f None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:40.436030 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3c855-f066-4a2e-a210-5c5256b7230f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:40.437531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3c855-f066-4a2e-a210-5c5256b7230f None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:40.444915 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 520/1033] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Sep 6 20:07:40 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:07:40.694035 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2089268-ae7a-494e-9394-3600248a0916 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:40.743406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:40.827167 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2089268-ae7a-494e-9394-3600248a0916 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:40.868818 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee26e47-039f-4c63-abc9-60c5ffba426b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:40.869861 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee26e47-039f-4c63-abc9-60c5ffba426b None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:40.870363 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee26e47-039f-4c63-abc9-60c5ffba426b None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:40.870847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee26e47-039f-4c63-abc9-60c5ffba426b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:40.884444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee26e47-039f-4c63-abc9-60c5ffba426b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:07:40.890355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-dee26e47-039f-4c63-abc9-60c5ffba426b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 20:07:40.890355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:40.890355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:40.890355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:40.890355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:40.890355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:40.890355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:40.890355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:40.890355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:40.890355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:40.890355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:40.890355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:40.890355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:07:40.890355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:07:40.890355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:07:40.890355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:07:40.891332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:07:40.891332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:07:40.891332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:07:40.891332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:07:40.891332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:40.891332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:40.891332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:40.891332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:40.891332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:40.891332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:40.891332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:40.891332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:40.891332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:40.891332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:40.891332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:40.891332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:40.892266 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:40.892266 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:40.892266 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:40.892266 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:40.892266 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:07:40.892266 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:07:40.892266 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:07:40.892266 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:07:40.892266 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:07:40.892266 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:07:40.892266 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 20:07:40.892266 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:40.892950 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 514/1034] 10.222.0.77 () {56 vars in 1120 bytes} [Tue Sep 6 20:07:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:40.899236 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3c855-f066-4a2e-a210-5c5256b7230f None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:40.921193 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:41.034284 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3c855-f066-4a2e-a210-5c5256b7230f None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:41.085230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228a98c-5129-43bf-acde-90630f0f5cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:41.085887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228a98c-5129-43bf-acde-90630f0f5cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:41.086201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228a98c-5129-43bf-acde-90630f0f5cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:41.086429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228a98c-5129-43bf-acde-90630f0f5cf8 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:41.087328 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228a98c-5129-43bf-acde-90630f0f5cf8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:41.087687 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228a98c-5129-43bf-acde-90630f0f5cf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:41.089589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228a98c-5129-43bf-acde-90630f0f5cf8 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:41.103922 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 521/1035] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Sep 6 20:07:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:41.111684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee26e47-039f-4c63-abc9-60c5ffba426b None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:41.239610 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:41.245389 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee26e47-039f-4c63-abc9-60c5ffba426b None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:41.285882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d00970-1718-4fa9-9075-f7a2591b818a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:41.286430 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d00970-1718-4fa9-9075-f7a2591b818a None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:41.286707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d00970-1718-4fa9-9075-f7a2591b818a None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:41.286973 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d00970-1718-4fa9-9075-f7a2591b818a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:41.298267 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d00970-1718-4fa9-9075-f7a2591b818a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:41.299759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d00970-1718-4fa9-9075-f7a2591b818a None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:41.316882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-d1d00970-1718-4fa9-9075-f7a2591b818a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:41.316882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:41.316882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:41.316882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:41.316882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:41.316882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:41.316882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:41.316882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:41.316882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:41.316882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:41.316882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:41.316882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:41.316882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:07:41.316882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:07:41.316882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:07:41.316882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:07:41.317911 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:41.317911 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:41.317911 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:41.317911 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:41.317911 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:41.317911 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:41.317911 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:41.317911 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:41.317911 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:41.317911 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:41.317911 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:41.317911 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:41.317911 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:41.317911 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:41.317911 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:41.317911 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:41.317911 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:07:41.319407 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:07:41.319407 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:41.319407 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:41.319407 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 515/1036] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:41.323929 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228a98c-5129-43bf-acde-90630f0f5cf8 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:41.417988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:41.458496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228a98c-5129-43bf-acde-90630f0f5cf8 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:41.496157 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0b64d-18f0-4e90-89a5-bbf72f7c80ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:41.497014 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0b64d-18f0-4e90-89a5-bbf72f7c80ae None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:41.497477 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0b64d-18f0-4e90-89a5-bbf72f7c80ae None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:41.498405 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0b64d-18f0-4e90-89a5-bbf72f7c80ae None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:41.499182 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0b64d-18f0-4e90-89a5-bbf72f7c80ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:41.499659 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0b64d-18f0-4e90-89a5-bbf72f7c80ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:41.501447 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0b64d-18f0-4e90-89a5-bbf72f7c80ae None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:41.519180 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 522/1037] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:41.520923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d00970-1718-4fa9-9075-f7a2591b818a None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:41.631060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d00970-1718-4fa9-9075-f7a2591b818a None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:41.666964 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad55a2-7826-46cb-babb-35d727a233da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:41.667699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad55a2-7826-46cb-babb-35d727a233da None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:41.667932 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad55a2-7826-46cb-babb-35d727a233da None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:41.668203 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad55a2-7826-46cb-babb-35d727a233da None admin] PATH_INFO: `/v3/users/nova` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:41.677589 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad55a2-7826-46cb-babb-35d727a233da None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:41.679556 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad55a2-7826-46cb-babb-35d727a233da None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:41.693872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-f0ad55a2-7826-46cb-babb-35d727a233da None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 20:07:41.693872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:41.693872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:41.693872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:41.693872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:41.693872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:41.693872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:41.693872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:41.693872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:41.693872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:41.693872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:41.693872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:41.693872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:07:41.693872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:07:41.693872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:07:41.693872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:07:41.694923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:41.694923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:41.694923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:07:41.694923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:41.694923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:07:41.694923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:41.694923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:41.694923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:41.694923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:41.694923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:41.694923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:41.694923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:41.694923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:41.694923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:41.694923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:41.694923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:41.694923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:41.694923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:41.696541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:41.696541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:41.696541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:07:41.696541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:07:41.696541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:07:41.696541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:07:41.696541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:07:41.696541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:07:41.696541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 20:07:41.696541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:41.699776 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 516/1038] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Sep 6 20:07:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:41.701762 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0b64d-18f0-4e90-89a5-bbf72f7c80ae None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:41.810629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0b64d-18f0-4e90-89a5-bbf72f7c80ae None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:41.860791 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c91bd6-eacc-4c2a-bb91-481258a6d363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:41.861471 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c91bd6-eacc-4c2a-bb91-481258a6d363 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:41.861753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c91bd6-eacc-4c2a-bb91-481258a6d363 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:41.862073 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c91bd6-eacc-4c2a-bb91-481258a6d363 None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:41.862942 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c91bd6-eacc-4c2a-bb91-481258a6d363 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:41.863300 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c91bd6-eacc-4c2a-bb91-481258a6d363 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:41.865665 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c91bd6-eacc-4c2a-bb91-481258a6d363 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:41.875489 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:41.916118 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 523/1039] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Sep 6 20:07:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:41.916326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad55a2-7826-46cb-babb-35d727a233da None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:41.916326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:42.009457 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad55a2-7826-46cb-babb-35d727a233da None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:42.045528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcf47f-f3a2-4269-838f-fccb421ac8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:42.046134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcf47f-f3a2-4269-838f-fccb421ac8fb None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:42.046409 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcf47f-f3a2-4269-838f-fccb421ac8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:42.046684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcf47f-f3a2-4269-838f-fccb421ac8fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:42.131669 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcf47f-f3a2-4269-838f-fccb421ac8fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:42.134411 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcf47f-f3a2-4269-838f-fccb421ac8fb None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:42.153315 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:42.190089 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6d7c5-24f9-4848-bd59-7450c6154118 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:42.190623 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6d7c5-24f9-4848-bd59-7450c6154118 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:42.190623 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6d7c5-24f9-4848-bd59-7450c6154118 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:42.191939 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 524/1040] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:07:42.197063 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9ca56-1224-4e89-a8bd-399d2dee20c7 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:42.197351 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9ca56-1224-4e89-a8bd-399d2dee20c7 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:42.197627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9ca56-1224-4e89-a8bd-399d2dee20c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:42.217713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-86e9ca56-1224-4e89-a8bd-399d2dee20c7 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:42.218925 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-86e9ca56-1224-4e89-a8bd-399d2dee20c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:42.256862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 517/1041] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:07:41 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 20:07:42.262374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcf47f-f3a2-4269-838f-fccb421ac8fb None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:42.294234 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 525/1042] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 20:07:42.376564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcf47f-f3a2-4269-838f-fccb421ac8fb None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:42.387241 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:42.413859 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4281b2b-d460-4f00-88d0-26d492280b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:42.414503 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4281b2b-d460-4f00-88d0-26d492280b42 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:42.414784 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4281b2b-d460-4f00-88d0-26d492280b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:42.415058 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4281b2b-d460-4f00-88d0-26d492280b42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:42.426673 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4281b2b-d460-4f00-88d0-26d492280b42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:42.428337 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4281b2b-d460-4f00-88d0-26d492280b42 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:42.444390 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-e4281b2b-d460-4f00-88d0-26d492280b42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:42.444390 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:42.444390 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:42.444390 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:42.444390 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:42.444390 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:42.444390 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:42.444390 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:42.444390 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:42.444390 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:42.444390 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:42.444390 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:42.444390 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:07:42.444390 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:07:42.444390 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:07:42.444390 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:07:42.445372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:42.445372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:42.445372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:42.445372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:42.445372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:42.445372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:42.445372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:42.445372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:42.445372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:42.445372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:42.445372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:42.445372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:42.445372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:42.445372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:42.445372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:42.445372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:42.445372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:07:42.446254 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:07:42.446254 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:42.446254 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:42.447791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 518/1043] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:07:42.451284 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9ca56-1224-4e89-a8bd-399d2dee20c7 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:42.565123 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4281b2b-d460-4f00-88d0-26d492280b42 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:42.565330 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9ca56-1224-4e89-a8bd-399d2dee20c7 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:42.595224 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:42.605747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1e188-8444-46ac-b743-2b6a46fcb33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:42.606625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1e188-8444-46ac-b743-2b6a46fcb33c None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:42.607063 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1e188-8444-46ac-b743-2b6a46fcb33c None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:42.608078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1e188-8444-46ac-b743-2b6a46fcb33c None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:42.609038 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1e188-8444-46ac-b743-2b6a46fcb33c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:42.609514 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1e188-8444-46ac-b743-2b6a46fcb33c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:42.610898 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1e188-8444-46ac-b743-2b6a46fcb33c None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:42.628592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 526/1044] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:42.629707 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1e188-8444-46ac-b743-2b6a46fcb33c None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:42.684924 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4281b2b-d460-4f00-88d0-26d492280b42 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:42.719352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce8c94-a73a-4b5d-9017-243cdc55ad3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:42.719943 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce8c94-a73a-4b5d-9017-243cdc55ad3a None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:42.720216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce8c94-a73a-4b5d-9017-243cdc55ad3a None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:42.720485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce8c94-a73a-4b5d-9017-243cdc55ad3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:42.731207 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce8c94-a73a-4b5d-9017-243cdc55ad3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:07:42.736591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-81ce8c94-a73a-4b5d-9017-243cdc55ad3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:07:42.736591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:42.736591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:42.736591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:42.736591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:42.736591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:42.736591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:42.736591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:42.736591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:42.736591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:42.736591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:42.736591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:42.736591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:07:42.736591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:07:42.736591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:07:42.736591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:07:42.737733 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:07:42.737733 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:07:42.737733 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:07:42.737733 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:07:42.737733 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:42.737733 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:42.737733 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:42.737733 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:42.737733 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:42.737733 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:42.737733 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:42.737733 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:42.737733 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:42.737733 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:42.737733 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:42.737733 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:42.740565 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:42.740565 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:42.740565 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:42.740565 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:42.740565 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:07:42.740565 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:07:42.740565 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:07:42.740565 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:07:42.740565 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:07:42.740565 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:07:42.740565 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:07:42.740565 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:42.741230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1e188-8444-46ac-b743-2b6a46fcb33c None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:42.741307 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 519/1045] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:07:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:07:42.741307 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83200fde-3734-4fc4-b1a4-a82b19e0e184 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:42.741307 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83200fde-3734-4fc4-b1a4-a82b19e0e184 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:42.741307 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83200fde-3734-4fc4-b1a4-a82b19e0e184 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:42.741307 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 520/1046] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:42.744332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83200fde-3734-4fc4-b1a4-a82b19e0e184 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:42.766926 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:42.775488 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2eb2c4-8b22-4f82-82b9-36cd1c68f066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:42.776136 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2eb2c4-8b22-4f82-82b9-36cd1c68f066 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:42.778067 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2eb2c4-8b22-4f82-82b9-36cd1c68f066 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:42.778067 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2eb2c4-8b22-4f82-82b9-36cd1c68f066 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:42.784642 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2eb2c4-8b22-4f82-82b9-36cd1c68f066 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:42.786132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2eb2c4-8b22-4f82-82b9-36cd1c68f066 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:42.798729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-ea2eb2c4-8b22-4f82-82b9-36cd1c68f066 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:42.798729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:42.798729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:42.798729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:42.798729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:42.798729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:42.798729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:42.798729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:42.798729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:42.798729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:42.798729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:42.798729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:42.798729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:07:42.798729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:07:42.798729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:07:42.799947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:07:42.799947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:42.799947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:42.799947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:42.799947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:42.799947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:42.799947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:42.799947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:42.799947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:42.799947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:42.799947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:42.799947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:42.799947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:42.799947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:42.799947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:42.799947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:42.799947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:42.800868 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:07:42.800868 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:07:42.800868 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:07:42.800868 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:07:42.800868 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:07:42.800868 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:07:42.800868 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:42.800868 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:42.800868 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 527/1047] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:07:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:42.801557 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5737a-40e1-48b6-a6f9-7a9a156ff577 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:42.801848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5737a-40e1-48b6-a6f9-7a9a156ff577 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:42.802093 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5737a-40e1-48b6-a6f9-7a9a156ff577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:42.822195 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-7bd5737a-40e1-48b6-a6f9-7a9a156ff577 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:42.823400 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-7bd5737a-40e1-48b6-a6f9-7a9a156ff577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:42.854028 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83200fde-3734-4fc4-b1a4-a82b19e0e184 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:42.869186 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:42.890912 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94e274-82b2-4b50-af48-2538f177eb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:42.891535 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94e274-82b2-4b50-af48-2538f177eb97 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:42.891809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94e274-82b2-4b50-af48-2538f177eb97 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:42.892077 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94e274-82b2-4b50-af48-2538f177eb97 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:42.892727 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94e274-82b2-4b50-af48-2538f177eb97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:42.893022 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94e274-82b2-4b50-af48-2538f177eb97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:42.894369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94e274-82b2-4b50-af48-2538f177eb97 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:42.894889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 528/1048] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:07:42.895963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5737a-40e1-48b6-a6f9-7a9a156ff577 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:42.911703 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 521/1049] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:07:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:42.917566 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94e274-82b2-4b50-af48-2538f177eb97 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:43.013314 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5737a-40e1-48b6-a6f9-7a9a156ff577 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:43.014926 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:43.035735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94e274-82b2-4b50-af48-2538f177eb97 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:43.053779 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c972ea0-ae99-4e32-a42e-b487d52a1d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:43.054504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c972ea0-ae99-4e32-a42e-b487d52a1d91 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:43.054782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c972ea0-ae99-4e32-a42e-b487d52a1d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:43.055141 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c972ea0-ae99-4e32-a42e-b487d52a1d91 None admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:43.055874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c972ea0-ae99-4e32-a42e-b487d52a1d91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:43.056186 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c972ea0-ae99-4e32-a42e-b487d52a1d91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:43.057704 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c972ea0-ae99-4e32-a42e-b487d52a1d91 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:43.073329 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 529/1050] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:07:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:43.080086 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f284e-3fb7-473d-b4cd-5229af412385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:43.080290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c972ea0-ae99-4e32-a42e-b487d52a1d91 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:43.080818 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f284e-3fb7-473d-b4cd-5229af412385 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:43.081100 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f284e-3fb7-473d-b4cd-5229af412385 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:43.081369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f284e-3fb7-473d-b4cd-5229af412385 None admin] PATH_INFO: `/v3/users/e9251ec85fd44d28acafb82385774734` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:43.097197 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f284e-3fb7-473d-b4cd-5229af412385 None admin] RBAC: Authorizing `identity:get_user(user_id=e9251ec85fd44d28acafb82385774734)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:43.098624 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f284e-3fb7-473d-b4cd-5229af412385 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:43.100392 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 522/1051] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:07:42 2022] GET /identity/v3/users/e9251ec85fd44d28acafb82385774734 => generated 285 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:43.106207 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f284e-3fb7-473d-b4cd-5229af412385 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:43.127347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:43.198800 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c972ea0-ae99-4e32-a42e-b487d52a1d91 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:43.216434 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f284e-3fb7-473d-b4cd-5229af412385 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:43.235130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc672b-fb3c-4b99-b2c5-f0e7b7776cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:43.235770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc672b-fb3c-4b99-b2c5-f0e7b7776cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:43.236048 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc672b-fb3c-4b99-b2c5-f0e7b7776cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:43.236316 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc672b-fb3c-4b99-b2c5-f0e7b7776cb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:43.237039 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc672b-fb3c-4b99-b2c5-f0e7b7776cb7 None admin] RBAC: Adding query filter params (role.id=82691a07001644e48564ddf52dcdfb89, scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343, user.id=b09ce16da49b4af38491ad4eb6287d70) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:43.237370 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc672b-fb3c-4b99-b2c5-f0e7b7776cb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:43.238781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc672b-fb3c-4b99-b2c5-f0e7b7776cb7 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:43.244380 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 530/1052] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:07:43 2022] GET /identity/v3/role_assignments?user.id=b09ce16da49b4af38491ad4eb6287d70&scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343&role.id=82691a07001644e48564ddf52dcdfb89 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:43.245019 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc672b-fb3c-4b99-b2c5-f0e7b7776cb7 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:43.251405 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332af72-acaa-4310-bb57-47bca0f39570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:43.252074 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332af72-acaa-4310-bb57-47bca0f39570 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:43.252357 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332af72-acaa-4310-bb57-47bca0f39570 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:43.252629 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332af72-acaa-4310-bb57-47bca0f39570 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:43.266465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:43.344529 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332af72-acaa-4310-bb57-47bca0f39570 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:43.346097 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332af72-acaa-4310-bb57-47bca0f39570 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:43.372216 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:43.375403 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc672b-fb3c-4b99-b2c5-f0e7b7776cb7 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:43.419054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a27f4f-64ff-49dc-b031-8864f45c524a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:43.420018 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a27f4f-64ff-49dc-b031-8864f45c524a None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:43.420592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a27f4f-64ff-49dc-b031-8864f45c524a None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:43.420766 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a27f4f-64ff-49dc-b031-8864f45c524a None admin] PATH_INFO: `/v3/services/image` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:43.421367 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a27f4f-64ff-49dc-b031-8864f45c524a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:43.422802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a27f4f-64ff-49dc-b031-8864f45c524a None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:43.432858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-f1a27f4f-64ff-49dc-b031-8864f45c524a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 20:07:43.432858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:43.432858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 20:07:43.432858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 20:07:43.432858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 20:07:43.432858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 20:07:43.432858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 20:07:43.432858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:43.432858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 20:07:43.432858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:43.432858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:07:43.432858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:43.432858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:43.432858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:43.432858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:43.432858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:43.432858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:43.433904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:43.433904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:43.433904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:43.433904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:43.433904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:43.433904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:43.433904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 20:07:43.433904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 20:07:43.433904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 20:07:43.433904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 20:07:43.433904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:43.433904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:43.433904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:43.433904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:43.433904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:43.433904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:43.434751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:43.434751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:43.434751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:43.434751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:43.434751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:43.434751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:43.434751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:43.434751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:43.434751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:43.434751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:43.434751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 20:07:43.434751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:07:43.434751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 20:07:43.434751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:43.434751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 531/1053] 10.222.0.77 () {56 vars in 1105 bytes} [Tue Sep 6 20:07:43 2022] GET /identity/v3/services/image => generated 86 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:43.440735 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a27f4f-64ff-49dc-b031-8864f45c524a None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:43.482758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 523/1054] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:07:43 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 06 20:07:43.489235 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332af72-acaa-4310-bb57-47bca0f39570 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:43.541016 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:43.582041 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a27f4f-64ff-49dc-b031-8864f45c524a None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:43.609207 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332af72-acaa-4310-bb57-47bca0f39570 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:43.617646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378d68a-b57f-42a0-8148-d9f8799d8ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:43.618381 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378d68a-b57f-42a0-8148-d9f8799d8ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:43.618660 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378d68a-b57f-42a0-8148-d9f8799d8ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:43.618928 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378d68a-b57f-42a0-8148-d9f8799d8ed0 None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:43.619868 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378d68a-b57f-42a0-8148-d9f8799d8ed0 None admin] RBAC: Adding query filter params (name=image) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:43.619868 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378d68a-b57f-42a0-8148-d9f8799d8ed0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:43.621228 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378d68a-b57f-42a0-8148-d9f8799d8ed0 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:43.632103 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 532/1055] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:43.632870 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378d68a-b57f-42a0-8148-d9f8799d8ed0 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:43.649656 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f125d-1e9b-4a6b-a62d-70328712b3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:43.650292 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f125d-1e9b-4a6b-a62d-70328712b3f6 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:43.650574 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f125d-1e9b-4a6b-a62d-70328712b3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:43.650847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f125d-1e9b-4a6b-a62d-70328712b3f6 None admin] PATH_INFO: `/v3/projects/68969f60034f41ac9d7fda46e9ce8505` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:43.652018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f125d-1e9b-4a6b-a62d-70328712b3f6 None admin] RBAC: Authorizing `identity:get_project(project_id=68969f60034f41ac9d7fda46e9ce8505)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:43.653428 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f125d-1e9b-4a6b-a62d-70328712b3f6 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:43.655102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 524/1056] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:07:43 2022] GET /identity/v3/projects/68969f60034f41ac9d7fda46e9ce8505 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:43.662000 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f125d-1e9b-4a6b-a62d-70328712b3f6 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:43.664648 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:43.747410 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378d68a-b57f-42a0-8148-d9f8799d8ed0 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:43.774331 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f125d-1e9b-4a6b-a62d-70328712b3f6 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:43.785177 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:43.787409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdc0d7-7eba-4c7f-84ed-1bdb980524d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:43.788052 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdc0d7-7eba-4c7f-84ed-1bdb980524d3 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:43.788336 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdc0d7-7eba-4c7f-84ed-1bdb980524d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:43.788606 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdc0d7-7eba-4c7f-84ed-1bdb980524d3 None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:43.789239 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdc0d7-7eba-4c7f-84ed-1bdb980524d3 None admin] RBAC: Adding query filter params (type=image) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:43.789690 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdc0d7-7eba-4c7f-84ed-1bdb980524d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:43.790921 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdc0d7-7eba-4c7f-84ed-1bdb980524d3 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:43.797594 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 533/1057] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:43.803706 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdc0d7-7eba-4c7f-84ed-1bdb980524d3 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:43.813625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a23ee-b899-451d-8336-1b1e0b660ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:43.814241 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a23ee-b899-451d-8336-1b1e0b660ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:43.820612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a23ee-b899-451d-8336-1b1e0b660ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:43.820612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a23ee-b899-451d-8336-1b1e0b660ce7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:43.820612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a23ee-b899-451d-8336-1b1e0b660ce7 None admin] RBAC: Adding query filter params (role.id=1e2ac44410664e6b8f42ab3c37e2643f, scope.project.id=68969f60034f41ac9d7fda46e9ce8505, user.id=e9251ec85fd44d28acafb82385774734) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:43.820612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a23ee-b899-451d-8336-1b1e0b660ce7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:43.820612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a23ee-b899-451d-8336-1b1e0b660ce7 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:43.825103 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 525/1058] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:07:43 2022] GET /identity/v3/role_assignments?user.id=e9251ec85fd44d28acafb82385774734&scope.project.id=68969f60034f41ac9d7fda46e9ce8505&role.id=1e2ac44410664e6b8f42ab3c37e2643f => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:43.936887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:43.946875 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdc0d7-7eba-4c7f-84ed-1bdb980524d3 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:43.990841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22657b-8108-4d0a-89c1-47d8e6064975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:43.991498 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22657b-8108-4d0a-89c1-47d8e6064975 None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:43.991799 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22657b-8108-4d0a-89c1-47d8e6064975 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:43.992074 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22657b-8108-4d0a-89c1-47d8e6064975 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:43.992762 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d22657b-8108-4d0a-89c1-47d8e6064975 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:43.994163 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d22657b-8108-4d0a-89c1-47d8e6064975 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:44.109359 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 534/1059] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:07:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:07:45.443587 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d91c6-c180-4eac-9772-0c3d5277ae7f None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:45.444118 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d91c6-c180-4eac-9772-0c3d5277ae7f None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:45.444118 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d91c6-c180-4eac-9772-0c3d5277ae7f None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:45.445684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 526/1060] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:45.450747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3cff8-0bfd-4f61-8a65-ccadc5300b66 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:45.451179 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3cff8-0bfd-4f61-8a65-ccadc5300b66 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:45.451345 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3cff8-0bfd-4f61-8a65-ccadc5300b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:45.469405 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-76d3cff8-0bfd-4f61-8a65-ccadc5300b66 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:45.470634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-76d3cff8-0bfd-4f61-8a65-ccadc5300b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:45.558197 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 535/1061] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:07:45.820931 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d91c6-c180-4eac-9772-0c3d5277ae7f None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:45.930549 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d91c6-c180-4eac-9772-0c3d5277ae7f None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:45.970935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220819f-b2f0-4568-a168-3bdb0490cc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:45.971647 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220819f-b2f0-4568-a168-3bdb0490cc86 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:45.971926 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220819f-b2f0-4568-a168-3bdb0490cc86 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:45.972265 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220819f-b2f0-4568-a168-3bdb0490cc86 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:45.984590 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220819f-b2f0-4568-a168-3bdb0490cc86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:07:45.989677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-e220819f-b2f0-4568-a168-3bdb0490cc86 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 20:07:45.989677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:45.989677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:45.989677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:45.989677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:45.989677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:45.989677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:45.989677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:45.989677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:45.989677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:45.989677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:45.989677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:45.989677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:07:45.989677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:07:45.989677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:07:45.989677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:07:45.990626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:07:45.990626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:07:45.990626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:07:45.990626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:07:45.990626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:45.990626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:45.990626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:45.990626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:45.990626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:45.990626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:45.990626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:45.990626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:45.990626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:45.990626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:45.990626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:45.990626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:45.992481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:45.992481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:45.992481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:45.992481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:45.992481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:07:45.992481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:07:45.992481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:07:45.992481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:07:45.992481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:07:45.992481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:07:45.992481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 20:07:45.992481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:45.992481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 527/1062] 10.222.0.77 () {56 vars in 1120 bytes} [Tue Sep 6 20:07:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:07:45.996892 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3cff8-0bfd-4f61-8a65-ccadc5300b66 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:46.072283 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d751b-fcd6-4601-84fb-abd12364804e None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:46.072472 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d751b-fcd6-4601-84fb-abd12364804e None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:46.072778 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d751b-fcd6-4601-84fb-abd12364804e None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:46.074918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 528/1063] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:07:46.076989 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:46.080860 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707167c-8cac-4c75-bbf4-fabc36c15071 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:46.081180 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707167c-8cac-4c75-bbf4-fabc36c15071 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:46.081413 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707167c-8cac-4c75-bbf4-fabc36c15071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:46.101336 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-8707167c-8cac-4c75-bbf4-fabc36c15071 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:46.102546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-8707167c-8cac-4c75-bbf4-fabc36c15071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:46.107434 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3cff8-0bfd-4f61-8a65-ccadc5300b66 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:46.131919 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:46.147190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f6c19-abc2-4c09-8e5e-cde39753cd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:46.148238 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f6c19-abc2-4c09-8e5e-cde39753cd62 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:46.148518 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f6c19-abc2-4c09-8e5e-cde39753cd62 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:46.148885 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f6c19-abc2-4c09-8e5e-cde39753cd62 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:46.149557 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f6c19-abc2-4c09-8e5e-cde39753cd62 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:46.149860 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f6c19-abc2-4c09-8e5e-cde39753cd62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:46.151226 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f6c19-abc2-4c09-8e5e-cde39753cd62 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:46.167558 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 536/1064] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Sep 6 20:07:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:46.168442 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f6c19-abc2-4c09-8e5e-cde39753cd62 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:46.180372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 529/1065] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 20:07:46.283856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f6c19-abc2-4c09-8e5e-cde39753cd62 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:46.321997 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47643e-d761-4de2-a11f-3d53a609a706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:46.322689 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47643e-d761-4de2-a11f-3d53a609a706 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:46.322910 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47643e-d761-4de2-a11f-3d53a609a706 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:46.323176 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47643e-d761-4de2-a11f-3d53a609a706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:46.326753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:46.335802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47643e-d761-4de2-a11f-3d53a609a706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:46.337256 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47643e-d761-4de2-a11f-3d53a609a706 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:46.345694 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09908aa-572a-420d-9bbf-231616199ee3 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:46.346099 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09908aa-572a-420d-9bbf-231616199ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:46.346384 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09908aa-572a-420d-9bbf-231616199ee3 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:46.348027 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 530/1066] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:07:46.353101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb61496-2081-4bd0-a3c3-5ef4aa38c640 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:46.353385 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb61496-2081-4bd0-a3c3-5ef4aa38c640 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:46.353658 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb61496-2081-4bd0-a3c3-5ef4aa38c640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:46.353760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-4e47643e-d761-4de2-a11f-3d53a609a706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:46.353760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:46.353760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:46.353760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:46.353760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:46.353760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:46.353760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:46.353760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:46.353760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:46.353760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:46.353760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:46.353760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:46.353760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:07:46.353760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:07:46.353760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:07:46.353760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:07:46.354645 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:46.354645 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:46.354645 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:46.354645 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:46.354645 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:46.354645 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:46.354645 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:46.354645 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:46.354645 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:46.354645 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:46.354645 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:46.354645 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:46.354645 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:46.354645 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:46.354645 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:46.354645 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:46.354645 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:07:46.360553 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:07:46.360553 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:46.360553 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:46.360553 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 537/1067] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:07:46.361131 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47643e-d761-4de2-a11f-3d53a609a706 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:46.379080 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-bcb61496-2081-4bd0-a3c3-5ef4aa38c640 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:46.380372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-bcb61496-2081-4bd0-a3c3-5ef4aa38c640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:46.463884 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 531/1068] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 20:07:46.465010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb61496-2081-4bd0-a3c3-5ef4aa38c640 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:46.486651 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47643e-d761-4de2-a11f-3d53a609a706 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:46.523600 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf692d9-17a5-4a67-9677-a646465f6fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:46.524210 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf692d9-17a5-4a67-9677-a646465f6fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:46.524491 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf692d9-17a5-4a67-9677-a646465f6fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:46.524768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf692d9-17a5-4a67-9677-a646465f6fd9 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:46.525409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf692d9-17a5-4a67-9677-a646465f6fd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:46.525713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf692d9-17a5-4a67-9677-a646465f6fd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:46.527225 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf692d9-17a5-4a67-9677-a646465f6fd9 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:46.540318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 538/1069] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:46.545894 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf692d9-17a5-4a67-9677-a646465f6fd9 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:46.581703 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:46.590662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb61496-2081-4bd0-a3c3-5ef4aa38c640 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:46.605505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:46.628923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81846a-1597-47bd-8564-e8625d5e647e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:46.629576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81846a-1597-47bd-8564-e8625d5e647e None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:46.629850 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81846a-1597-47bd-8564-e8625d5e647e None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:46.630109 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81846a-1597-47bd-8564-e8625d5e647e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:46.644566 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81846a-1597-47bd-8564-e8625d5e647e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:07:46.649526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-2e81846a-1597-47bd-8564-e8625d5e647e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:07:46.649526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:46.649526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:46.649526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:46.649526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:46.649526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:46.649526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:46.649526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:46.649526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:46.649526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:46.649526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:46.649526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:46.649526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:07:46.649526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:07:46.649526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:07:46.649526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:07:46.650516 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:07:46.650516 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:07:46.650516 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:07:46.650516 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:07:46.650516 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:46.650516 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:46.650516 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:46.650516 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:46.650516 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:46.650516 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:46.650516 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:46.650516 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:46.650516 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:46.650516 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:46.650516 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:46.650516 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:46.651352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:46.651352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:46.651352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:46.651352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:46.651352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:07:46.651352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:07:46.651352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:07:46.651352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:07:46.651352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:07:46.651352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:07:46.651352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:07:46.651352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:46.651352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 532/1070] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:07:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:46.657021 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81846a-1597-47bd-8564-e8625d5e647e None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:46.671963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf692d9-17a5-4a67-9677-a646465f6fd9 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:46.708954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97ba77-1739-419d-bf17-5bad8c8c03ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:46.709576 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97ba77-1739-419d-bf17-5bad8c8c03ee None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:46.709850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97ba77-1739-419d-bf17-5bad8c8c03ee None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:46.710113 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97ba77-1739-419d-bf17-5bad8c8c03ee None admin] PATH_INFO: `/v3/users/nova` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:46.717601 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97ba77-1739-419d-bf17-5bad8c8c03ee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:46.719034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97ba77-1739-419d-bf17-5bad8c8c03ee None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:46.732029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-bb97ba77-1739-419d-bf17-5bad8c8c03ee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 20:07:46.732029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:46.732029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:46.732029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:46.732029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:46.732029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:46.732029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:46.732029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:46.732029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:46.732029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:46.732029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:46.732029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:46.732029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:07:46.732029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:07:46.732029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:07:46.732029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:07:46.733297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:46.733297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:46.733297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:07:46.733297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:46.733297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:07:46.733297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:46.733297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:46.733297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:46.733297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:46.733297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:46.733297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:46.733297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:46.733297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:46.733297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:46.733297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:46.733297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:46.733297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:46.733297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:46.734420 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:46.734420 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:46.734420 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:07:46.734420 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:07:46.734420 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:07:46.734420 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:07:46.734420 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:07:46.734420 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:07:46.734420 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 20:07:46.734420 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:46.737771 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 539/1071] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Sep 6 20:07:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:07:46.738635 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97ba77-1739-419d-bf17-5bad8c8c03ee None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:46.775555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81846a-1597-47bd-8564-e8625d5e647e None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:46.813106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f12764-bfcc-4b3c-8019-60a4d6edde06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:46.813715 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f12764-bfcc-4b3c-8019-60a4d6edde06 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:46.813999 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f12764-bfcc-4b3c-8019-60a4d6edde06 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:46.814264 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f12764-bfcc-4b3c-8019-60a4d6edde06 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:46.814960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f12764-bfcc-4b3c-8019-60a4d6edde06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:46.815279 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f12764-bfcc-4b3c-8019-60a4d6edde06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:46.816695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f12764-bfcc-4b3c-8019-60a4d6edde06 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:46.828013 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 533/1072] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:07:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:46.828013 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f12764-bfcc-4b3c-8019-60a4d6edde06 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:46.848360 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:46.852450 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97ba77-1739-419d-bf17-5bad8c8c03ee None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:46.862118 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:46.889113 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a1999-ea30-4821-a859-db104de5cced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:46.889716 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a1999-ea30-4821-a859-db104de5cced None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:46.889992 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a1999-ea30-4821-a859-db104de5cced None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:46.890259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a1999-ea30-4821-a859-db104de5cced None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:46.930739 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f12764-bfcc-4b3c-8019-60a4d6edde06 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:46.967016 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7b006-ab16-4593-8182-cdd659821b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:46.967586 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a1999-ea30-4821-a859-db104de5cced None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:46.967724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7b006-ab16-4593-8182-cdd659821b1d None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:46.967918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7b006-ab16-4593-8182-cdd659821b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:46.968438 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7b006-ab16-4593-8182-cdd659821b1d None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:46.969007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7b006-ab16-4593-8182-cdd659821b1d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:46.969313 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7b006-ab16-4593-8182-cdd659821b1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:46.969916 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a1999-ea30-4821-a859-db104de5cced None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:46.970741 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7b006-ab16-4593-8182-cdd659821b1d None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:46.989678 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 534/1073] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Sep 6 20:07:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:46.990535 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7b006-ab16-4593-8182-cdd659821b1d None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:47.064035 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:47.092443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 540/1074] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:07:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 20:07:47.093299 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a1999-ea30-4821-a859-db104de5cced None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:47.093536 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7b006-ab16-4593-8182-cdd659821b1d None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:47.103966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:47.130763 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b68b15-98a4-419d-9523-1271ef8bbff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:47.131394 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b68b15-98a4-419d-9523-1271ef8bbff8 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:47.131707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b68b15-98a4-419d-9523-1271ef8bbff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:47.131980 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b68b15-98a4-419d-9523-1271ef8bbff8 None admin] PATH_INFO: `/v3/users/e9251ec85fd44d28acafb82385774734` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:47.133252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b68b15-98a4-419d-9523-1271ef8bbff8 None admin] RBAC: Authorizing `identity:get_user(user_id=e9251ec85fd44d28acafb82385774734)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:47.134682 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b68b15-98a4-419d-9523-1271ef8bbff8 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:47.136379 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 535/1075] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:07:46 2022] GET /identity/v3/users/e9251ec85fd44d28acafb82385774734 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:47.137148 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b68b15-98a4-419d-9523-1271ef8bbff8 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:47.200639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a1999-ea30-4821-a859-db104de5cced None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:47.235926 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9198c16-288f-4caa-ac3f-81a1d016dc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:47.236548 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9198c16-288f-4caa-ac3f-81a1d016dc25 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:47.236818 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9198c16-288f-4caa-ac3f-81a1d016dc25 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:47.237085 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9198c16-288f-4caa-ac3f-81a1d016dc25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:47.239352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b68b15-98a4-419d-9523-1271ef8bbff8 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:47.247091 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9198c16-288f-4caa-ac3f-81a1d016dc25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:47.249098 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9198c16-288f-4caa-ac3f-81a1d016dc25 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:47.265027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-f9198c16-288f-4caa-ac3f-81a1d016dc25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:47.265027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:47.265027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:47.265027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:47.265027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:47.265027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:47.265027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:47.265027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:47.265027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:47.265027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:47.265027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:47.265027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:47.265027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:07:47.265027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:07:47.265027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:07:47.265027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:07:47.266058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:47.266058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:47.266058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:47.266058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:47.266058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:47.266058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:47.266058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:47.266058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:47.266058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:47.266058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:47.266058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:47.266058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:47.266058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:47.266058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:47.266058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:47.266058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:47.266058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:07:47.266942 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:07:47.266942 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:47.266942 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:47.266942 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 541/1076] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:47.266942 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9198c16-288f-4caa-ac3f-81a1d016dc25 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:47.279742 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72d071-6104-4588-9d27-b1a573b1ae7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:47.280376 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72d071-6104-4588-9d27-b1a573b1ae7c None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:47.280651 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72d071-6104-4588-9d27-b1a573b1ae7c None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:47.280919 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72d071-6104-4588-9d27-b1a573b1ae7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:47.289300 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:47.292086 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72d071-6104-4588-9d27-b1a573b1ae7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:47.293561 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72d071-6104-4588-9d27-b1a573b1ae7c None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:47.316834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-2d72d071-6104-4588-9d27-b1a573b1ae7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:47.316834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:47.316834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:47.316834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:47.316834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:47.316834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:47.316834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:47.316834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:47.316834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:47.316834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:47.316834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:47.316834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:47.316834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:07:47.316834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:07:47.316834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:07:47.316834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:07:47.317922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:47.317922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:47.317922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:47.317922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:47.317922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:47.317922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:47.317922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:47.317922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:47.317922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:47.317922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:47.317922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:47.317922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:47.317922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:47.317922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:47.317922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:47.317922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:47.317922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:07:47.319273 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:07:47.319273 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:47.319273 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:47.319273 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 536/1077] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:47.319273 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72d071-6104-4588-9d27-b1a573b1ae7c None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:47.332027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:47.384310 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9198c16-288f-4caa-ac3f-81a1d016dc25 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:47.437642 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db8a4a-4a56-4e57-8329-dc3e312e668c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:47.438831 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db8a4a-4a56-4e57-8329-dc3e312e668c None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:47.439311 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db8a4a-4a56-4e57-8329-dc3e312e668c None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:47.439889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db8a4a-4a56-4e57-8329-dc3e312e668c None admin] PATH_INFO: `/v3/projects/68969f60034f41ac9d7fda46e9ce8505` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:47.441812 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db8a4a-4a56-4e57-8329-dc3e312e668c None admin] RBAC: Authorizing `identity:get_project(project_id=68969f60034f41ac9d7fda46e9ce8505)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:47.442704 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72d071-6104-4588-9d27-b1a573b1ae7c None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:47.444634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db8a4a-4a56-4e57-8329-dc3e312e668c None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:47.453548 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 542/1078] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:07:47 2022] GET /identity/v3/projects/68969f60034f41ac9d7fda46e9ce8505 => generated 311 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:47.453548 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db8a4a-4a56-4e57-8329-dc3e312e668c None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:47.481819 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545b2f4-93ee-44b2-85b2-76a10bd6466c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:47.482485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545b2f4-93ee-44b2-85b2-76a10bd6466c None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:47.482769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545b2f4-93ee-44b2-85b2-76a10bd6466c None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:47.483042 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545b2f4-93ee-44b2-85b2-76a10bd6466c None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:47.483728 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545b2f4-93ee-44b2-85b2-76a10bd6466c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:47.484031 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545b2f4-93ee-44b2-85b2-76a10bd6466c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:47.485404 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545b2f4-93ee-44b2-85b2-76a10bd6466c None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:47.499096 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 537/1079] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:47.499974 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545b2f4-93ee-44b2-85b2-76a10bd6466c None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:47.558236 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:47.582685 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db8a4a-4a56-4e57-8329-dc3e312e668c None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:47.606657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545b2f4-93ee-44b2-85b2-76a10bd6466c None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:47.609302 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:47.617024 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf872231-7b0c-4189-9ef0-315205f9fe6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:47.617639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf872231-7b0c-4189-9ef0-315205f9fe6e None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:47.617918 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf872231-7b0c-4189-9ef0-315205f9fe6e None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:47.618286 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf872231-7b0c-4189-9ef0-315205f9fe6e None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:47.618890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf872231-7b0c-4189-9ef0-315205f9fe6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:47.619188 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf872231-7b0c-4189-9ef0-315205f9fe6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:47.620607 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf872231-7b0c-4189-9ef0-315205f9fe6e None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:47.636246 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 543/1080] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:47.636246 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf872231-7b0c-4189-9ef0-315205f9fe6e None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:47.646846 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed2740-accf-465a-948e-afbb4b4eb62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:47.647866 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed2740-accf-465a-948e-afbb4b4eb62b None admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:47.648347 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed2740-accf-465a-948e-afbb4b4eb62b None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:47.648601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed2740-accf-465a-948e-afbb4b4eb62b None admin] PATH_INFO: `/v3/projects/68969f60034f41ac9d7fda46e9ce8505/users/e9251ec85fd44d28acafb82385774734/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:47.651116 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed2740-accf-465a-948e-afbb4b4eb62b None admin] RBAC: Authorizing `identity:create_grant(project_id=68969f60034f41ac9d7fda46e9ce8505, user_id=e9251ec85fd44d28acafb82385774734, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:47.652645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed2740-accf-465a-948e-afbb4b4eb62b None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:47.726835 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 538/1081] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Sep 6 20:07:47 2022] PUT /identity/v3/projects/68969f60034f41ac9d7fda46e9ce8505/users/e9251ec85fd44d28acafb82385774734/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:07:47.765094 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf872231-7b0c-4189-9ef0-315205f9fe6e None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:47.814083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13729085-8411-471d-a073-a38d9e93ebce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:47.815129 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13729085-8411-471d-a073-a38d9e93ebce None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:47.815620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13729085-8411-471d-a073-a38d9e93ebce None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:47.816066 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13729085-8411-471d-a073-a38d9e93ebce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:47.829435 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13729085-8411-471d-a073-a38d9e93ebce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:47.831066 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13729085-8411-471d-a073-a38d9e93ebce None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:47.849040 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-13729085-8411-471d-a073-a38d9e93ebce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:47.849040 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:47.849040 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:47.849040 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:47.849040 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:47.849040 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:47.849040 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:47.849040 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:47.849040 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:47.849040 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:47.849040 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:47.849040 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:47.849040 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:07:47.849040 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:07:47.849040 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:07:47.850844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:07:47.850844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:47.850844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:47.850844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:47.850844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:47.850844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:47.850844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:47.850844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:47.850844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:47.850844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:47.850844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:47.850844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:47.850844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:47.850844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:47.850844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:47.850844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:47.850844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:47.852464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:07:47.852464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:07:47.852464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:07:47.852464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:07:47.852464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:07:47.852464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:07:47.852464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:47.852464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:47.854379 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 544/1082] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:07:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:47.861291 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed2740-accf-465a-948e-afbb4b4eb62b None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:47.983706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed2740-accf-465a-948e-afbb4b4eb62b None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:47.998407 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:48.020732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151f657-1941-41ad-83b8-8ed0fd98ada1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:48.021354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151f657-1941-41ad-83b8-8ed0fd98ada1 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:48.021632 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151f657-1941-41ad-83b8-8ed0fd98ada1 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:48.021904 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151f657-1941-41ad-83b8-8ed0fd98ada1 None admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:48.022659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151f657-1941-41ad-83b8-8ed0fd98ada1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:48.022962 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151f657-1941-41ad-83b8-8ed0fd98ada1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:48.024426 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151f657-1941-41ad-83b8-8ed0fd98ada1 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:48.037443 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 539/1083] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:07:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:48.043372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13729085-8411-471d-a073-a38d9e93ebce None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:48.096856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:48.149772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13729085-8411-471d-a073-a38d9e93ebce None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:48.184347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9d00a-e09c-4b12-b569-87d7dfd258ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:48.185007 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9d00a-e09c-4b12-b569-87d7dfd258ed None admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:48.185817 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9d00a-e09c-4b12-b569-87d7dfd258ed None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:48.186087 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9d00a-e09c-4b12-b569-87d7dfd258ed None admin] PATH_INFO: `/v3/projects/1b4323c35aef456b90ba9f1b7eb2b343/users/b09ce16da49b4af38491ad4eb6287d70/roles/82691a07001644e48564ddf52dcdfb89` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:48.188240 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9d00a-e09c-4b12-b569-87d7dfd258ed None admin] RBAC: Authorizing `identity:create_grant(project_id=1b4323c35aef456b90ba9f1b7eb2b343, user_id=b09ce16da49b4af38491ad4eb6287d70, role_id=82691a07001644e48564ddf52dcdfb89)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:48.189688 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9d00a-e09c-4b12-b569-87d7dfd258ed None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:48.251962 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 545/1084] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Sep 6 20:07:48 2022] PUT /identity/v3/projects/1b4323c35aef456b90ba9f1b7eb2b343/users/b09ce16da49b4af38491ad4eb6287d70/roles/82691a07001644e48564ddf52dcdfb89 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:07:49.913953 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075be34-8dde-4eb5-ba5e-87c85816f10b None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:49.914505 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075be34-8dde-4eb5-ba5e-87c85816f10b None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:49.914505 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075be34-8dde-4eb5-ba5e-87c85816f10b None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:49.915919 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 540/1085] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:49.922003 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b318fa9-4059-4046-a95c-7266e653262d None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:49.922452 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b318fa9-4059-4046-a95c-7266e653262d None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:49.922678 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b318fa9-4059-4046-a95c-7266e653262d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:49.941586 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-4b318fa9-4059-4046-a95c-7266e653262d None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:49.942794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-4b318fa9-4059-4046-a95c-7266e653262d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:50.015584 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 546/1086] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:07:50.285149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075be34-8dde-4eb5-ba5e-87c85816f10b None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:50.401632 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075be34-8dde-4eb5-ba5e-87c85816f10b None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:50.425371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78ed2e-44c3-44c8-a969-8d6969f32955 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:50.426658 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78ed2e-44c3-44c8-a969-8d6969f32955 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:50.434060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78ed2e-44c3-44c8-a969-8d6969f32955 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:50.434060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 547/1087] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:50.434060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0583b6b-08df-4aca-9c5e-a4514f840391 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:50.434447 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0583b6b-08df-4aca-9c5e-a4514f840391 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:50.434592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0583b6b-08df-4aca-9c5e-a4514f840391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:50.438990 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c055fbb-de9c-4ef2-8e53-2a107bf31efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:50.439661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c055fbb-de9c-4ef2-8e53-2a107bf31efc None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:50.439942 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c055fbb-de9c-4ef2-8e53-2a107bf31efc None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:50.440241 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c055fbb-de9c-4ef2-8e53-2a107bf31efc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:50.451032 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c055fbb-de9c-4ef2-8e53-2a107bf31efc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:07:50.453343 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-a0583b6b-08df-4aca-9c5e-a4514f840391 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:50.454548 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-a0583b6b-08df-4aca-9c5e-a4514f840391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:50.456150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-3c055fbb-de9c-4ef2-8e53-2a107bf31efc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:07:50.456150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:50.456150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:50.456150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:50.456150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:50.456150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:50.456150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:50.456150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:50.456150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:50.456150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:50.456150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:50.456150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:50.456150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:07:50.456150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:07:50.456150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:07:50.456150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:07:50.458181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:07:50.458181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:07:50.458181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:07:50.458181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:07:50.458181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:50.458181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:50.458181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:50.458181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:50.458181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:50.458181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:50.458181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:50.458181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:50.458181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:50.458181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:50.458181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:50.458181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:50.459053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:50.459053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:50.459053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:50.459053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:50.459053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:07:50.459053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:07:50.459053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:07:50.459053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:07:50.459053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:07:50.459053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:07:50.459053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:07:50.459053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:50.459053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 541/1088] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:07:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:50.463670 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c055fbb-de9c-4ef2-8e53-2a107bf31efc None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:50.491304 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:50.498331 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:50.535830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 548/1089] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 20:07:50.573069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c055fbb-de9c-4ef2-8e53-2a107bf31efc None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:50.609162 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019f07a-91ba-4539-b876-1cbee1ef45a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:50.609778 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019f07a-91ba-4539-b876-1cbee1ef45a9 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:50.610058 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019f07a-91ba-4539-b876-1cbee1ef45a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:50.610330 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019f07a-91ba-4539-b876-1cbee1ef45a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:50.610993 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019f07a-91ba-4539-b876-1cbee1ef45a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:50.611296 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019f07a-91ba-4539-b876-1cbee1ef45a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:50.612704 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019f07a-91ba-4539-b876-1cbee1ef45a9 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:50.621331 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 542/1090] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:07:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:50.627665 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0583b6b-08df-4aca-9c5e-a4514f840391 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:50.734409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0583b6b-08df-4aca-9c5e-a4514f840391 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:50.772040 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb96ef-f4aa-406c-ae72-eda448a51f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:50.772676 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb96ef-f4aa-406c-ae72-eda448a51f87 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:50.772953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb96ef-f4aa-406c-ae72-eda448a51f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:50.773223 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb96ef-f4aa-406c-ae72-eda448a51f87 None admin] PATH_INFO: `/v3/users/e9251ec85fd44d28acafb82385774734` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:50.774356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb96ef-f4aa-406c-ae72-eda448a51f87 None admin] RBAC: Authorizing `identity:get_user(user_id=e9251ec85fd44d28acafb82385774734)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:50.775823 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb96ef-f4aa-406c-ae72-eda448a51f87 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:50.777462 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 549/1091] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:07:50 2022] GET /identity/v3/users/e9251ec85fd44d28acafb82385774734 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:50.784247 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019f07a-91ba-4539-b876-1cbee1ef45a9 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:50.807425 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb96ef-f4aa-406c-ae72-eda448a51f87 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:50.849724 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:50.883392 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:50.891534 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019f07a-91ba-4539-b876-1cbee1ef45a9 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:50.920933 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb96ef-f4aa-406c-ae72-eda448a51f87 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:50.929291 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2a636-0f3b-4331-952c-356c6b34e794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:50.929922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2a636-0f3b-4331-952c-356c6b34e794 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:50.930322 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2a636-0f3b-4331-952c-356c6b34e794 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:50.930480 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2a636-0f3b-4331-952c-356c6b34e794 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:50.961284 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3bbb4e-b66a-4246-bf46-1cb116cf7bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:50.961945 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bbb4e-b66a-4246-bf46-1cb116cf7bdd None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:50.962242 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bbb4e-b66a-4246-bf46-1cb116cf7bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:50.962497 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bbb4e-b66a-4246-bf46-1cb116cf7bdd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:50.974734 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3bbb4e-b66a-4246-bf46-1cb116cf7bdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:07:50.979667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-ca3bbb4e-b66a-4246-bf46-1cb116cf7bdd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 20:07:50.979667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:50.979667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:50.979667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:50.979667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:50.979667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:50.979667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:50.979667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:50.979667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:50.979667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:50.979667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:50.979667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:50.979667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:07:50.979667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:07:50.979667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:07:50.979667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:07:50.980598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:07:50.980598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:07:50.980598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:07:50.980598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:07:50.980598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:50.980598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:50.980598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:50.980598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:50.980598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:50.980598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:50.980598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:50.980598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:50.980598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:50.980598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:50.980598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:50.980598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:50.981736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:50.981736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:50.981736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:50.981736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:50.981736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:07:50.981736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:07:50.981736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:07:50.981736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:07:50.981736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:07:50.981736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:07:50.981736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 20:07:50.981736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:50.981736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 550/1092] 10.222.0.77 () {56 vars in 1120 bytes} [Tue Sep 6 20:07:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:07:50.986908 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3bbb4e-b66a-4246-bf46-1cb116cf7bdd None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:51.006990 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2a636-0f3b-4331-952c-356c6b34e794 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:51.008494 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2a636-0f3b-4331-952c-356c6b34e794 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:51.091410 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:51.098081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3bbb4e-b66a-4246-bf46-1cb116cf7bdd None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:51.112101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:51.125461 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 543/1093] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:07:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 20:07:51.131777 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2a636-0f3b-4331-952c-356c6b34e794 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:51.143945 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d73ae6-a535-4a8b-b25a-5d1b4637be61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:51.144717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d73ae6-a535-4a8b-b25a-5d1b4637be61 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:51.145101 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d73ae6-a535-4a8b-b25a-5d1b4637be61 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:51.145478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d73ae6-a535-4a8b-b25a-5d1b4637be61 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:51.146253 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d73ae6-a535-4a8b-b25a-5d1b4637be61 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:51.146661 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d73ae6-a535-4a8b-b25a-5d1b4637be61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:51.148186 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d73ae6-a535-4a8b-b25a-5d1b4637be61 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:51.162069 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 551/1094] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Sep 6 20:07:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:51.163280 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d73ae6-a535-4a8b-b25a-5d1b4637be61 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:51.252706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2a636-0f3b-4331-952c-356c6b34e794 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:51.274154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d73ae6-a535-4a8b-b25a-5d1b4637be61 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:51.288824 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e6a2e-125f-416c-a5fc-87baeaecf71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:51.289465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e6a2e-125f-416c-a5fc-87baeaecf71f None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:51.289746 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e6a2e-125f-416c-a5fc-87baeaecf71f None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:51.290023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e6a2e-125f-416c-a5fc-87baeaecf71f None admin] PATH_INFO: `/v3/projects/68969f60034f41ac9d7fda46e9ce8505` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:51.291149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e6a2e-125f-416c-a5fc-87baeaecf71f None admin] RBAC: Authorizing `identity:get_project(project_id=68969f60034f41ac9d7fda46e9ce8505)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:51.292625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e6a2e-125f-416c-a5fc-87baeaecf71f None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:51.294292 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 544/1095] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:07:51 2022] GET /identity/v3/projects/68969f60034f41ac9d7fda46e9ce8505 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:51.301107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e6a2e-125f-416c-a5fc-87baeaecf71f None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:51.310147 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e47f67-98ec-4b1e-af17-a219bb0a2a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:51.311501 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e47f67-98ec-4b1e-af17-a219bb0a2a82 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:51.311757 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e47f67-98ec-4b1e-af17-a219bb0a2a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:51.312089 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e47f67-98ec-4b1e-af17-a219bb0a2a82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:51.323408 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e47f67-98ec-4b1e-af17-a219bb0a2a82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:51.324873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e47f67-98ec-4b1e-af17-a219bb0a2a82 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:51.339544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-80e47f67-98ec-4b1e-af17-a219bb0a2a82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:51.339544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:51.339544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:51.339544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:51.339544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:51.339544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:51.339544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:51.339544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:51.339544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:51.339544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:51.339544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:51.339544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:51.339544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:07:51.339544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:07:51.339544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:07:51.339544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:07:51.340747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:51.340747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:51.340747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:51.340747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:51.340747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:51.340747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:51.340747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:51.340747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:51.340747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:51.340747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:51.340747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:51.340747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:51.340747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:51.340747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:51.340747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:51.340747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:51.340747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:07:51.341740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:07:51.341740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:51.341740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:51.341740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 552/1096] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:51.346452 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e47f67-98ec-4b1e-af17-a219bb0a2a82 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:51.361242 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:51.366817 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:51.409916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e6a2e-125f-416c-a5fc-87baeaecf71f None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:51.449808 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f06319-7c19-43a3-a793-681ebd490b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:51.450525 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f06319-7c19-43a3-a793-681ebd490b94 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:51.450810 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f06319-7c19-43a3-a793-681ebd490b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:51.451091 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f06319-7c19-43a3-a793-681ebd490b94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:51.451968 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f06319-7c19-43a3-a793-681ebd490b94 None admin] RBAC: Adding query filter params (role.id=1e2ac44410664e6b8f42ab3c37e2643f, scope.project.id=68969f60034f41ac9d7fda46e9ce8505, user.id=e9251ec85fd44d28acafb82385774734) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:51.452279 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f06319-7c19-43a3-a793-681ebd490b94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:51.453728 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f06319-7c19-43a3-a793-681ebd490b94 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:51.457039 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e47f67-98ec-4b1e-af17-a219bb0a2a82 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:51.459646 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 545/1097] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:07:51 2022] GET /identity/v3/role_assignments?user.id=e9251ec85fd44d28acafb82385774734&scope.project.id=68969f60034f41ac9d7fda46e9ce8505&role.id=1e2ac44410664e6b8f42ab3c37e2643f => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:51.495319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a51442-f3a8-4c06-9ad4-6a9a0c5a1bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:51.495968 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a51442-f3a8-4c06-9ad4-6a9a0c5a1bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:51.496241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a51442-f3a8-4c06-9ad4-6a9a0c5a1bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:51.496508 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a51442-f3a8-4c06-9ad4-6a9a0c5a1bb5 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:51.497168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a51442-f3a8-4c06-9ad4-6a9a0c5a1bb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:51.497468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a51442-f3a8-4c06-9ad4-6a9a0c5a1bb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:51.499513 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a51442-f3a8-4c06-9ad4-6a9a0c5a1bb5 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:51.512855 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 553/1098] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:51.519003 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f06319-7c19-43a3-a793-681ebd490b94 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:51.630980 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f06319-7c19-43a3-a793-681ebd490b94 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:51.660664 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:51.670245 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947413ba-a4d4-4d99-bfe8-a2e238f450a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:51.675062 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947413ba-a4d4-4d99-bfe8-a2e238f450a3 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:51.675062 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947413ba-a4d4-4d99-bfe8-a2e238f450a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:51.675062 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947413ba-a4d4-4d99-bfe8-a2e238f450a3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:51.680548 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947413ba-a4d4-4d99-bfe8-a2e238f450a3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:51.682017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947413ba-a4d4-4d99-bfe8-a2e238f450a3 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:51.694293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-947413ba-a4d4-4d99-bfe8-a2e238f450a3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 20:07:51.694293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:51.694293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:51.694293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:51.694293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:51.694293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:51.694293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:51.694293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:51.694293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:51.694293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:51.694293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:51.694293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:51.694293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:07:51.694293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:07:51.694293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:07:51.694293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:07:51.695522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:51.695522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:51.695522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:07:51.695522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:51.695522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:07:51.695522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:07:51.695522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:51.695522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:51.695522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:51.695522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:51.695522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:51.695522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:51.695522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:51.695522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:51.695522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:51.695522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:51.695522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:51.695522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:51.696761 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:51.696761 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:51.696761 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:07:51.696761 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:07:51.696761 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:07:51.696761 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:07:51.696761 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:07:51.696761 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:07:51.696761 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 20:07:51.696761 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:07:51.696761 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 546/1099] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Sep 6 20:07:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:51.703368 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a51442-f3a8-4c06-9ad4-6a9a0c5a1bb5 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:51.776067 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:51.808885 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a51442-f3a8-4c06-9ad4-6a9a0c5a1bb5 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:51.845079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af55722-97d0-4118-b312-67ce93058392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:51.845687 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af55722-97d0-4118-b312-67ce93058392 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:51.845960 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af55722-97d0-4118-b312-67ce93058392 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:51.846225 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af55722-97d0-4118-b312-67ce93058392 None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:51.846951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af55722-97d0-4118-b312-67ce93058392 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:51.847289 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af55722-97d0-4118-b312-67ce93058392 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:51.848718 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af55722-97d0-4118-b312-67ce93058392 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:51.870721 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 554/1100] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Sep 6 20:07:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:51.877102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947413ba-a4d4-4d99-bfe8-a2e238f450a3 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:51.987262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947413ba-a4d4-4d99-bfe8-a2e238f450a3 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:52.023603 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbfa8e-f93e-4c1e-a7df-0a9798bf5d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:52.024104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbfa8e-f93e-4c1e-a7df-0a9798bf5d3b None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:52.024384 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbfa8e-f93e-4c1e-a7df-0a9798bf5d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:52.024658 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbfa8e-f93e-4c1e-a7df-0a9798bf5d3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:52.081401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:52.095418 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebbfa8e-f93e-4c1e-a7df-0a9798bf5d3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:52.096914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebbfa8e-f93e-4c1e-a7df-0a9798bf5d3b None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:52.205073 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 547/1101] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:07:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 06 20:07:52.206358 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af55722-97d0-4118-b312-67ce93058392 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:52.309891 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af55722-97d0-4118-b312-67ce93058392 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:52.339193 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:52.347322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc7498-2922-4e11-8321-1aa909639392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:52.350238 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc7498-2922-4e11-8321-1aa909639392 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:52.350238 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc7498-2922-4e11-8321-1aa909639392 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:52.350238 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc7498-2922-4e11-8321-1aa909639392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:52.358899 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc7498-2922-4e11-8321-1aa909639392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:52.360378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc7498-2922-4e11-8321-1aa909639392 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:52.376369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-50fc7498-2922-4e11-8321-1aa909639392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:52.376369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:52.376369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:52.376369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:52.376369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:52.376369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:52.376369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:52.376369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:52.376369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:52.376369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:52.376369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:52.376369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:52.376369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:07:52.376369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:07:52.376369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:07:52.376369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:07:52.377391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:52.377391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:52.377391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:52.377391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:52.377391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:52.377391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:52.377391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:52.377391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:52.377391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:52.377391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:52.377391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:52.377391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:52.377391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:52.377391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:52.377391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:52.377391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:52.377391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:07:52.378290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:07:52.378290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:07:52.378290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:52.378290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 555/1102] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:52.383765 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbfa8e-f93e-4c1e-a7df-0a9798bf5d3b None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:52.475964 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:52.492551 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbfa8e-f93e-4c1e-a7df-0a9798bf5d3b None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:52.528065 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37669606-3b60-4582-9f2e-c47c5b5f31e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:52.528677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37669606-3b60-4582-9f2e-c47c5b5f31e3 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:52.528987 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37669606-3b60-4582-9f2e-c47c5b5f31e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:52.529261 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37669606-3b60-4582-9f2e-c47c5b5f31e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:52.529902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37669606-3b60-4582-9f2e-c47c5b5f31e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:52.530207 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37669606-3b60-4582-9f2e-c47c5b5f31e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:52.531610 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37669606-3b60-4582-9f2e-c47c5b5f31e3 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:52.542954 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 548/1103] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:52.548808 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc7498-2922-4e11-8321-1aa909639392 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:52.655283 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc7498-2922-4e11-8321-1aa909639392 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:52.690211 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823d5a7-8c2f-4213-a512-509bbc6d908e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:52.690844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823d5a7-8c2f-4213-a512-509bbc6d908e None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:52.691122 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823d5a7-8c2f-4213-a512-509bbc6d908e None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:52.691394 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823d5a7-8c2f-4213-a512-509bbc6d908e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:52.698312 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823d5a7-8c2f-4213-a512-509bbc6d908e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:52.699775 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823d5a7-8c2f-4213-a512-509bbc6d908e None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:52.712054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-1823d5a7-8c2f-4213-a512-509bbc6d908e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:52.712054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:07:52.712054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:07:52.712054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:07:52.712054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:07:52.712054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:07:52.712054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:07:52.712054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:07:52.712054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:07:52.712054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:07:52.712054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:07:52.712054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:07:52.712054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:07:52.712054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:07:52.712054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:07:52.713107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:07:52.713107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:07:52.713107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:07:52.713107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:07:52.713107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:07:52.713107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:07:52.713107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:07:52.713107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:07:52.713107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:07:52.713107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:07:52.713107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:07:52.713107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:07:52.713107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:07:52.713107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:07:52.713107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:07:52.713107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:07:52.713107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:07:52.713994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:07:52.713994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:07:52.713994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:07:52.713994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:07:52.713994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:07:52.713994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:07:52.713994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:07:52.713994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:07:52.713994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 556/1104] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:07:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:07:52.719271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37669606-3b60-4582-9f2e-c47c5b5f31e3 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:52.824923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37669606-3b60-4582-9f2e-c47c5b5f31e3 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:52.861296 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8353ec-c7e0-4208-858f-aa7b9168f97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:52.862010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8353ec-c7e0-4208-858f-aa7b9168f97e None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:52.862374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8353ec-c7e0-4208-858f-aa7b9168f97e None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:52.862541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8353ec-c7e0-4208-858f-aa7b9168f97e None admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:52.863239 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8353ec-c7e0-4208-858f-aa7b9168f97e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:52.863597 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8353ec-c7e0-4208-858f-aa7b9168f97e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:52.865023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8353ec-c7e0-4208-858f-aa7b9168f97e None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:52.878585 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 549/1105] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:07:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:52.884656 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823d5a7-8c2f-4213-a512-509bbc6d908e None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:52.929443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:52.988428 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823d5a7-8c2f-4213-a512-509bbc6d908e None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:53.022970 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093fd25-4aad-4f7b-ada3-7f25dcffa7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:53.023612 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093fd25-4aad-4f7b-ada3-7f25dcffa7b4 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:53.023938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093fd25-4aad-4f7b-ada3-7f25dcffa7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:53.024159 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093fd25-4aad-4f7b-ada3-7f25dcffa7b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:53.024886 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093fd25-4aad-4f7b-ada3-7f25dcffa7b4 None admin] RBAC: Adding query filter params (role.id=82691a07001644e48564ddf52dcdfb89, scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343, user.id=b09ce16da49b4af38491ad4eb6287d70) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:53.025190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093fd25-4aad-4f7b-ada3-7f25dcffa7b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:53.026645 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093fd25-4aad-4f7b-ada3-7f25dcffa7b4 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:53.032696 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 557/1106] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:07:52 2022] GET /identity/v3/role_assignments?user.id=b09ce16da49b4af38491ad4eb6287d70&scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343&role.id=82691a07001644e48564ddf52dcdfb89 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:07:53.714817 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b76dd1-9365-41f2-9872-d358043357de None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:53.715361 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b76dd1-9365-41f2-9872-d358043357de None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:53.715361 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b76dd1-9365-41f2-9872-d358043357de None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:53.717363 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 550/1107] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:07:53.723143 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7135ad-be43-4af9-ad02-8af0d313042e None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:53.723629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7135ad-be43-4af9-ad02-8af0d313042e None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:53.724929 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7135ad-be43-4af9-ad02-8af0d313042e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:53.743034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-fe7135ad-be43-4af9-ad02-8af0d313042e None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:53.744550 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-fe7135ad-be43-4af9-ad02-8af0d313042e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:53.818651 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 558/1108] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:07:54.088559 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b76dd1-9365-41f2-9872-d358043357de None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:54.097622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:54.193925 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b76dd1-9365-41f2-9872-d358043357de None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:54.228859 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810667e-cf99-4969-bb80-97b3f0aa6445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:54.229493 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810667e-cf99-4969-bb80-97b3f0aa6445 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:54.229770 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810667e-cf99-4969-bb80-97b3f0aa6445 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:54.230040 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810667e-cf99-4969-bb80-97b3f0aa6445 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:54.231170 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810667e-cf99-4969-bb80-97b3f0aa6445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:54.232675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810667e-cf99-4969-bb80-97b3f0aa6445 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:54.234253 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 551/1109] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:07:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:54.240570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7135ad-be43-4af9-ad02-8af0d313042e None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:54.275317 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:54.343799 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7135ad-be43-4af9-ad02-8af0d313042e None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:54.378947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefaab9c-b165-446b-945a-bc0ed3dae0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:54.379578 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefaab9c-b165-446b-945a-bc0ed3dae0a9 None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:54.379853 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefaab9c-b165-446b-945a-bc0ed3dae0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:54.380116 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefaab9c-b165-446b-945a-bc0ed3dae0a9 None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:54.380757 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefaab9c-b165-446b-945a-bc0ed3dae0a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:54.382173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefaab9c-b165-446b-945a-bc0ed3dae0a9 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:54.474233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 559/1110] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Sep 6 20:07:54 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:07:56.702324 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658523a8-b4a8-4210-9299-e36bf1200fc9 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:56.702926 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658523a8-b4a8-4210-9299-e36bf1200fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:56.702926 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658523a8-b4a8-4210-9299-e36bf1200fc9 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:56.704271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 552/1111] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:07:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:07:56.713978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255a5b3-8523-42fe-b357-794c4f7a8b1d None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:56.714516 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255a5b3-8523-42fe-b357-794c4f7a8b1d None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:56.714516 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255a5b3-8523-42fe-b357-794c4f7a8b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:56.735680 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-7255a5b3-8523-42fe-b357-794c4f7a8b1d None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:07:56.736876 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-7255a5b3-8523-42fe-b357-794c4f7a8b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:07:56.805123 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 560/1112] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:07:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 20:07:57.072931 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658523a8-b4a8-4210-9299-e36bf1200fc9 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:57.153844 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:57.179060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658523a8-b4a8-4210-9299-e36bf1200fc9 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:57.216074 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8435d-5a37-48ff-8122-454c943d9da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:57.216857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8435d-5a37-48ff-8122-454c943d9da9 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:57.217216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8435d-5a37-48ff-8122-454c943d9da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:57.217539 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8435d-5a37-48ff-8122-454c943d9da9 None admin] PATH_INFO: `/v3/roles/8ad4b0e0a5384306acd6d162f21dcd3d` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:57.219040 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8435d-5a37-48ff-8122-454c943d9da9 None admin] RBAC: Authorizing `identity:get_role(role_id=8ad4b0e0a5384306acd6d162f21dcd3d)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:57.220467 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8435d-5a37-48ff-8122-454c943d9da9 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:57.221850 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 553/1113] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:07:57 2022] GET /identity/v3/roles/8ad4b0e0a5384306acd6d162f21dcd3d => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:57.227972 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255a5b3-8523-42fe-b357-794c4f7a8b1d None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:57.251458 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:57.335040 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255a5b3-8523-42fe-b357-794c4f7a8b1d None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:57.370071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93384966-9576-4414-b8d1-d0edb0c158ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:57.370703 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93384966-9576-4414-b8d1-d0edb0c158ff None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:57.370985 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93384966-9576-4414-b8d1-d0edb0c158ff None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:57.371258 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93384966-9576-4414-b8d1-d0edb0c158ff None admin] PATH_INFO: `/v3/users/768689569891426fbb03feca2b779341` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:57.386680 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93384966-9576-4414-b8d1-d0edb0c158ff None admin] RBAC: Authorizing `identity:get_user(user_id=768689569891426fbb03feca2b779341)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:57.388214 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93384966-9576-4414-b8d1-d0edb0c158ff None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:57.389927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 561/1114] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:07:57 2022] GET /identity/v3/users/768689569891426fbb03feca2b779341 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:57.396155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8435d-5a37-48ff-8122-454c943d9da9 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:57.501265 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8435d-5a37-48ff-8122-454c943d9da9 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:57.551122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564b99f-8a26-49ed-8f8c-30cee360d443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:57.551758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564b99f-8a26-49ed-8f8c-30cee360d443 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:57.552088 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564b99f-8a26-49ed-8f8c-30cee360d443 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:57.552362 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564b99f-8a26-49ed-8f8c-30cee360d443 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:57.567179 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:57.627899 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564b99f-8a26-49ed-8f8c-30cee360d443 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:57.629266 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564b99f-8a26-49ed-8f8c-30cee360d443 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:57.730377 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 554/1115] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:07:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 06 20:07:57.737197 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93384966-9576-4414-b8d1-d0edb0c158ff None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:57.819124 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:57.844664 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93384966-9576-4414-b8d1-d0edb0c158ff None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:57.884079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484b8f2-34a6-4acc-ab3b-7b35cdf1351d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:57.884624 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484b8f2-34a6-4acc-ab3b-7b35cdf1351d None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:57.884898 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484b8f2-34a6-4acc-ab3b-7b35cdf1351d None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:57.885166 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484b8f2-34a6-4acc-ab3b-7b35cdf1351d None admin] PATH_INFO: `/v3/projects/68969f60034f41ac9d7fda46e9ce8505` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:57.886300 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484b8f2-34a6-4acc-ab3b-7b35cdf1351d None admin] RBAC: Authorizing `identity:get_project(project_id=68969f60034f41ac9d7fda46e9ce8505)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:57.887761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484b8f2-34a6-4acc-ab3b-7b35cdf1351d None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:57.889396 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 562/1116] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:07:57 2022] GET /identity/v3/projects/68969f60034f41ac9d7fda46e9ce8505 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:07:57.895639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564b99f-8a26-49ed-8f8c-30cee360d443 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:07:57.940149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:07:58.002888 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564b99f-8a26-49ed-8f8c-30cee360d443 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:07:58.039132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37faa8-95e1-4614-9229-88e46c06819f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:07:58.039759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37faa8-95e1-4614-9229-88e46c06819f None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:07:58.040033 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37faa8-95e1-4614-9229-88e46c06819f None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:07:58.040302 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37faa8-95e1-4614-9229-88e46c06819f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:07:58.041018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37faa8-95e1-4614-9229-88e46c06819f None admin] RBAC: Adding query filter params (role.id=8ad4b0e0a5384306acd6d162f21dcd3d, scope.project.id=68969f60034f41ac9d7fda46e9ce8505, user.id=768689569891426fbb03feca2b779341) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:07:58.041325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37faa8-95e1-4614-9229-88e46c06819f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:07:58.042766 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37faa8-95e1-4614-9229-88e46c06819f None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:07:58.048519 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 555/1117] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:07:57 2022] GET /identity/v3/role_assignments?user.id=768689569891426fbb03feca2b779341&scope.project.id=68969f60034f41ac9d7fda46e9ce8505&role.id=8ad4b0e0a5384306acd6d162f21dcd3d => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:00.226543 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e065422-8335-4e45-87ed-ccf12f94156f None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:00.227036 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e065422-8335-4e45-87ed-ccf12f94156f None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:00.227036 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e065422-8335-4e45-87ed-ccf12f94156f None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:00.228511 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 563/1118] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:08:00.233821 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445668c4-7803-4df7-9ec6-ef3143473527 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:00.234276 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445668c4-7803-4df7-9ec6-ef3143473527 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:00.234505 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445668c4-7803-4df7-9ec6-ef3143473527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:00.253270 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-445668c4-7803-4df7-9ec6-ef3143473527 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:08:00.254467 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-445668c4-7803-4df7-9ec6-ef3143473527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:08:00.323524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 556/1119] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:08:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:08:00.600330 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e065422-8335-4e45-87ed-ccf12f94156f None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:00.717051 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e065422-8335-4e45-87ed-ccf12f94156f None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:00.759238 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0920cb-8d02-4c1c-a3f1-533d17606546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:00.759893 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0920cb-8d02-4c1c-a3f1-533d17606546 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:00.760166 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0920cb-8d02-4c1c-a3f1-533d17606546 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:00.760430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0920cb-8d02-4c1c-a3f1-533d17606546 None admin] PATH_INFO: `/v3/roles/8ad4b0e0a5384306acd6d162f21dcd3d` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:00.761802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0920cb-8d02-4c1c-a3f1-533d17606546 None admin] RBAC: Authorizing `identity:get_role(role_id=8ad4b0e0a5384306acd6d162f21dcd3d)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:00.763217 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0920cb-8d02-4c1c-a3f1-533d17606546 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:00.764579 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 564/1120] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:08:00 2022] GET /identity/v3/roles/8ad4b0e0a5384306acd6d162f21dcd3d => generated 223 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:00.770725 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445668c4-7803-4df7-9ec6-ef3143473527 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:00.811653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:00.881921 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445668c4-7803-4df7-9ec6-ef3143473527 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:00.916884 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac7617-5453-4378-aa5e-a861fc64f66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:00.917757 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac7617-5453-4378-aa5e-a861fc64f66a None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:00.917906 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac7617-5453-4378-aa5e-a861fc64f66a None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:00.918143 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac7617-5453-4378-aa5e-a861fc64f66a None admin] PATH_INFO: `/v3/users/768689569891426fbb03feca2b779341` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:00.920022 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac7617-5453-4378-aa5e-a861fc64f66a None admin] RBAC: Authorizing `identity:get_user(user_id=768689569891426fbb03feca2b779341)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:00.921524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac7617-5453-4378-aa5e-a861fc64f66a None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:00.923145 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 557/1121] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:08:00 2022] GET /identity/v3/users/768689569891426fbb03feca2b779341 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:00.929705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0920cb-8d02-4c1c-a3f1-533d17606546 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:00.946361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:01.043403 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0920cb-8d02-4c1c-a3f1-533d17606546 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:01.081252 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80e4e6-b36e-4fab-9939-c38c9bd67c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:01.081883 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80e4e6-b36e-4fab-9939-c38c9bd67c0c None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:01.082156 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80e4e6-b36e-4fab-9939-c38c9bd67c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:01.082429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80e4e6-b36e-4fab-9939-c38c9bd67c0c None admin] PATH_INFO: `/v3/projects/68969f60034f41ac9d7fda46e9ce8505` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:01.083582 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80e4e6-b36e-4fab-9939-c38c9bd67c0c None admin] RBAC: Authorizing `identity:get_project(project_id=68969f60034f41ac9d7fda46e9ce8505)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:01.085024 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80e4e6-b36e-4fab-9939-c38c9bd67c0c None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:01.086665 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 565/1122] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:08:00 2022] GET /identity/v3/projects/68969f60034f41ac9d7fda46e9ce8505 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:01.093600 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac7617-5453-4378-aa5e-a861fc64f66a None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:01.201756 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac7617-5453-4378-aa5e-a861fc64f66a None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:01.204350 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:01.238192 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d79d4f-4082-454b-be80-f3fcd563ba38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:01.238914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d79d4f-4082-454b-be80-f3fcd563ba38 None admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:01.239114 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d79d4f-4082-454b-be80-f3fcd563ba38 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:01.239385 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d79d4f-4082-454b-be80-f3fcd563ba38 None admin] PATH_INFO: `/v3/projects/68969f60034f41ac9d7fda46e9ce8505/users/768689569891426fbb03feca2b779341/roles/8ad4b0e0a5384306acd6d162f21dcd3d` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:01.241644 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d79d4f-4082-454b-be80-f3fcd563ba38 None admin] RBAC: Authorizing `identity:create_grant(project_id=68969f60034f41ac9d7fda46e9ce8505, user_id=768689569891426fbb03feca2b779341, role_id=8ad4b0e0a5384306acd6d162f21dcd3d)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:01.243073 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d79d4f-4082-454b-be80-f3fcd563ba38 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:01.302480 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 558/1123] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Sep 6 20:08:01 2022] PUT /identity/v3/projects/68969f60034f41ac9d7fda46e9ce8505/users/768689569891426fbb03feca2b779341/roles/8ad4b0e0a5384306acd6d162f21dcd3d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:08:03.476772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc81bc1-b200-496b-aabc-77e3d260b144 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:03.477330 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc81bc1-b200-496b-aabc-77e3d260b144 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:03.477330 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc81bc1-b200-496b-aabc-77e3d260b144 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:03.478716 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 566/1124] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:08:03.484616 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e5572-d211-4b2f-b49a-f9468ee1cade None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:03.485052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e5572-d211-4b2f-b49a-f9468ee1cade None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:03.485146 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e5572-d211-4b2f-b49a-f9468ee1cade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:03.503835 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-a65e5572-d211-4b2f-b49a-f9468ee1cade None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:08:03.505022 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-a65e5572-d211-4b2f-b49a-f9468ee1cade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:08:03.570669 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 559/1125] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:08:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:08:03.843239 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc81bc1-b200-496b-aabc-77e3d260b144 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:03.929825 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:03.950874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc81bc1-b200-496b-aabc-77e3d260b144 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:03.991921 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259a181-dc75-4f2c-9ea4-4f16c8e1be26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:03.992554 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259a181-dc75-4f2c-9ea4-4f16c8e1be26 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:03.992833 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259a181-dc75-4f2c-9ea4-4f16c8e1be26 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:03.993109 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259a181-dc75-4f2c-9ea4-4f16c8e1be26 None admin] PATH_INFO: `/v3/roles/8ad4b0e0a5384306acd6d162f21dcd3d` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:03.994501 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259a181-dc75-4f2c-9ea4-4f16c8e1be26 None admin] RBAC: Authorizing `identity:get_role(role_id=8ad4b0e0a5384306acd6d162f21dcd3d)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:03.995915 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259a181-dc75-4f2c-9ea4-4f16c8e1be26 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:03.997259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 567/1126] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:08:03 2022] GET /identity/v3/roles/8ad4b0e0a5384306acd6d162f21dcd3d => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:04.003569 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e5572-d211-4b2f-b49a-f9468ee1cade None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:04.104283 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:04.110931 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e5572-d211-4b2f-b49a-f9468ee1cade None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:04.147140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb887f-bd2b-4280-b3ae-734f336dc613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:04.147798 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb887f-bd2b-4280-b3ae-734f336dc613 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:04.148079 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb887f-bd2b-4280-b3ae-734f336dc613 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:04.148355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb887f-bd2b-4280-b3ae-734f336dc613 None admin] PATH_INFO: `/v3/users/768689569891426fbb03feca2b779341` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:04.149529 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb887f-bd2b-4280-b3ae-734f336dc613 None admin] RBAC: Authorizing `identity:get_user(user_id=768689569891426fbb03feca2b779341)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:04.150960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb887f-bd2b-4280-b3ae-734f336dc613 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:04.152637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 560/1127] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:08:04 2022] GET /identity/v3/users/768689569891426fbb03feca2b779341 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:04.159347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259a181-dc75-4f2c-9ea4-4f16c8e1be26 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:04.262614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259a181-dc75-4f2c-9ea4-4f16c8e1be26 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:04.300829 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d70c9a-1c2c-48bf-b0a6-1c09192eaf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:04.301435 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d70c9a-1c2c-48bf-b0a6-1c09192eaf16 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:04.301714 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d70c9a-1c2c-48bf-b0a6-1c09192eaf16 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:04.301987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d70c9a-1c2c-48bf-b0a6-1c09192eaf16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:04.321920 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:04.373996 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d70c9a-1c2c-48bf-b0a6-1c09192eaf16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:04.375266 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d70c9a-1c2c-48bf-b0a6-1c09192eaf16 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:04.481147 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 568/1128] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:08:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 20:08:04.487351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb887f-bd2b-4280-b3ae-734f336dc613 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:04.596899 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb887f-bd2b-4280-b3ae-734f336dc613 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:04.637301 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c62f3a-110e-498e-a8bf-4afe4b86139f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:04.637854 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c62f3a-110e-498e-a8bf-4afe4b86139f None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:04.638744 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c62f3a-110e-498e-a8bf-4afe4b86139f None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:04.639014 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c62f3a-110e-498e-a8bf-4afe4b86139f None admin] PATH_INFO: `/v3/projects/68969f60034f41ac9d7fda46e9ce8505` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:04.640299 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c62f3a-110e-498e-a8bf-4afe4b86139f None admin] RBAC: Authorizing `identity:get_project(project_id=68969f60034f41ac9d7fda46e9ce8505)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:04.641768 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c62f3a-110e-498e-a8bf-4afe4b86139f None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:04.643406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 561/1129] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:08:04 2022] GET /identity/v3/projects/68969f60034f41ac9d7fda46e9ce8505 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:04.650536 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d70c9a-1c2c-48bf-b0a6-1c09192eaf16 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:04.709409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:04.765090 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d70c9a-1c2c-48bf-b0a6-1c09192eaf16 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:04.799607 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09b1f7-a7a6-4709-8f0e-2ce3898144b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:04.800213 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09b1f7-a7a6-4709-8f0e-2ce3898144b8 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:04.800491 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09b1f7-a7a6-4709-8f0e-2ce3898144b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:04.800765 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09b1f7-a7a6-4709-8f0e-2ce3898144b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:04.801488 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09b1f7-a7a6-4709-8f0e-2ce3898144b8 None admin] RBAC: Adding query filter params (role.id=8ad4b0e0a5384306acd6d162f21dcd3d, scope.project.id=68969f60034f41ac9d7fda46e9ce8505, user.id=768689569891426fbb03feca2b779341) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:08:04.801793 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09b1f7-a7a6-4709-8f0e-2ce3898144b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:04.803220 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09b1f7-a7a6-4709-8f0e-2ce3898144b8 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:04.809363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 569/1130] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:08:04 2022] GET /identity/v3/role_assignments?user.id=768689569891426fbb03feca2b779341&scope.project.id=68969f60034f41ac9d7fda46e9ce8505&role.id=8ad4b0e0a5384306acd6d162f21dcd3d => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:07.029829 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0e4e0-8aeb-4449-95cc-2e39e6a47a7a None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:07.030358 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0e4e0-8aeb-4449-95cc-2e39e6a47a7a None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:07.030358 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0e4e0-8aeb-4449-95cc-2e39e6a47a7a None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:07.031702 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 562/1131] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:08:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:08:07.036993 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676a9ae-e243-4f25-8b02-a002c730b768 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:07.037403 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676a9ae-e243-4f25-8b02-a002c730b768 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:07.037584 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676a9ae-e243-4f25-8b02-a002c730b768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:07.055653 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-7676a9ae-e243-4f25-8b02-a002c730b768 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:08:07.056806 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-7676a9ae-e243-4f25-8b02-a002c730b768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:08:07.125745 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 570/1132] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:08:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 20:08:07.396953 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0e4e0-8aeb-4449-95cc-2e39e6a47a7a None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:07.429739 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:07.513925 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0e4e0-8aeb-4449-95cc-2e39e6a47a7a None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:07.552791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c21f7-11e2-4308-93eb-2f5f98e5007d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:07.553428 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c21f7-11e2-4308-93eb-2f5f98e5007d None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:07.553705 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c21f7-11e2-4308-93eb-2f5f98e5007d None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:07.553978 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c21f7-11e2-4308-93eb-2f5f98e5007d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:07.555108 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c21f7-11e2-4308-93eb-2f5f98e5007d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:07.556598 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c21f7-11e2-4308-93eb-2f5f98e5007d None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:07.558330 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 563/1133] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:08:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:07.565486 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676a9ae-e243-4f25-8b02-a002c730b768 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:07.614299 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:07.671896 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676a9ae-e243-4f25-8b02-a002c730b768 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:07.705339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9c62c-81fc-437d-86f5-b7d6d4c2cc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:07.705939 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9c62c-81fc-437d-86f5-b7d6d4c2cc96 None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:07.706216 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9c62c-81fc-437d-86f5-b7d6d4c2cc96 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:07.706488 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9c62c-81fc-437d-86f5-b7d6d4c2cc96 None admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:07.707132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9c62c-81fc-437d-86f5-b7d6d4c2cc96 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:07.708613 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9c62c-81fc-437d-86f5-b7d6d4c2cc96 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:07.812448 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 571/1134] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Sep 6 20:08:07 2022] POST /identity/v3/projects => generated 311 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:08:10.018127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f3c96-d667-4f5c-9a64-cd3454b30475 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:10.018754 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f3c96-d667-4f5c-9a64-cd3454b30475 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:10.018754 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f3c96-d667-4f5c-9a64-cd3454b30475 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:10.020040 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 564/1135] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:08:10.025706 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0209c7-435c-4657-baf7-70bbf09a47e6 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:10.026173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0209c7-435c-4657-baf7-70bbf09a47e6 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:10.026268 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0209c7-435c-4657-baf7-70bbf09a47e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:10.045751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-ad0209c7-435c-4657-baf7-70bbf09a47e6 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:08:10.046942 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ad0209c7-435c-4657-baf7-70bbf09a47e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:08:10.114322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 572/1136] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:08:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:08:10.384458 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f3c96-d667-4f5c-9a64-cd3454b30475 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:10.488922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:10.494149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f3c96-d667-4f5c-9a64-cd3454b30475 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:10.543036 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f1f68-82f5-437a-8493-6ff855a92476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:10.543825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f1f68-82f5-437a-8493-6ff855a92476 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:10.544130 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f1f68-82f5-437a-8493-6ff855a92476 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:10.544401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f1f68-82f5-437a-8493-6ff855a92476 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:10.545628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f1f68-82f5-437a-8493-6ff855a92476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:10.548493 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f1f68-82f5-437a-8493-6ff855a92476 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:10.552611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 565/1137] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:08:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:10.558357 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0209c7-435c-4657-baf7-70bbf09a47e6 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:10.592581 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:10.671077 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0209c7-435c-4657-baf7-70bbf09a47e6 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:10.707630 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bafa42-3446-4bfa-abfc-ffe75e22a6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:10.708222 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bafa42-3446-4bfa-abfc-ffe75e22a6f5 None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:10.708500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bafa42-3446-4bfa-abfc-ffe75e22a6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:10.708770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bafa42-3446-4bfa-abfc-ffe75e22a6f5 None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:10.709422 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bafa42-3446-4bfa-abfc-ffe75e22a6f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:10.710846 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bafa42-3446-4bfa-abfc-ffe75e22a6f5 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:10.835121 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 573/1138] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Sep 6 20:08:10 2022] POST /identity/v3/users => generated 286 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:08:13.080845 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a754a6f-f5c9-468d-83d6-6c87d22e1fde None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:13.081371 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a754a6f-f5c9-468d-83d6-6c87d22e1fde None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:13.081371 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a754a6f-f5c9-468d-83d6-6c87d22e1fde None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:13.082661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 566/1139] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:08:13.088101 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e2ed1-514e-4b77-8783-7862129dfb7b None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:13.088571 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e2ed1-514e-4b77-8783-7862129dfb7b None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:13.088670 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e2ed1-514e-4b77-8783-7862129dfb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:13.108559 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-a10e2ed1-514e-4b77-8783-7862129dfb7b None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:08:13.109772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-a10e2ed1-514e-4b77-8783-7862129dfb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:08:13.177581 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 574/1140] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:08:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:08:13.452086 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a754a6f-f5c9-468d-83d6-6c87d22e1fde None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:13.556005 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a754a6f-f5c9-468d-83d6-6c87d22e1fde None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:13.595241 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755e29d-7572-4e65-a15a-691eca1c2a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:13.595902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755e29d-7572-4e65-a15a-691eca1c2a44 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:13.596191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755e29d-7572-4e65-a15a-691eca1c2a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:13.596466 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755e29d-7572-4e65-a15a-691eca1c2a44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:13.606917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0755e29d-7572-4e65-a15a-691eca1c2a44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:08:13.611791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-0755e29d-7572-4e65-a15a-691eca1c2a44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:08:13.611791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:08:13.611791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:08:13.611791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:08:13.611791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:08:13.611791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:08:13.611791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:08:13.611791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:08:13.611791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:08:13.611791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:08:13.611791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:08:13.611791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:08:13.611791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:08:13.611791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:08:13.611791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:08:13.611791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:08:13.612984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:08:13.612984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:08:13.612984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:08:13.612984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:08:13.612984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:08:13.612984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:08:13.612984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:08:13.612984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:08:13.612984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:08:13.612984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:08:13.612984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:08:13.612984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:08:13.612984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:08:13.612984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:08:13.612984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:08:13.612984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:08:13.614048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:08:13.614048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:08:13.614048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:08:13.614048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:08:13.614048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:08:13.614048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:08:13.614048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:08:13.614048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:08:13.614048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:08:13.614048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:08:13.614048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:08:13.614048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:08:13.614048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 567/1141] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:08:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:08:13.619016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e2ed1-514e-4b77-8783-7862129dfb7b None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:13.634129 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:13.735848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e2ed1-514e-4b77-8783-7862129dfb7b None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:13.771434 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee93c66-3e0f-4ba2-83d3-2f39a829706a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:13.772072 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee93c66-3e0f-4ba2-83d3-2f39a829706a None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:13.772349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee93c66-3e0f-4ba2-83d3-2f39a829706a None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:13.772622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee93c66-3e0f-4ba2-83d3-2f39a829706a None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:13.773284 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee93c66-3e0f-4ba2-83d3-2f39a829706a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:08:13.773592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee93c66-3e0f-4ba2-83d3-2f39a829706a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:13.774969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee93c66-3e0f-4ba2-83d3-2f39a829706a None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:13.784052 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 575/1142] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:08:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:13.790346 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755e29d-7572-4e65-a15a-691eca1c2a44 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:13.819954 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:13.897886 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755e29d-7572-4e65-a15a-691eca1c2a44 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:13.932175 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a41a4a-adf8-486c-b076-2d84f626e071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:13.932802 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a41a4a-adf8-486c-b076-2d84f626e071 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:13.933081 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a41a4a-adf8-486c-b076-2d84f626e071 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:13.933352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a41a4a-adf8-486c-b076-2d84f626e071 None admin] PATH_INFO: `/v3/users/9c46ea3083f64a6cabe000f8baea17dd` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:13.947408 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a41a4a-adf8-486c-b076-2d84f626e071 None admin] RBAC: Authorizing `identity:get_user(user_id=9c46ea3083f64a6cabe000f8baea17dd)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:13.948897 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a41a4a-adf8-486c-b076-2d84f626e071 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:13.950635 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 568/1143] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:08:13 2022] GET /identity/v3/users/9c46ea3083f64a6cabe000f8baea17dd => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:13.956526 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee93c66-3e0f-4ba2-83d3-2f39a829706a None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:14.056727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:14.090872 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee93c66-3e0f-4ba2-83d3-2f39a829706a None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:14.127187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15288c56-ebf0-44b6-833c-e918807d36c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:14.127818 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15288c56-ebf0-44b6-833c-e918807d36c4 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:14.128094 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15288c56-ebf0-44b6-833c-e918807d36c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:14.128364 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15288c56-ebf0-44b6-833c-e918807d36c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:14.196338 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15288c56-ebf0-44b6-833c-e918807d36c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:14.197779 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15288c56-ebf0-44b6-833c-e918807d36c4 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:14.290367 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:14.318052 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 576/1144] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:08:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 20:08:14.324092 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a41a4a-adf8-486c-b076-2d84f626e071 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:14.433472 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:14.449886 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a41a4a-adf8-486c-b076-2d84f626e071 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:14.486076 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cccfa-5e9a-4420-8de9-46ee0a380b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:14.486705 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cccfa-5e9a-4420-8de9-46ee0a380b24 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:14.486981 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cccfa-5e9a-4420-8de9-46ee0a380b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:14.487249 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cccfa-5e9a-4420-8de9-46ee0a380b24 None admin] PATH_INFO: `/v3/projects/cd762de73b2c4b65a72b30f67b256d9e` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:14.488383 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942cccfa-5e9a-4420-8de9-46ee0a380b24 None admin] RBAC: Authorizing `identity:get_project(project_id=cd762de73b2c4b65a72b30f67b256d9e)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:14.489805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942cccfa-5e9a-4420-8de9-46ee0a380b24 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:14.491434 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 569/1145] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:08:14 2022] GET /identity/v3/projects/cd762de73b2c4b65a72b30f67b256d9e => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:14.497710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15288c56-ebf0-44b6-833c-e918807d36c4 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:14.596564 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15288c56-ebf0-44b6-833c-e918807d36c4 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:14.639859 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050013a-ef62-4808-8247-4987b5d3d52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:14.640467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050013a-ef62-4808-8247-4987b5d3d52d None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:14.640749 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050013a-ef62-4808-8247-4987b5d3d52d None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:14.641024 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050013a-ef62-4808-8247-4987b5d3d52d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:14.641748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050013a-ef62-4808-8247-4987b5d3d52d None admin] RBAC: Adding query filter params (role.id=1e2ac44410664e6b8f42ab3c37e2643f, scope.project.id=cd762de73b2c4b65a72b30f67b256d9e, user.id=9c46ea3083f64a6cabe000f8baea17dd) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:08:14.642061 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050013a-ef62-4808-8247-4987b5d3d52d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:14.643528 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050013a-ef62-4808-8247-4987b5d3d52d None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:14.649064 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 577/1146] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:08:14 2022] GET /identity/v3/role_assignments?user.id=9c46ea3083f64a6cabe000f8baea17dd&scope.project.id=cd762de73b2c4b65a72b30f67b256d9e&role.id=1e2ac44410664e6b8f42ab3c37e2643f => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:16.841601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba43b23-c572-4c27-8dff-c0f7bd4badb2 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:16.842140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba43b23-c572-4c27-8dff-c0f7bd4badb2 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:16.842140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba43b23-c572-4c27-8dff-c0f7bd4badb2 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:16.843509 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 570/1147] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:08:16.849119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accef6f2-f9b9-4b1f-86fb-ddcceed6403e None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:16.849611 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accef6f2-f9b9-4b1f-86fb-ddcceed6403e None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:16.849702 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accef6f2-f9b9-4b1f-86fb-ddcceed6403e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:16.868451 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-accef6f2-f9b9-4b1f-86fb-ddcceed6403e None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:08:16.869687 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-accef6f2-f9b9-4b1f-86fb-ddcceed6403e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:08:16.900241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:16.940786 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 578/1148] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:08:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:08:17.207691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba43b23-c572-4c27-8dff-c0f7bd4badb2 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:17.310629 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba43b23-c572-4c27-8dff-c0f7bd4badb2 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:17.345533 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a3341-78b6-4336-981f-8f1a8ae773f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:17.346166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a3341-78b6-4336-981f-8f1a8ae773f6 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:17.346452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a3341-78b6-4336-981f-8f1a8ae773f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:17.346719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a3341-78b6-4336-981f-8f1a8ae773f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:17.358173 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a3341-78b6-4336-981f-8f1a8ae773f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:08:17.363102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-a81a3341-78b6-4336-981f-8f1a8ae773f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:08:17.363102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:08:17.363102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:08:17.363102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:08:17.363102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:08:17.363102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:08:17.363102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:08:17.363102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:08:17.363102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:08:17.363102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:08:17.363102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:08:17.363102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:08:17.363102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:08:17.363102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:08:17.363102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:08:17.363102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:08:17.364321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:08:17.364321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:08:17.364321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:08:17.364321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:08:17.364321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:08:17.364321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:08:17.364321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:08:17.364321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:08:17.364321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:08:17.364321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:08:17.364321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:08:17.364321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:08:17.364321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:08:17.364321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:08:17.364321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:08:17.364321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:08:17.365653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:08:17.365653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:08:17.365653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:08:17.365653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:08:17.365653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:08:17.365653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:08:17.365653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:08:17.365653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:08:17.365653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:08:17.365653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:08:17.365653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:08:17.365653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:08:17.365653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 571/1149] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:08:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:08:17.370365 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accef6f2-f9b9-4b1f-86fb-ddcceed6403e None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:17.475514 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accef6f2-f9b9-4b1f-86fb-ddcceed6403e None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:17.516632 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0123681-9e29-4b15-895f-4d4dcd126979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:17.517238 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0123681-9e29-4b15-895f-4d4dcd126979 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:17.517516 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0123681-9e29-4b15-895f-4d4dcd126979 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:17.517785 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0123681-9e29-4b15-895f-4d4dcd126979 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:17.518443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0123681-9e29-4b15-895f-4d4dcd126979 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:08:17.518743 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0123681-9e29-4b15-895f-4d4dcd126979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:17.520131 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0123681-9e29-4b15-895f-4d4dcd126979 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:17.529142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 579/1150] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:08:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:17.535047 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a3341-78b6-4336-981f-8f1a8ae773f6 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:17.551136 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:17.636646 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a3341-78b6-4336-981f-8f1a8ae773f6 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:17.670962 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df06283-0655-45f3-855c-949d9ad89081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:17.671621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df06283-0655-45f3-855c-949d9ad89081 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:17.671903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df06283-0655-45f3-855c-949d9ad89081 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:17.672175 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df06283-0655-45f3-855c-949d9ad89081 None admin] PATH_INFO: `/v3/users/9c46ea3083f64a6cabe000f8baea17dd` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:17.673299 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df06283-0655-45f3-855c-949d9ad89081 None admin] RBAC: Authorizing `identity:get_user(user_id=9c46ea3083f64a6cabe000f8baea17dd)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:17.674724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df06283-0655-45f3-855c-949d9ad89081 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:17.676326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 572/1151] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:08:17 2022] GET /identity/v3/users/9c46ea3083f64a6cabe000f8baea17dd => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:17.682161 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0123681-9e29-4b15-895f-4d4dcd126979 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:17.713172 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:17.784169 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0123681-9e29-4b15-895f-4d4dcd126979 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:17.823751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551b598-3ec5-46a5-a67c-a10c9d6def64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:17.824394 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551b598-3ec5-46a5-a67c-a10c9d6def64 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:17.824674 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551b598-3ec5-46a5-a67c-a10c9d6def64 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:17.824950 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551b598-3ec5-46a5-a67c-a10c9d6def64 None admin] PATH_INFO: `/v3/projects/cd762de73b2c4b65a72b30f67b256d9e` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:17.826123 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551b598-3ec5-46a5-a67c-a10c9d6def64 None admin] RBAC: Authorizing `identity:get_project(project_id=cd762de73b2c4b65a72b30f67b256d9e)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:17.827651 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551b598-3ec5-46a5-a67c-a10c9d6def64 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:17.829339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 580/1152] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:08:17 2022] GET /identity/v3/projects/cd762de73b2c4b65a72b30f67b256d9e => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:17.836819 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df06283-0655-45f3-855c-949d9ad89081 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:17.929035 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:17.947334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df06283-0655-45f3-855c-949d9ad89081 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:17.984592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc9347-b3c8-4dad-a3ca-ba84967e595a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:17.985257 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc9347-b3c8-4dad-a3ca-ba84967e595a None admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:17.985537 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc9347-b3c8-4dad-a3ca-ba84967e595a None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:17.985809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc9347-b3c8-4dad-a3ca-ba84967e595a None admin] PATH_INFO: `/v3/projects/cd762de73b2c4b65a72b30f67b256d9e/users/9c46ea3083f64a6cabe000f8baea17dd/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:17.987718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc9347-b3c8-4dad-a3ca-ba84967e595a None admin] RBAC: Authorizing `identity:create_grant(project_id=cd762de73b2c4b65a72b30f67b256d9e, user_id=9c46ea3083f64a6cabe000f8baea17dd, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:17.989140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc9347-b3c8-4dad-a3ca-ba84967e595a None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:18.062791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 573/1153] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Sep 6 20:08:17 2022] PUT /identity/v3/projects/cd762de73b2c4b65a72b30f67b256d9e/users/9c46ea3083f64a6cabe000f8baea17dd/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:08:20.227799 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cba22d-8680-4291-8290-d658e4663e6e None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:20.228384 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cba22d-8680-4291-8290-d658e4663e6e None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:20.228384 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cba22d-8680-4291-8290-d658e4663e6e None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:20.229594 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 581/1154] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:08:20.235798 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bdb2e-b680-4ca9-b907-25272ecfac31 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:20.236268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bdb2e-b680-4ca9-b907-25272ecfac31 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:20.236362 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bdb2e-b680-4ca9-b907-25272ecfac31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:20.254617 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-d41bdb2e-b680-4ca9-b907-25272ecfac31 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:08:20.255862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-d41bdb2e-b680-4ca9-b907-25272ecfac31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:08:20.323214 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 574/1155] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:08:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:08:20.589860 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cba22d-8680-4291-8290-d658e4663e6e None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:20.691426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:20.695992 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cba22d-8680-4291-8290-d658e4663e6e None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:20.730728 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16c1c6-f438-4136-9e3f-7cda85470386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:20.731942 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16c1c6-f438-4136-9e3f-7cda85470386 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:20.732222 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16c1c6-f438-4136-9e3f-7cda85470386 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:20.732492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16c1c6-f438-4136-9e3f-7cda85470386 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:20.743121 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16c1c6-f438-4136-9e3f-7cda85470386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:08:20.748494 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-9e16c1c6-f438-4136-9e3f-7cda85470386 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:08:20.748494 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:08:20.748494 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:08:20.748494 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:08:20.748494 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:08:20.748494 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:08:20.748494 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:08:20.748494 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:08:20.748494 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:08:20.748494 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:08:20.748494 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:08:20.748494 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:08:20.748494 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:08:20.748494 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:08:20.748494 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:08:20.748494 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:08:20.749600 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:08:20.749600 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:08:20.749600 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:08:20.749600 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:08:20.749600 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:08:20.749600 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:08:20.749600 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:08:20.749600 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:08:20.749600 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:08:20.749600 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:08:20.749600 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:08:20.749600 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:08:20.749600 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:08:20.749600 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:08:20.749600 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:08:20.749600 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:08:20.751119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:08:20.751119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:08:20.751119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:08:20.751119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:08:20.751119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:08:20.751119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:08:20.751119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:08:20.751119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:08:20.751119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:08:20.751119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:08:20.751119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:08:20.751119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:08:20.751119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 582/1156] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:08:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:08:20.755960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bdb2e-b680-4ca9-b907-25272ecfac31 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:20.823946 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:20.855829 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bdb2e-b680-4ca9-b907-25272ecfac31 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:20.890722 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a4669-751a-444e-80e2-2589419a8008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:20.891310 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a4669-751a-444e-80e2-2589419a8008 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:20.891619 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a4669-751a-444e-80e2-2589419a8008 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:20.891890 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a4669-751a-444e-80e2-2589419a8008 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:20.892541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a4669-751a-444e-80e2-2589419a8008 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:08:20.892848 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a4669-751a-444e-80e2-2589419a8008 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:20.894232 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a4669-751a-444e-80e2-2589419a8008 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:20.902969 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 575/1157] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:08:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:20.909885 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16c1c6-f438-4136-9e3f-7cda85470386 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:21.013136 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16c1c6-f438-4136-9e3f-7cda85470386 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:21.049001 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933553ba-d5d9-46a3-ab9c-7a31aade6035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:21.049548 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933553ba-d5d9-46a3-ab9c-7a31aade6035 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:21.049828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933553ba-d5d9-46a3-ab9c-7a31aade6035 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:21.050101 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933553ba-d5d9-46a3-ab9c-7a31aade6035 None admin] PATH_INFO: `/v3/users/9c46ea3083f64a6cabe000f8baea17dd` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:21.051215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933553ba-d5d9-46a3-ab9c-7a31aade6035 None admin] RBAC: Authorizing `identity:get_user(user_id=9c46ea3083f64a6cabe000f8baea17dd)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:21.052682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933553ba-d5d9-46a3-ab9c-7a31aade6035 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:21.054262 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 583/1158] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:08:20 2022] GET /identity/v3/users/9c46ea3083f64a6cabe000f8baea17dd => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:21.060139 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a4669-751a-444e-80e2-2589419a8008 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:21.166976 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a4669-751a-444e-80e2-2589419a8008 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:21.195712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:21.200864 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621c9ce-a542-4907-975f-6ba9501cf15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:21.201465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621c9ce-a542-4907-975f-6ba9501cf15a None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:21.201739 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621c9ce-a542-4907-975f-6ba9501cf15a None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:21.202007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621c9ce-a542-4907-975f-6ba9501cf15a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:21.270582 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621c9ce-a542-4907-975f-6ba9501cf15a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:21.272069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621c9ce-a542-4907-975f-6ba9501cf15a None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:21.369772 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 576/1159] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:08:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 20:08:21.376061 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933553ba-d5d9-46a3-ab9c-7a31aade6035 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:21.404778 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:21.478938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933553ba-d5d9-46a3-ab9c-7a31aade6035 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:21.513096 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec718fd9-c679-40e8-873a-52d45d67a1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:21.513717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec718fd9-c679-40e8-873a-52d45d67a1bb None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:21.513994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec718fd9-c679-40e8-873a-52d45d67a1bb None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:21.514274 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec718fd9-c679-40e8-873a-52d45d67a1bb None admin] PATH_INFO: `/v3/projects/cd762de73b2c4b65a72b30f67b256d9e` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:21.515371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec718fd9-c679-40e8-873a-52d45d67a1bb None admin] RBAC: Authorizing `identity:get_project(project_id=cd762de73b2c4b65a72b30f67b256d9e)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:21.516827 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec718fd9-c679-40e8-873a-52d45d67a1bb None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:21.518440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 584/1160] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:08:21 2022] GET /identity/v3/projects/cd762de73b2c4b65a72b30f67b256d9e => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:21.524626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621c9ce-a542-4907-975f-6ba9501cf15a None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:21.554363 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:21.620623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621c9ce-a542-4907-975f-6ba9501cf15a None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:21.655108 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f86789-e835-4fea-98a4-d0eda1d7b078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:21.655724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f86789-e835-4fea-98a4-d0eda1d7b078 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:21.656000 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f86789-e835-4fea-98a4-d0eda1d7b078 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:21.656266 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f86789-e835-4fea-98a4-d0eda1d7b078 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:21.656978 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f86789-e835-4fea-98a4-d0eda1d7b078 None admin] RBAC: Adding query filter params (role.id=1e2ac44410664e6b8f42ab3c37e2643f, scope.project.id=cd762de73b2c4b65a72b30f67b256d9e, user.id=9c46ea3083f64a6cabe000f8baea17dd) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:08:21.657276 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f86789-e835-4fea-98a4-d0eda1d7b078 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:21.658694 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f86789-e835-4fea-98a4-d0eda1d7b078 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:21.664494 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 577/1161] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:08:21 2022] GET /identity/v3/role_assignments?user.id=9c46ea3083f64a6cabe000f8baea17dd&scope.project.id=cd762de73b2c4b65a72b30f67b256d9e&role.id=1e2ac44410664e6b8f42ab3c37e2643f => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:23.851485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14ab9e-45c2-4b94-af82-00c7f4106a1e None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:23.852033 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14ab9e-45c2-4b94-af82-00c7f4106a1e None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:23.852033 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14ab9e-45c2-4b94-af82-00c7f4106a1e None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:23.853377 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 585/1162] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:08:23.858809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606b5b4-1912-4e00-b980-17e83377a4d9 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:23.859280 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606b5b4-1912-4e00-b980-17e83377a4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:23.859374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606b5b4-1912-4e00-b980-17e83377a4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:23.877686 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-3606b5b4-1912-4e00-b980-17e83377a4d9 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:08:23.878902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-3606b5b4-1912-4e00-b980-17e83377a4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:08:23.948140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 578/1163] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:08:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:08:24.216981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14ab9e-45c2-4b94-af82-00c7f4106a1e None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:24.314447 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:24.321939 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14ab9e-45c2-4b94-af82-00c7f4106a1e None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:24.356274 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acde61-b073-4efb-b8e1-529e95dc9bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:24.356869 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acde61-b073-4efb-b8e1-529e95dc9bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:24.357148 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acde61-b073-4efb-b8e1-529e95dc9bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:24.357420 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acde61-b073-4efb-b8e1-529e95dc9bb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:24.424464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07acde61-b073-4efb-b8e1-529e95dc9bb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:24.425922 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07acde61-b073-4efb-b8e1-529e95dc9bb1 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:24.514997 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:24.522141 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 586/1164] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:08:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 20:08:24.528118 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606b5b4-1912-4e00-b980-17e83377a4d9 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:24.555143 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:24.626817 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606b5b4-1912-4e00-b980-17e83377a4d9 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:24.660340 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533869c-f1af-4d7e-825d-92abb49f8619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:24.661000 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533869c-f1af-4d7e-825d-92abb49f8619 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:24.661281 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533869c-f1af-4d7e-825d-92abb49f8619 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:24.661555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533869c-f1af-4d7e-825d-92abb49f8619 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:24.668310 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533869c-f1af-4d7e-825d-92abb49f8619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:24.670346 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533869c-f1af-4d7e-825d-92abb49f8619 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:24.681696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-f533869c-f1af-4d7e-825d-92abb49f8619 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 06 20:08:24.681696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:08:24.681696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 06 20:08:24.681696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 06 20:08:24.681696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:08:24.681696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:08:24.681696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:08:24.681696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:08:24.681696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 06 20:08:24.681696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:08:24.681696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:08:24.681696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:08:24.681696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:08:24.681696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:08:24.681696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:08:24.681696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:08:24.681696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:08:24.682883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:08:24.682883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:08:24.682883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:08:24.682883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:08:24.682883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:08:24.682883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:08:24.682883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:08:24.682883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:08:24.682883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:08:24.682883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:08:24.682883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:08:24.682883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:08:24.682883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:08:24.682883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:08:24.682883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:08:24.682883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:08:24.683940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:08:24.683940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:08:24.683940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:08:24.683940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:08:24.683940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:08:24.683940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:08:24.683940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:08:24.683940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:08:24.683940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:08:24.683940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:08:24.683940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 06 20:08:24.683940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:08:24.683940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 06 20:08:24.683940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:08:24.683940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 579/1165] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Sep 6 20:08:24 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:08:24.689008 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acde61-b073-4efb-b8e1-529e95dc9bb1 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:24.789684 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acde61-b073-4efb-b8e1-529e95dc9bb1 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:24.824410 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfbca0-b097-4d78-b7c8-6b1fd3a7dd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:24.825025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfbca0-b097-4d78-b7c8-6b1fd3a7dd4f None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:24.825312 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfbca0-b097-4d78-b7c8-6b1fd3a7dd4f None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:24.825592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfbca0-b097-4d78-b7c8-6b1fd3a7dd4f None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:24.826229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfbca0-b097-4d78-b7c8-6b1fd3a7dd4f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:08:24.826536 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfbca0-b097-4d78-b7c8-6b1fd3a7dd4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:24.827948 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfbca0-b097-4d78-b7c8-6b1fd3a7dd4f None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:24.835162 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 587/1166] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Sep 6 20:08:24 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:27.002137 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e71a9-f158-44e0-b5fd-4c71019269e1 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:27.002664 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e71a9-f158-44e0-b5fd-4c71019269e1 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:27.002664 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e71a9-f158-44e0-b5fd-4c71019269e1 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:27.004042 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 580/1167] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:08:27.009446 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea29946-08f8-43be-b78c-0ba9999b5c71 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:27.009840 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea29946-08f8-43be-b78c-0ba9999b5c71 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:27.010006 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea29946-08f8-43be-b78c-0ba9999b5c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:27.028938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-dea29946-08f8-43be-b78c-0ba9999b5c71 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:08:27.030126 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-dea29946-08f8-43be-b78c-0ba9999b5c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:08:27.083535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:27.096818 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 588/1168] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:08:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:08:27.364981 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e71a9-f158-44e0-b5fd-4c71019269e1 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:27.452285 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:27.469454 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e71a9-f158-44e0-b5fd-4c71019269e1 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:27.504494 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e21e9c-65fd-4b7c-b57f-eb6d17c22e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:27.505094 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e21e9c-65fd-4b7c-b57f-eb6d17c22e04 None admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:27.505376 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e21e9c-65fd-4b7c-b57f-eb6d17c22e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:27.505647 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e21e9c-65fd-4b7c-b57f-eb6d17c22e04 None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:27.506314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e21e9c-65fd-4b7c-b57f-eb6d17c22e04 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:27.507701 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e21e9c-65fd-4b7c-b57f-eb6d17c22e04 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:27.629271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 581/1169] 10.222.0.77 () {60 vars in 1138 bytes} [Tue Sep 6 20:08:27 2022] POST /identity/v3/domains => generated 267 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:08:29.816017 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cf7b1-a95c-44e6-9f1d-72ce1fb05b26 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:29.816572 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cf7b1-a95c-44e6-9f1d-72ce1fb05b26 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:29.816572 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cf7b1-a95c-44e6-9f1d-72ce1fb05b26 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:29.817994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 589/1170] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:08:29.824167 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f99241-5360-4997-b79d-1f8e77d206b1 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:29.825537 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f99241-5360-4997-b79d-1f8e77d206b1 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:29.825537 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f99241-5360-4997-b79d-1f8e77d206b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:29.845699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-f3f99241-5360-4997-b79d-1f8e77d206b1 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:08:29.847550 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f3f99241-5360-4997-b79d-1f8e77d206b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:08:29.936316 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 582/1171] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:08:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:08:30.237480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cf7b1-a95c-44e6-9f1d-72ce1fb05b26 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:30.358870 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cf7b1-a95c-44e6-9f1d-72ce1fb05b26 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:30.399962 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a7478-de1a-4be8-979c-b9d4ef19d5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:30.400599 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a7478-de1a-4be8-979c-b9d4ef19d5be None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:30.400880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a7478-de1a-4be8-979c-b9d4ef19d5be None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:30.401157 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a7478-de1a-4be8-979c-b9d4ef19d5be None admin] PATH_INFO: `/v3/domains/46835a5875c14319938434182193457d` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:30.412909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a7478-de1a-4be8-979c-b9d4ef19d5be None admin] RBAC: Authorizing `identity:get_domain(domain_id=46835a5875c14319938434182193457d)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:30.415701 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a7478-de1a-4be8-979c-b9d4ef19d5be None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:30.418296 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 590/1172] 10.222.0.77 () {56 vars in 1183 bytes} [Tue Sep 6 20:08:30 2022] GET /identity/v3/domains/46835a5875c14319938434182193457d => generated 267 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:30.427252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f99241-5360-4997-b79d-1f8e77d206b1 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:30.515638 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:30.540587 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f99241-5360-4997-b79d-1f8e77d206b1 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:30.579100 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd97c7f-ab47-4b57-83fb-99646f300077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:30.579751 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd97c7f-ab47-4b57-83fb-99646f300077 None admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:30.580029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd97c7f-ab47-4b57-83fb-99646f300077 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:30.580369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd97c7f-ab47-4b57-83fb-99646f300077 None admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:30.581033 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd97c7f-ab47-4b57-83fb-99646f300077 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:30.582541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd97c7f-ab47-4b57-83fb-99646f300077 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:30.686652 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 583/1173] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Sep 6 20:08:30 2022] POST /identity/v3/projects => generated 361 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:08:32.882604 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888db354-6fc4-4d65-b84f-66344977a965 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:32.883135 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888db354-6fc4-4d65-b84f-66344977a965 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:32.883135 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888db354-6fc4-4d65-b84f-66344977a965 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:32.884537 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 591/1174] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:08:32.889932 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1622e0-8eef-4589-839a-c7e102c40e36 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:32.890342 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1622e0-8eef-4589-839a-c7e102c40e36 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:32.890487 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1622e0-8eef-4589-839a-c7e102c40e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:32.908990 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-fe1622e0-8eef-4589-839a-c7e102c40e36 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:08:32.910214 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-fe1622e0-8eef-4589-839a-c7e102c40e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:08:32.980530 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 584/1175] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:08:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:08:33.252160 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888db354-6fc4-4d65-b84f-66344977a965 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:33.304051 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:33.357640 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888db354-6fc4-4d65-b84f-66344977a965 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:33.391560 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edf117-bb4a-47aa-850a-65edff54a7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:33.392188 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edf117-bb4a-47aa-850a-65edff54a7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:33.392467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edf117-bb4a-47aa-850a-65edff54a7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:33.392739 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edf117-bb4a-47aa-850a-65edff54a7e5 None admin] PATH_INFO: `/v3/domains/46835a5875c14319938434182193457d` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:33.393839 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edf117-bb4a-47aa-850a-65edff54a7e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=46835a5875c14319938434182193457d)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:33.395270 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edf117-bb4a-47aa-850a-65edff54a7e5 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:33.396882 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 592/1176] 10.222.0.77 () {56 vars in 1183 bytes} [Tue Sep 6 20:08:33 2022] GET /identity/v3/domains/46835a5875c14319938434182193457d => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:33.403494 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1622e0-8eef-4589-839a-c7e102c40e36 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:33.461970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:33.502791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1622e0-8eef-4589-839a-c7e102c40e36 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:33.534471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87e7da-fcdd-4ef2-8d17-607401da3d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:33.535068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87e7da-fcdd-4ef2-8d17-607401da3d96 None admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:33.535343 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87e7da-fcdd-4ef2-8d17-607401da3d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:33.540848 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87e7da-fcdd-4ef2-8d17-607401da3d96 None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:33.540848 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87e7da-fcdd-4ef2-8d17-607401da3d96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:33.540848 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87e7da-fcdd-4ef2-8d17-607401da3d96 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:33.622481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 585/1177] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Sep 6 20:08:33 2022] POST /identity/v3/users => generated 311 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:08:35.826509 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57a17d-ff0a-4463-86cf-1ef992c6db43 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:35.827190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57a17d-ff0a-4463-86cf-1ef992c6db43 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:35.827190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57a17d-ff0a-4463-86cf-1ef992c6db43 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:35.828434 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 593/1178] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:08:35.834559 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ef1e4-3725-4af3-8c7a-6d3b58df1953 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:35.835028 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ef1e4-3725-4af3-8c7a-6d3b58df1953 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:35.835396 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ef1e4-3725-4af3-8c7a-6d3b58df1953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:35.854377 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-6a1ef1e4-3725-4af3-8c7a-6d3b58df1953 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:08:35.855606 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6a1ef1e4-3725-4af3-8c7a-6d3b58df1953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:08:35.924026 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 586/1179] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:08:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:08:36.200399 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57a17d-ff0a-4463-86cf-1ef992c6db43 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:36.306695 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57a17d-ff0a-4463-86cf-1ef992c6db43 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:36.323740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:36.341955 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a3b97-89a1-47e3-b78c-dc93f3aa3dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:36.342578 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a3b97-89a1-47e3-b78c-dc93f3aa3dff None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:36.343323 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a3b97-89a1-47e3-b78c-dc93f3aa3dff None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:36.343323 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a3b97-89a1-47e3-b78c-dc93f3aa3dff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:36.353537 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a3b97-89a1-47e3-b78c-dc93f3aa3dff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:08:36.358412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-eb6a3b97-89a1-47e3-b78c-dc93f3aa3dff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:08:36.358412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:08:36.358412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:08:36.358412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:08:36.358412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:08:36.358412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:08:36.358412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:08:36.358412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:08:36.358412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:08:36.358412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:08:36.358412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:08:36.358412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:08:36.358412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:08:36.358412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:08:36.358412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:08:36.358412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:08:36.359568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:08:36.359568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:08:36.359568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:08:36.359568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:08:36.359568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:08:36.359568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:08:36.359568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:08:36.359568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:08:36.359568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:08:36.359568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:08:36.359568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:08:36.359568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:08:36.359568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:08:36.359568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:08:36.359568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:08:36.359568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:08:36.360607 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:08:36.360607 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:08:36.360607 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:08:36.360607 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:08:36.360607 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:08:36.360607 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:08:36.360607 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:08:36.360607 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:08:36.360607 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:08:36.360607 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:08:36.360607 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:08:36.360607 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:08:36.360607 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 594/1180] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:08:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:08:36.365684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ef1e4-3725-4af3-8c7a-6d3b58df1953 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:36.412147 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:36.477602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ef1e4-3725-4af3-8c7a-6d3b58df1953 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:36.513509 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32222b4d-d812-4345-b47a-b6a0de6aa213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:36.514109 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32222b4d-d812-4345-b47a-b6a0de6aa213 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:36.514391 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32222b4d-d812-4345-b47a-b6a0de6aa213 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:36.514664 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32222b4d-d812-4345-b47a-b6a0de6aa213 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:36.515417 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32222b4d-d812-4345-b47a-b6a0de6aa213 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:08:36.515776 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32222b4d-d812-4345-b47a-b6a0de6aa213 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:36.517217 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32222b4d-d812-4345-b47a-b6a0de6aa213 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:36.525549 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 587/1181] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:08:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:36.532351 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a3b97-89a1-47e3-b78c-dc93f3aa3dff None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:36.641725 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a3b97-89a1-47e3-b78c-dc93f3aa3dff None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:36.675981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2319733-fad6-4f38-bd74-c1d53a1d782e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:36.676601 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2319733-fad6-4f38-bd74-c1d53a1d782e None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:36.676876 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2319733-fad6-4f38-bd74-c1d53a1d782e None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:36.677145 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2319733-fad6-4f38-bd74-c1d53a1d782e None admin] PATH_INFO: `/v3/users/3edf6b29ba2740aead83fe3b17ba62bb` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:36.690844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2319733-fad6-4f38-bd74-c1d53a1d782e None admin] RBAC: Authorizing `identity:get_user(user_id=3edf6b29ba2740aead83fe3b17ba62bb)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:36.692296 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2319733-fad6-4f38-bd74-c1d53a1d782e None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:36.693899 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 595/1182] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:08:36 2022] GET /identity/v3/users/3edf6b29ba2740aead83fe3b17ba62bb => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:36.700672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32222b4d-d812-4345-b47a-b6a0de6aa213 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:36.811288 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32222b4d-d812-4345-b47a-b6a0de6aa213 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:36.820981 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:36.851984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0608f-8e58-4797-8ce2-a04765d54b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:36.853003 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0608f-8e58-4797-8ce2-a04765d54b3d None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:36.853003 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0608f-8e58-4797-8ce2-a04765d54b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:36.853304 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0608f-8e58-4797-8ce2-a04765d54b3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:36.935946 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0608f-8e58-4797-8ce2-a04765d54b3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:36.937404 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0608f-8e58-4797-8ce2-a04765d54b3d None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:37.055282 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 588/1183] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:08:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 20:08:37.062014 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2319733-fad6-4f38-bd74-c1d53a1d782e None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:37.096468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:37.164217 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2319733-fad6-4f38-bd74-c1d53a1d782e None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:37.198658 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cff00f-fd53-4010-adaa-e51c5aad320c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:37.199279 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cff00f-fd53-4010-adaa-e51c5aad320c None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:37.199581 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cff00f-fd53-4010-adaa-e51c5aad320c None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:37.199870 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cff00f-fd53-4010-adaa-e51c5aad320c None admin] PATH_INFO: `/v3/projects/e5c45ce024264819a7310be795ef889f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:37.200977 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cff00f-fd53-4010-adaa-e51c5aad320c None admin] RBAC: Authorizing `identity:get_project(project_id=e5c45ce024264819a7310be795ef889f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:37.202393 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cff00f-fd53-4010-adaa-e51c5aad320c None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:37.204042 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 596/1184] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:08:37 2022] GET /identity/v3/projects/e5c45ce024264819a7310be795ef889f => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:37.210258 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0608f-8e58-4797-8ce2-a04765d54b3d None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:37.218537 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:37.311140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0608f-8e58-4797-8ce2-a04765d54b3d None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:37.347665 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac49acf-c4bd-40e1-9129-3e816409e9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:37.348180 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac49acf-c4bd-40e1-9129-3e816409e9d3 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:37.348450 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac49acf-c4bd-40e1-9129-3e816409e9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:37.348721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac49acf-c4bd-40e1-9129-3e816409e9d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:37.349431 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac49acf-c4bd-40e1-9129-3e816409e9d3 None admin] RBAC: Adding query filter params (role.id=1e2ac44410664e6b8f42ab3c37e2643f, scope.project.id=e5c45ce024264819a7310be795ef889f, user.id=3edf6b29ba2740aead83fe3b17ba62bb) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:08:37.349731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac49acf-c4bd-40e1-9129-3e816409e9d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:37.351139 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac49acf-c4bd-40e1-9129-3e816409e9d3 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:37.356752 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 589/1185] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:08:37 2022] GET /identity/v3/role_assignments?user.id=3edf6b29ba2740aead83fe3b17ba62bb&scope.project.id=e5c45ce024264819a7310be795ef889f&role.id=1e2ac44410664e6b8f42ab3c37e2643f => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:39.479470 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1ac55-5173-4a9f-a69c-1134e257b37f None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:39.480056 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1ac55-5173-4a9f-a69c-1134e257b37f None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:39.480056 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1ac55-5173-4a9f-a69c-1134e257b37f None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:39.481851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 597/1186] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:08:39.487231 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e968417-96ff-48fa-9ef0-8126e2a6923e None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:39.487715 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e968417-96ff-48fa-9ef0-8126e2a6923e None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:39.487809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e968417-96ff-48fa-9ef0-8126e2a6923e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:39.506335 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-3e968417-96ff-48fa-9ef0-8126e2a6923e None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:08:39.507536 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-3e968417-96ff-48fa-9ef0-8126e2a6923e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:08:39.570559 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:39.575158 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 590/1187] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:08:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:08:39.845581 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1ac55-5173-4a9f-a69c-1134e257b37f None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:39.949220 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1ac55-5173-4a9f-a69c-1134e257b37f None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:39.950826 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:39.985484 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6fddf-7747-484f-80d2-07d7776592cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:39.986245 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6fddf-7747-484f-80d2-07d7776592cf None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:39.986524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6fddf-7747-484f-80d2-07d7776592cf None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:39.986796 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6fddf-7747-484f-80d2-07d7776592cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:39.998574 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6fddf-7747-484f-80d2-07d7776592cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:08:40.003877 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-79c6fddf-7747-484f-80d2-07d7776592cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:08:40.003877 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:08:40.003877 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:08:40.003877 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:08:40.003877 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:08:40.003877 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:08:40.003877 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:08:40.003877 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:08:40.003877 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:08:40.003877 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:08:40.003877 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:08:40.003877 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:08:40.003877 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:08:40.003877 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:08:40.003877 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:08:40.003877 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:08:40.005108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:08:40.005108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:08:40.005108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:08:40.005108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:08:40.005108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:08:40.005108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:08:40.005108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:08:40.005108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:08:40.005108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:08:40.005108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:08:40.005108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:08:40.005108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:08:40.005108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:08:40.005108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:08:40.005108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:08:40.005108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:08:40.006290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:08:40.006290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:08:40.006290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:08:40.006290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:08:40.006290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:08:40.006290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:08:40.006290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:08:40.006290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:08:40.006290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:08:40.006290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:08:40.006290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:08:40.006290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:08:40.007613 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 598/1188] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:08:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:08:40.011535 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e968417-96ff-48fa-9ef0-8126e2a6923e None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:40.114433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e968417-96ff-48fa-9ef0-8126e2a6923e None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:40.148586 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c415b4-c325-46f8-bb82-277fe0eeb286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:40.149193 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c415b4-c325-46f8-bb82-277fe0eeb286 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:40.149467 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c415b4-c325-46f8-bb82-277fe0eeb286 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:40.149736 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c415b4-c325-46f8-bb82-277fe0eeb286 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:40.150398 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c415b4-c325-46f8-bb82-277fe0eeb286 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:08:40.150709 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c415b4-c325-46f8-bb82-277fe0eeb286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:40.152268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c415b4-c325-46f8-bb82-277fe0eeb286 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:40.161109 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 591/1189] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:08:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:40.167051 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6fddf-7747-484f-80d2-07d7776592cf None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:40.267362 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6fddf-7747-484f-80d2-07d7776592cf None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:40.301309 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01215711-9ece-417c-a01c-cfb4c7cf275e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:40.301930 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01215711-9ece-417c-a01c-cfb4c7cf275e None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:40.302210 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01215711-9ece-417c-a01c-cfb4c7cf275e None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:40.302483 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01215711-9ece-417c-a01c-cfb4c7cf275e None admin] PATH_INFO: `/v3/users/3edf6b29ba2740aead83fe3b17ba62bb` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:40.303640 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01215711-9ece-417c-a01c-cfb4c7cf275e None admin] RBAC: Authorizing `identity:get_user(user_id=3edf6b29ba2740aead83fe3b17ba62bb)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:40.305080 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01215711-9ece-417c-a01c-cfb4c7cf275e None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:40.306660 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 599/1190] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:08:40 2022] GET /identity/v3/users/3edf6b29ba2740aead83fe3b17ba62bb => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:40.312711 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c415b4-c325-46f8-bb82-277fe0eeb286 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:40.375765 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:40.415534 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c415b4-c325-46f8-bb82-277fe0eeb286 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:40.452063 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf4c98-1e6c-4ac0-82dc-56913bb4b48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:40.452721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf4c98-1e6c-4ac0-82dc-56913bb4b48e None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:40.452999 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf4c98-1e6c-4ac0-82dc-56913bb4b48e None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:40.453274 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf4c98-1e6c-4ac0-82dc-56913bb4b48e None admin] PATH_INFO: `/v3/projects/e5c45ce024264819a7310be795ef889f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:40.454424 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf4c98-1e6c-4ac0-82dc-56913bb4b48e None admin] RBAC: Authorizing `identity:get_project(project_id=e5c45ce024264819a7310be795ef889f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:40.455900 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf4c98-1e6c-4ac0-82dc-56913bb4b48e None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:40.457545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 592/1191] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:08:40 2022] GET /identity/v3/projects/e5c45ce024264819a7310be795ef889f => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:40.463688 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01215711-9ece-417c-a01c-cfb4c7cf275e None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:40.495170 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:40.569931 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01215711-9ece-417c-a01c-cfb4c7cf275e None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:40.604909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa9d03-2bb4-404f-b040-52b41fe69c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:40.605568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa9d03-2bb4-404f-b040-52b41fe69c35 None admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:40.605851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa9d03-2bb4-404f-b040-52b41fe69c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:40.606222 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa9d03-2bb4-404f-b040-52b41fe69c35 None admin] PATH_INFO: `/v3/projects/e5c45ce024264819a7310be795ef889f/users/3edf6b29ba2740aead83fe3b17ba62bb/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:40.608187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa9d03-2bb4-404f-b040-52b41fe69c35 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5c45ce024264819a7310be795ef889f, user_id=3edf6b29ba2740aead83fe3b17ba62bb, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:40.609624 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa9d03-2bb4-404f-b040-52b41fe69c35 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:40.673438 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 600/1192] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Sep 6 20:08:40 2022] PUT /identity/v3/projects/e5c45ce024264819a7310be795ef889f/users/3edf6b29ba2740aead83fe3b17ba62bb/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:08:42.842293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29468bb5-8442-4b72-b89c-f526b315f572 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:42.842854 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29468bb5-8442-4b72-b89c-f526b315f572 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:42.842854 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29468bb5-8442-4b72-b89c-f526b315f572 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:42.844181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 593/1193] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:08:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:08:42.849617 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c7c45-c1be-49dd-a155-3001fb7cf6c9 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:42.850013 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c7c45-c1be-49dd-a155-3001fb7cf6c9 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:42.850173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c7c45-c1be-49dd-a155-3001fb7cf6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:42.869151 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-dd6c7c45-c1be-49dd-a155-3001fb7cf6c9 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:08:42.870346 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-dd6c7c45-c1be-49dd-a155-3001fb7cf6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:08:42.944857 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 601/1194] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:08:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:08:43.212956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29468bb5-8442-4b72-b89c-f526b315f572 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:43.333151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29468bb5-8442-4b72-b89c-f526b315f572 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:43.368387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:43.374365 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a946d-fd5b-4ba0-ac78-208b26a2671c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:43.380401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a946d-fd5b-4ba0-ac78-208b26a2671c None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:43.380401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a946d-fd5b-4ba0-ac78-208b26a2671c None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:43.380401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a946d-fd5b-4ba0-ac78-208b26a2671c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:43.385999 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a946d-fd5b-4ba0-ac78-208b26a2671c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:08:43.391369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-4a2a946d-fd5b-4ba0-ac78-208b26a2671c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:08:43.391369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:08:43.391369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:08:43.391369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:08:43.391369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:08:43.391369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:08:43.391369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:08:43.391369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:08:43.391369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:08:43.391369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:08:43.391369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:08:43.391369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:08:43.391369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:08:43.391369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:08:43.391369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:08:43.391369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:08:43.392714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:08:43.392714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:08:43.392714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:08:43.392714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:08:43.392714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:08:43.392714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:08:43.392714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:08:43.392714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:08:43.392714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:08:43.392714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:08:43.392714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:08:43.392714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:08:43.392714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:08:43.392714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:08:43.392714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:08:43.392714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:08:43.393712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:08:43.393712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:08:43.393712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:08:43.393712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:08:43.393712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:08:43.393712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:08:43.393712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:08:43.393712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:08:43.393712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:08:43.393712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:08:43.393712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:08:43.393712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:08:43.393712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 594/1195] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:08:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:08:43.398639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c7c45-c1be-49dd-a155-3001fb7cf6c9 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:43.420749 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:43.531962 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c7c45-c1be-49dd-a155-3001fb7cf6c9 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:43.565951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6545e-28f8-498c-8346-f7495cc50cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:43.566557 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6545e-28f8-498c-8346-f7495cc50cfe None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:43.566837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6545e-28f8-498c-8346-f7495cc50cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:43.567107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6545e-28f8-498c-8346-f7495cc50cfe None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:43.567795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6545e-28f8-498c-8346-f7495cc50cfe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:08:43.568098 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6545e-28f8-498c-8346-f7495cc50cfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:43.569461 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6545e-28f8-498c-8346-f7495cc50cfe None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:43.578146 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 602/1196] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:08:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:43.584254 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a946d-fd5b-4ba0-ac78-208b26a2671c None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:43.686431 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a946d-fd5b-4ba0-ac78-208b26a2671c None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:43.720177 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950768cd-e4cb-4f81-b362-50b143e77044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:43.720797 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950768cd-e4cb-4f81-b362-50b143e77044 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:43.721070 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950768cd-e4cb-4f81-b362-50b143e77044 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:43.721336 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950768cd-e4cb-4f81-b362-50b143e77044 None admin] PATH_INFO: `/v3/users/3edf6b29ba2740aead83fe3b17ba62bb` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:43.722436 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950768cd-e4cb-4f81-b362-50b143e77044 None admin] RBAC: Authorizing `identity:get_user(user_id=3edf6b29ba2740aead83fe3b17ba62bb)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:43.723923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950768cd-e4cb-4f81-b362-50b143e77044 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:43.725490 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 595/1197] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Sep 6 20:08:43 2022] GET /identity/v3/users/3edf6b29ba2740aead83fe3b17ba62bb => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:43.731987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6545e-28f8-498c-8346-f7495cc50cfe None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:43.816468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:43.835787 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6545e-28f8-498c-8346-f7495cc50cfe None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:43.871333 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fb6ae-09cb-4958-af96-2447c1d63375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:43.872106 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fb6ae-09cb-4958-af96-2447c1d63375 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:43.872245 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fb6ae-09cb-4958-af96-2447c1d63375 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:43.872513 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fb6ae-09cb-4958-af96-2447c1d63375 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:43.942483 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fb6ae-09cb-4958-af96-2447c1d63375 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:43.943959 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fb6ae-09cb-4958-af96-2447c1d63375 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:44.023715 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:44.043011 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 603/1198] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:08:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 20:08:44.049135 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950768cd-e4cb-4f81-b362-50b143e77044 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:44.110008 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:44.153781 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950768cd-e4cb-4f81-b362-50b143e77044 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:44.187453 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e91764-2eb4-45fe-b558-e51d97dcf9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:44.188083 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e91764-2eb4-45fe-b558-e51d97dcf9c8 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:44.188361 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e91764-2eb4-45fe-b558-e51d97dcf9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:44.188633 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e91764-2eb4-45fe-b558-e51d97dcf9c8 None admin] PATH_INFO: `/v3/projects/e5c45ce024264819a7310be795ef889f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:44.189733 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e91764-2eb4-45fe-b558-e51d97dcf9c8 None admin] RBAC: Authorizing `identity:get_project(project_id=e5c45ce024264819a7310be795ef889f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:44.191293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e91764-2eb4-45fe-b558-e51d97dcf9c8 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:44.192945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 596/1199] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Sep 6 20:08:44 2022] GET /identity/v3/projects/e5c45ce024264819a7310be795ef889f => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:08:44.199242 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fb6ae-09cb-4958-af96-2447c1d63375 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:08:44.298416 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fb6ae-09cb-4958-af96-2447c1d63375 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:08:44.332153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28047f53-7f89-4a0e-a357-32e4cc5d3dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:08:44.332755 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28047f53-7f89-4a0e-a357-32e4cc5d3dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:08:44.333035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28047f53-7f89-4a0e-a357-32e4cc5d3dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:08:44.333308 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28047f53-7f89-4a0e-a357-32e4cc5d3dc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:08:44.334028 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28047f53-7f89-4a0e-a357-32e4cc5d3dc4 None admin] RBAC: Adding query filter params (role.id=1e2ac44410664e6b8f42ab3c37e2643f, scope.project.id=e5c45ce024264819a7310be795ef889f, user.id=3edf6b29ba2740aead83fe3b17ba62bb) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:08:44.334335 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28047f53-7f89-4a0e-a357-32e4cc5d3dc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:08:44.335788 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28047f53-7f89-4a0e-a357-32e4cc5d3dc4 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:08:44.342235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 604/1200] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:08:44 2022] GET /identity/v3/role_assignments?user.id=3edf6b29ba2740aead83fe3b17ba62bb&scope.project.id=e5c45ce024264819a7310be795ef889f&role.id=1e2ac44410664e6b8f42ab3c37e2643f => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:08:54.183381 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=37 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:08:54.338907 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=77 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:06.305482 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c4ccd-1c55-4189-87eb-88b7d2289704 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:06.306116 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c4ccd-1c55-4189-87eb-88b7d2289704 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:06.306116 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c4ccd-1c55-4189-87eb-88b7d2289704 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:06.307374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 597/1201] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:10:06.312820 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975c69e-d1ea-4c54-8115-f11434a11a76 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:06.313272 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975c69e-d1ea-4c54-8115-f11434a11a76 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:06.313392 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975c69e-d1ea-4c54-8115-f11434a11a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:06.332348 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-c975c69e-d1ea-4c54-8115-f11434a11a76 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:10:06.333544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-c975c69e-d1ea-4c54-8115-f11434a11a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:10:06.401985 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 605/1202] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:10:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:10:06.673585 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c4ccd-1c55-4189-87eb-88b7d2289704 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:06.777877 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c4ccd-1c55-4189-87eb-88b7d2289704 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:06.811720 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389e878-95f7-4984-b64f-fb779dbbe185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:06.812882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389e878-95f7-4984-b64f-fb779dbbe185 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:06.813160 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389e878-95f7-4984-b64f-fb779dbbe185 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:06.813465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389e878-95f7-4984-b64f-fb779dbbe185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:06.824520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389e878-95f7-4984-b64f-fb779dbbe185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:06.825995 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389e878-95f7-4984-b64f-fb779dbbe185 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:06.843406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-e389e878-95f7-4984-b64f-fb779dbbe185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:10:06.843406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:06.843406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:06.843406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:06.843406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:06.843406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:06.843406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:06.843406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:06.843406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:06.843406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:06.843406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:06.843406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:06.843406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:10:06.843406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:10:06.843406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:10:06.843406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:10:06.846570 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:06.846570 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:06.846570 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:06.846570 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:06.846570 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:06.846570 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:06.846570 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:06.846570 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:06.846570 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:06.846570 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:06.846570 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:06.846570 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:06.846570 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:06.846570 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:06.846570 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:06.846570 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:06.846570 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:10:06.847594 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:10:06.847594 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:10:06.847594 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:10:06.847594 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 598/1203] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:10:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:06.851259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975c69e-d1ea-4c54-8115-f11434a11a76 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:06.953703 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975c69e-d1ea-4c54-8115-f11434a11a76 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:06.982754 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:06.989195 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d40b5-ee5e-4600-b6df-a405b5d71e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:06.989810 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d40b5-ee5e-4600-b6df-a405b5d71e2e None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:06.990086 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d40b5-ee5e-4600-b6df-a405b5d71e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:06.990355 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d40b5-ee5e-4600-b6df-a405b5d71e2e None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:06.990990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d40b5-ee5e-4600-b6df-a405b5d71e2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:06.991347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d40b5-ee5e-4600-b6df-a405b5d71e2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:06.992745 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d40b5-ee5e-4600-b6df-a405b5d71e2e None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:07.008172 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 606/1204] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:10:07.014611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389e878-95f7-4984-b64f-fb779dbbe185 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:07.068440 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:07.115208 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389e878-95f7-4984-b64f-fb779dbbe185 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:07.149082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af0c93-703c-434a-a14a-7bf187a571e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:07.149689 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af0c93-703c-434a-a14a-7bf187a571e9 None admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:07.149962 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af0c93-703c-434a-a14a-7bf187a571e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:07.150238 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af0c93-703c-434a-a14a-7bf187a571e9 None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:07.150888 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af0c93-703c-434a-a14a-7bf187a571e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:07.152501 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af0c93-703c-434a-a14a-7bf187a571e9 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:07.380672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 599/1205] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Sep 6 20:10:07 2022] POST /identity/v3/users => generated 251 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:10:09.580347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fda661-d54f-4ffd-90e7-a4c0fe986bf3 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:09.580915 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fda661-d54f-4ffd-90e7-a4c0fe986bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:09.580915 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fda661-d54f-4ffd-90e7-a4c0fe986bf3 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:09.582221 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 607/1206] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:10:09.587626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827f29d-f2eb-475f-af58-1c767ae439e4 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:09.590398 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827f29d-f2eb-475f-af58-1c767ae439e4 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:09.590398 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827f29d-f2eb-475f-af58-1c767ae439e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:09.606296 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-c827f29d-f2eb-475f-af58-1c767ae439e4 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:10:09.607522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c827f29d-f2eb-475f-af58-1c767ae439e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:10:09.676009 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 600/1207] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:10:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:10:09.943958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fda661-d54f-4ffd-90e7-a4c0fe986bf3 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:10.056633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fda661-d54f-4ffd-90e7-a4c0fe986bf3 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:10.091738 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f3b6c-7d89-40fd-8a13-d7cd3e225e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:10.092358 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f3b6c-7d89-40fd-8a13-d7cd3e225e48 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:10.092628 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f3b6c-7d89-40fd-8a13-d7cd3e225e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:10.092889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f3b6c-7d89-40fd-8a13-d7cd3e225e48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:10.104283 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f3b6c-7d89-40fd-8a13-d7cd3e225e48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:10:10.109230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-f51f3b6c-7d89-40fd-8a13-d7cd3e225e48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:10:10.109230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:10.109230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:10.109230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:10.109230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:10.109230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:10.109230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:10.109230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:10.109230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:10.109230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:10.109230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:10.109230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:10.109230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:10:10.109230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:10:10.109230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:10:10.109230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:10:10.110686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:10:10.110686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:10:10.110686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:10:10.110686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:10:10.110686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:10.110686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:10.110686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:10.110686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:10.110686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:10.110686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:10.110686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:10.110686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:10.110686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:10.110686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:10.110686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:10.110686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:10.111703 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:10.111703 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:10.111703 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:10.111703 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:10.111703 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:10:10.111703 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:10:10.111703 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:10:10.111703 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:10:10.111703 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:10:10.111703 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:10:10.111703 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:10:10.111703 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:10:10.111703 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 608/1208] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Sep 6 20:10:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:10:10.116652 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827f29d-f2eb-475f-af58-1c767ae439e4 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:10.157004 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:10.216903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827f29d-f2eb-475f-af58-1c767ae439e4 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:10.253041 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6568b1-b64e-49c4-9172-78fe7987b607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:10.253639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6568b1-b64e-49c4-9172-78fe7987b607 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:10.253920 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6568b1-b64e-49c4-9172-78fe7987b607 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:10.254190 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6568b1-b64e-49c4-9172-78fe7987b607 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:10.254841 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6568b1-b64e-49c4-9172-78fe7987b607 None admin] RBAC: Adding query filter params (name=service) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:10.255143 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6568b1-b64e-49c4-9172-78fe7987b607 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:10.256551 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6568b1-b64e-49c4-9172-78fe7987b607 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:10.264504 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 601/1209] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Sep 6 20:10:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:10.271234 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f3b6c-7d89-40fd-8a13-d7cd3e225e48 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:10.323312 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:10.378725 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f3b6c-7d89-40fd-8a13-d7cd3e225e48 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:10.412506 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2eea6-65be-4ae2-92ce-b062cc31d986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:10.413135 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2eea6-65be-4ae2-92ce-b062cc31d986 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:10.413413 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2eea6-65be-4ae2-92ce-b062cc31d986 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:10.413685 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2eea6-65be-4ae2-92ce-b062cc31d986 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:10.424264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2eea6-65be-4ae2-92ce-b062cc31d986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:10.425721 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2eea6-65be-4ae2-92ce-b062cc31d986 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:10.440758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-32c2eea6-65be-4ae2-92ce-b062cc31d986 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:10:10.440758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:10.440758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:10.440758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:10.440758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:10.440758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:10.440758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:10.440758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:10.440758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:10.440758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:10.440758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:10.440758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:10.440758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:10:10.440758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:10:10.440758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:10:10.440758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:10:10.442034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:10.442034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:10.442034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:10.442034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:10.442034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:10.442034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:10.442034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:10.442034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:10.442034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:10.442034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:10.442034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:10.442034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:10.442034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:10.442034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:10.442034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:10.442034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:10.442034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:10:10.443148 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:10:10.443148 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:10:10.443148 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:10:10.443148 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 609/1210] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:10:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:10.447733 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6568b1-b64e-49c4-9172-78fe7987b607 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:10.549224 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:10.552040 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6568b1-b64e-49c4-9172-78fe7987b607 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:10.588403 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557dbca5-cf34-47f7-9907-a896f59c36be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:10.589092 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dbca5-cf34-47f7-9907-a896f59c36be None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:10.589273 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dbca5-cf34-47f7-9907-a896f59c36be None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:10.589540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dbca5-cf34-47f7-9907-a896f59c36be None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:10.590175 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557dbca5-cf34-47f7-9907-a896f59c36be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:10.590479 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557dbca5-cf34-47f7-9907-a896f59c36be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:10.591866 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557dbca5-cf34-47f7-9907-a896f59c36be None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:10.602908 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 602/1211] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:10.608804 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2eea6-65be-4ae2-92ce-b062cc31d986 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:10.716072 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2eea6-65be-4ae2-92ce-b062cc31d986 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:10.717693 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:10.765009 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a931a0-9c78-4eb4-bada-c483bb81ac9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:10.766105 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a931a0-9c78-4eb4-bada-c483bb81ac9a None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:10.766392 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a931a0-9c78-4eb4-bada-c483bb81ac9a None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:10.766668 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a931a0-9c78-4eb4-bada-c483bb81ac9a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:10.775800 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a931a0-9c78-4eb4-bada-c483bb81ac9a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:10.777389 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a931a0-9c78-4eb4-bada-c483bb81ac9a None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:10.790259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-f1a931a0-9c78-4eb4-bada-c483bb81ac9a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 20:10:10.790259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:10.790259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:10.790259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:10.790259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:10.790259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:10.790259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:10.790259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:10.790259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:10.790259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:10.790259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:10.790259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:10.790259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:10:10.790259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:10:10.790259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:10:10.790259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:10:10.791500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:10.791500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:10.791500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:10:10.791500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:10:10.791500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:10:10.791500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:10:10.791500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:10.791500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:10.791500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:10.791500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:10.791500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:10.791500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:10.791500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:10.791500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:10.791500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:10.791500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:10.791500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:10.791500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:10.792707 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:10.792707 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:10.792707 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:10:10.792707 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:10:10.792707 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:10:10.792707 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:10:10.792707 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:10:10.792707 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:10:10.792707 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 20:10:10.792707 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:10:10.792707 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 610/1212] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:10:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:10.797927 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557dbca5-cf34-47f7-9907-a896f59c36be None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:10.900748 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557dbca5-cf34-47f7-9907-a896f59c36be None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:10.938678 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ed58e-16ed-4aa6-94bd-7693ee9ecafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:10.939304 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ed58e-16ed-4aa6-94bd-7693ee9ecafc None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:10.939613 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ed58e-16ed-4aa6-94bd-7693ee9ecafc None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:10.939885 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ed58e-16ed-4aa6-94bd-7693ee9ecafc None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:10.940617 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ed58e-16ed-4aa6-94bd-7693ee9ecafc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:10.940917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ed58e-16ed-4aa6-94bd-7693ee9ecafc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:10.942589 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ed58e-16ed-4aa6-94bd-7693ee9ecafc None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:10.962965 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 603/1213] 10.222.0.77 () {56 vars in 1143 bytes} [Tue Sep 6 20:10:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:10.968961 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a931a0-9c78-4eb4-bada-c483bb81ac9a None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:11.100607 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a931a0-9c78-4eb4-bada-c483bb81ac9a None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:11.140452 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067eee2-c0c4-4853-9e24-b27658f81bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:11.141070 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067eee2-c0c4-4853-9e24-b27658f81bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:11.141348 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067eee2-c0c4-4853-9e24-b27658f81bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:11.141614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067eee2-c0c4-4853-9e24-b27658f81bd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:11.175555 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:11.214843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067eee2-c0c4-4853-9e24-b27658f81bd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:11.216308 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067eee2-c0c4-4853-9e24-b27658f81bd3 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:11.317965 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 611/1214] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:10:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 20:10:11.324030 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ed58e-16ed-4aa6-94bd-7693ee9ecafc None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:11.344330 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:11.426398 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ed58e-16ed-4aa6-94bd-7693ee9ecafc None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:11.461517 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e628789-b046-401b-a957-6f569d49c9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:11.462147 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e628789-b046-401b-a957-6f569d49c9a4 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:11.462421 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e628789-b046-401b-a957-6f569d49c9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:11.462691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e628789-b046-401b-a957-6f569d49c9a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:11.473140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e628789-b046-401b-a957-6f569d49c9a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:11.474591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e628789-b046-401b-a957-6f569d49c9a4 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:11.489260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-8e628789-b046-401b-a957-6f569d49c9a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:10:11.489260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:11.489260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:11.489260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:11.489260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:11.489260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:11.489260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:11.489260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:11.489260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:11.489260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:11.489260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:11.489260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:11.489260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:10:11.489260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:10:11.489260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:10:11.489260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:10:11.490563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:11.490563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:11.490563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:11.490563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:11.490563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:11.490563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:11.490563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:11.490563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:11.490563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:11.490563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:11.490563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:11.490563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:11.490563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:11.490563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:11.490563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:11.490563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:11.490563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:10:11.491717 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:10:11.491717 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:10:11.491717 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:10:11.491717 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 604/1215] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:10:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:11.496376 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067eee2-c0c4-4853-9e24-b27658f81bd3 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:11.563049 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:11.603002 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067eee2-c0c4-4853-9e24-b27658f81bd3 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:11.636067 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0171fdc-e13c-42c2-9d5a-54a496f3051f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:11.637909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0171fdc-e13c-42c2-9d5a-54a496f3051f None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:11.637909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0171fdc-e13c-42c2-9d5a-54a496f3051f None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:11.637909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0171fdc-e13c-42c2-9d5a-54a496f3051f None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:11.637909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0171fdc-e13c-42c2-9d5a-54a496f3051f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:11.638277 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0171fdc-e13c-42c2-9d5a-54a496f3051f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:11.639382 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0171fdc-e13c-42c2-9d5a-54a496f3051f None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:11.651469 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 612/1216] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:11.657904 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e628789-b046-401b-a957-6f569d49c9a4 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:11.729408 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:11.761692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e628789-b046-401b-a957-6f569d49c9a4 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:11.799731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca4f30-52d7-4f84-b8d1-3f561ee770f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:11.800333 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca4f30-52d7-4f84-b8d1-3f561ee770f1 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:11.800647 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca4f30-52d7-4f84-b8d1-3f561ee770f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:11.800893 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca4f30-52d7-4f84-b8d1-3f561ee770f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:11.807373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca4f30-52d7-4f84-b8d1-3f561ee770f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:11.808827 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca4f30-52d7-4f84-b8d1-3f561ee770f1 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:11.820471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-24ca4f30-52d7-4f84-b8d1-3f561ee770f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:10:11.820471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:11.820471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:11.820471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:11.820471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:11.820471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:11.820471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:11.820471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:11.820471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:11.820471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:11.820471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:11.820471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:11.820471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:10:11.820471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:10:11.820471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:10:11.821527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:10:11.821527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:11.821527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:11.821527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:11.821527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:11.821527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:11.821527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:11.821527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:11.821527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:11.821527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:11.821527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:11.821527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:11.821527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:11.821527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:11.821527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:11.821527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:11.821527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:11.822696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:10:11.822696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:10:11.822696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:10:11.822696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:10:11.822696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:10:11.822696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:10:11.822696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:10:11.822696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:10:11.822696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 605/1217] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:10:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:11.827872 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0171fdc-e13c-42c2-9d5a-54a496f3051f None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:11.929932 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0171fdc-e13c-42c2-9d5a-54a496f3051f None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:11.953110 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:11.964444 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d75188-1a62-4d91-8726-18af5a512f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:11.965047 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d75188-1a62-4d91-8726-18af5a512f5e None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:11.965328 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d75188-1a62-4d91-8726-18af5a512f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:11.965601 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d75188-1a62-4d91-8726-18af5a512f5e None admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:11.966285 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d75188-1a62-4d91-8726-18af5a512f5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:11.966590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d75188-1a62-4d91-8726-18af5a512f5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:11.968062 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d75188-1a62-4d91-8726-18af5a512f5e None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:11.985239 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 613/1218] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:10:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:11.988990 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca4f30-52d7-4f84-b8d1-3f561ee770f1 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:12.095250 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca4f30-52d7-4f84-b8d1-3f561ee770f1 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:12.124623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:12.130503 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaebb42-d93e-4932-b50b-d620c4342717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:12.131110 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaebb42-d93e-4932-b50b-d620c4342717 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:12.131393 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaebb42-d93e-4932-b50b-d620c4342717 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:12.131699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaebb42-d93e-4932-b50b-d620c4342717 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:12.132417 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaebb42-d93e-4932-b50b-d620c4342717 None admin] RBAC: Adding query filter params (role.id=140b49dfcc2b489ca0504d2e7abfdbdb, scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343, user.id=2a486663ec144db0bbde6bf3deb35a8d) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:12.132731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaebb42-d93e-4932-b50b-d620c4342717 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:12.134211 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaebb42-d93e-4932-b50b-d620c4342717 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:12.139787 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 606/1219] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:10:11 2022] GET /identity/v3/role_assignments?user.id=2a486663ec144db0bbde6bf3deb35a8d&scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343&role.id=140b49dfcc2b489ca0504d2e7abfdbdb => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:14.278925 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38441d52-dab7-4ef8-84f0-626d0f57611c None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:14.279473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38441d52-dab7-4ef8-84f0-626d0f57611c None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:14.279473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38441d52-dab7-4ef8-84f0-626d0f57611c None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:14.280757 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 614/1220] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:10:14.286172 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995152da-8ca7-4360-94f9-4c7e3e1591a5 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:14.286613 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995152da-8ca7-4360-94f9-4c7e3e1591a5 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:14.286770 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995152da-8ca7-4360-94f9-4c7e3e1591a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:14.305664 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-995152da-8ca7-4360-94f9-4c7e3e1591a5 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:10:14.309036 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-995152da-8ca7-4360-94f9-4c7e3e1591a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:10:14.373140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 607/1221] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:10:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:10:14.646800 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38441d52-dab7-4ef8-84f0-626d0f57611c None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:14.753988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38441d52-dab7-4ef8-84f0-626d0f57611c None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:14.791692 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cbbcf-d7a8-4d39-b308-715f49e6eec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:14.792319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cbbcf-d7a8-4d39-b308-715f49e6eec3 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:14.792599 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cbbcf-d7a8-4d39-b308-715f49e6eec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:14.792863 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cbbcf-d7a8-4d39-b308-715f49e6eec3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:14.804451 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cbbcf-d7a8-4d39-b308-715f49e6eec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:10:14.809401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-f18cbbcf-d7a8-4d39-b308-715f49e6eec3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:10:14.809401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:14.809401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:14.809401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:14.809401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:14.809401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:14.809401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:14.809401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:14.809401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:14.809401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:14.809401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:14.809401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:14.809401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:10:14.809401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:10:14.809401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:10:14.809401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:10:14.817485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:10:14.817485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:10:14.817485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:10:14.817485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:10:14.817485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:14.817485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:14.817485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:14.817485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:14.817485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:14.817485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:14.817485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:14.817485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:14.817485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:14.817485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:14.817485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:14.817485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:14.818336 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:14.818336 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:14.818336 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:14.818336 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:14.818336 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:10:14.818336 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:10:14.818336 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:10:14.818336 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:10:14.818336 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:10:14.818336 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:10:14.818336 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:10:14.818336 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:10:14.818336 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 615/1222] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Sep 6 20:10:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:14.819054 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995152da-8ca7-4360-94f9-4c7e3e1591a5 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:14.924173 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995152da-8ca7-4360-94f9-4c7e3e1591a5 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:14.955058 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:14.962014 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116ee15-15da-45b5-850a-fc65d7763c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:14.962625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116ee15-15da-45b5-850a-fc65d7763c1a None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:14.962903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116ee15-15da-45b5-850a-fc65d7763c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:14.963168 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116ee15-15da-45b5-850a-fc65d7763c1a None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:14.963940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f116ee15-15da-45b5-850a-fc65d7763c1a None admin] RBAC: Adding query filter params (name=service) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:14.964240 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f116ee15-15da-45b5-850a-fc65d7763c1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:14.965611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f116ee15-15da-45b5-850a-fc65d7763c1a None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:14.974631 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 608/1223] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Sep 6 20:10:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:14.981201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cbbcf-d7a8-4d39-b308-715f49e6eec3 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:15.043549 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:15.102265 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cbbcf-d7a8-4d39-b308-715f49e6eec3 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:15.137068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08905b1b-f0ff-4846-9eea-6b330f60f9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:15.137696 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08905b1b-f0ff-4846-9eea-6b330f60f9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:15.137973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08905b1b-f0ff-4846-9eea-6b330f60f9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:15.138241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08905b1b-f0ff-4846-9eea-6b330f60f9d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:15.148667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08905b1b-f0ff-4846-9eea-6b330f60f9d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:15.150089 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08905b1b-f0ff-4846-9eea-6b330f60f9d5 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:15.165082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-08905b1b-f0ff-4846-9eea-6b330f60f9d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:10:15.165082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:15.165082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:15.165082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:15.165082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:15.165082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:15.165082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:15.165082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:15.165082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:15.165082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:15.165082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:15.165082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:15.165082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:10:15.165082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:10:15.165082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:10:15.165082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:10:15.166249 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:15.166249 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:15.166249 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:15.166249 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:15.166249 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:15.166249 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:15.166249 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:15.166249 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:15.166249 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:15.166249 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:15.166249 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:15.166249 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:15.166249 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:15.166249 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:15.166249 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:15.166249 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:15.166249 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:10:15.167168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:10:15.167168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:10:15.167168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:10:15.167168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 616/1224] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:10:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:15.173443 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116ee15-15da-45b5-850a-fc65d7763c1a None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:15.277769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116ee15-15da-45b5-850a-fc65d7763c1a None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:15.321702 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e236f-e20b-431c-8eb8-8ff9f089fb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:15.322622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e236f-e20b-431c-8eb8-8ff9f089fb71 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:15.323054 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e236f-e20b-431c-8eb8-8ff9f089fb71 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:15.323496 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e236f-e20b-431c-8eb8-8ff9f089fb71 None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:15.324490 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e236f-e20b-431c-8eb8-8ff9f089fb71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:15.324976 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e236f-e20b-431c-8eb8-8ff9f089fb71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:15.327249 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e236f-e20b-431c-8eb8-8ff9f089fb71 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:15.346207 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 609/1225] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:15.353279 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08905b1b-f0ff-4846-9eea-6b330f60f9d5 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:15.466935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:15.474082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08905b1b-f0ff-4846-9eea-6b330f60f9d5 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:15.508294 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291a3b0-c642-43bb-98fe-ea6d33a421e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:15.508926 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291a3b0-c642-43bb-98fe-ea6d33a421e8 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:15.509202 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291a3b0-c642-43bb-98fe-ea6d33a421e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:15.509468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291a3b0-c642-43bb-98fe-ea6d33a421e8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:15.517626 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291a3b0-c642-43bb-98fe-ea6d33a421e8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:15.519061 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291a3b0-c642-43bb-98fe-ea6d33a421e8 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:15.530705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-0291a3b0-c642-43bb-98fe-ea6d33a421e8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 20:10:15.530705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:15.530705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:15.530705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:15.530705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:15.530705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:15.530705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:15.530705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:15.530705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:15.530705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:15.530705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:15.530705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:15.530705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:10:15.530705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:10:15.530705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:10:15.530705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:10:15.531954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:15.531954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:15.531954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:10:15.531954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:10:15.531954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:10:15.531954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:10:15.531954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:15.531954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:15.531954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:15.531954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:15.531954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:15.531954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:15.531954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:15.531954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:15.531954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:15.531954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:15.531954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:15.531954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:15.532944 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:15.532944 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:15.532944 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:10:15.532944 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:10:15.532944 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:10:15.532944 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:10:15.532944 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:10:15.532944 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:10:15.532944 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 20:10:15.532944 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:10:15.532944 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 617/1226] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:10:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:15.538198 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e236f-e20b-431c-8eb8-8ff9f089fb71 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:15.586573 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:15.637790 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e236f-e20b-431c-8eb8-8ff9f089fb71 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:15.672141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022b788-697c-4ded-a3ea-2624999a3db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:15.672738 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022b788-697c-4ded-a3ea-2624999a3db1 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:15.673026 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022b788-697c-4ded-a3ea-2624999a3db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:15.673277 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022b788-697c-4ded-a3ea-2624999a3db1 None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:15.673988 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022b788-697c-4ded-a3ea-2624999a3db1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:15.678489 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022b788-697c-4ded-a3ea-2624999a3db1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:15.678489 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022b788-697c-4ded-a3ea-2624999a3db1 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:15.694354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 610/1227] 10.222.0.77 () {56 vars in 1143 bytes} [Tue Sep 6 20:10:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:15.700259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291a3b0-c642-43bb-98fe-ea6d33a421e8 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:15.803231 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291a3b0-c642-43bb-98fe-ea6d33a421e8 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:15.838243 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b07d31-0890-4bde-ad9b-27fa1f2a71ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:15.849693 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b07d31-0890-4bde-ad9b-27fa1f2a71ec None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:15.849693 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b07d31-0890-4bde-ad9b-27fa1f2a71ec None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:15.849693 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b07d31-0890-4bde-ad9b-27fa1f2a71ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:15.850159 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b07d31-0890-4bde-ad9b-27fa1f2a71ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:15.851636 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b07d31-0890-4bde-ad9b-27fa1f2a71ec None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:15.865588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-94b07d31-0890-4bde-ad9b-27fa1f2a71ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:10:15.865588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:15.865588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:15.865588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:15.865588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:15.865588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:15.865588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:15.865588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:15.865588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:15.865588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:15.865588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:15.865588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:15.865588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:10:15.865588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:10:15.865588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:10:15.865588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:10:15.866737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:15.866737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:15.866737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:15.866737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:15.866737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:15.866737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:15.866737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:15.866737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:15.866737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:15.866737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:15.866737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:15.866737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:15.866737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:15.866737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:15.866737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:15.866737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:15.866737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:10:15.868018 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:10:15.868018 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:10:15.868018 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:10:15.868018 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 618/1228] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:10:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:15.872471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022b788-697c-4ded-a3ea-2624999a3db1 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:15.974392 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022b788-697c-4ded-a3ea-2624999a3db1 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:15.976861 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:16.008898 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327123e-ebd9-4ae7-91fc-6522818749ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:16.009610 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327123e-ebd9-4ae7-91fc-6522818749ca None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:16.009885 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327123e-ebd9-4ae7-91fc-6522818749ca None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:16.010151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327123e-ebd9-4ae7-91fc-6522818749ca None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:16.010779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327123e-ebd9-4ae7-91fc-6522818749ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:16.011077 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327123e-ebd9-4ae7-91fc-6522818749ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:16.012460 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327123e-ebd9-4ae7-91fc-6522818749ca None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:16.023380 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 611/1229] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:10:16.029385 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b07d31-0890-4bde-ad9b-27fa1f2a71ec None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:16.040397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:16.133926 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b07d31-0890-4bde-ad9b-27fa1f2a71ec None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:16.167118 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea098586-d430-431b-adde-5d542bffc147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:16.167771 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea098586-d430-431b-adde-5d542bffc147 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:16.168049 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea098586-d430-431b-adde-5d542bffc147 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:16.168322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea098586-d430-431b-adde-5d542bffc147 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:16.175384 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea098586-d430-431b-adde-5d542bffc147 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:16.176869 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea098586-d430-431b-adde-5d542bffc147 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:16.188662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-ea098586-d430-431b-adde-5d542bffc147 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:10:16.188662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:16.188662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:16.188662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:16.188662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:16.188662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:16.188662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:16.188662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:16.188662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:16.188662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:16.188662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:16.188662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:16.188662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:10:16.188662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:10:16.188662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:10:16.194580 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:10:16.194580 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:16.194580 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:16.194580 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:16.194580 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:16.194580 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:16.194580 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:16.194580 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:16.194580 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:16.194580 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:16.194580 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:16.194580 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:16.194580 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:16.194580 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:16.194580 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:16.194580 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:16.194580 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:16.195582 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:10:16.195582 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:10:16.195582 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:10:16.195582 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:10:16.195582 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:10:16.195582 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:10:16.195582 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:10:16.195582 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:10:16.195582 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 619/1230] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:10:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:16.196101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327123e-ebd9-4ae7-91fc-6522818749ca None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:16.296209 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327123e-ebd9-4ae7-91fc-6522818749ca None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:16.329924 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4dc94-6ec2-48ce-9894-edfc471567b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:16.330566 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4dc94-6ec2-48ce-9894-edfc471567b1 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:16.330808 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4dc94-6ec2-48ce-9894-edfc471567b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:16.331080 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4dc94-6ec2-48ce-9894-edfc471567b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:16.331843 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4dc94-6ec2-48ce-9894-edfc471567b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:16.332147 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4dc94-6ec2-48ce-9894-edfc471567b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:16.333560 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4dc94-6ec2-48ce-9894-edfc471567b1 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:16.345971 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 612/1231] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:10:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:16.352182 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea098586-d430-431b-adde-5d542bffc147 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:16.418724 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:16.453402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea098586-d430-431b-adde-5d542bffc147 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:16.487163 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5788cba-3265-4556-b0d6-8ac6e71d16e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:16.487836 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5788cba-3265-4556-b0d6-8ac6e71d16e3 None admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:16.488117 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5788cba-3265-4556-b0d6-8ac6e71d16e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:16.488390 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5788cba-3265-4556-b0d6-8ac6e71d16e3 None admin] PATH_INFO: `/v3/projects/1b4323c35aef456b90ba9f1b7eb2b343/users/2a486663ec144db0bbde6bf3deb35a8d/roles/140b49dfcc2b489ca0504d2e7abfdbdb` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:16.502825 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5788cba-3265-4556-b0d6-8ac6e71d16e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b4323c35aef456b90ba9f1b7eb2b343, user_id=2a486663ec144db0bbde6bf3deb35a8d, role_id=140b49dfcc2b489ca0504d2e7abfdbdb)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:16.504293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5788cba-3265-4556-b0d6-8ac6e71d16e3 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:16.667643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 620/1232] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Sep 6 20:10:16 2022] PUT /identity/v3/projects/1b4323c35aef456b90ba9f1b7eb2b343/users/2a486663ec144db0bbde6bf3deb35a8d/roles/140b49dfcc2b489ca0504d2e7abfdbdb => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:10:18.927725 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f8c1b-4372-4b02-bd7c-ed1622c9a796 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:18.928274 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f8c1b-4372-4b02-bd7c-ed1622c9a796 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:18.928384 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f8c1b-4372-4b02-bd7c-ed1622c9a796 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:18.929652 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 613/1233] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:10:18.935143 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bec83c-c246-466f-b21f-90329a3a47db None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:18.935593 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bec83c-c246-466f-b21f-90329a3a47db None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:18.935727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bec83c-c246-466f-b21f-90329a3a47db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:18.954950 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-a1bec83c-c246-466f-b21f-90329a3a47db None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:10:18.956191 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-a1bec83c-c246-466f-b21f-90329a3a47db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:10:19.024369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 621/1234] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:10:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:10:19.295496 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f8c1b-4372-4b02-bd7c-ed1622c9a796 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:19.321706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:19.400572 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f8c1b-4372-4b02-bd7c-ed1622c9a796 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:19.435698 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d3a4a-92de-4cc2-a277-fbce9f2e4cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:19.440937 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d3a4a-92de-4cc2-a277-fbce9f2e4cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:19.440937 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d3a4a-92de-4cc2-a277-fbce9f2e4cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:19.440937 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d3a4a-92de-4cc2-a277-fbce9f2e4cf0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:19.447285 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d3a4a-92de-4cc2-a277-fbce9f2e4cf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:10:19.452060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-d38d3a4a-92de-4cc2-a277-fbce9f2e4cf0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:10:19.452060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:19.452060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:19.452060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:19.452060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:19.452060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:19.452060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:19.452060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:19.452060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:19.452060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:19.452060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:19.452060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:19.452060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:10:19.452060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:10:19.452060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:10:19.452060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:10:19.453682 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:10:19.453682 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:10:19.453682 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:10:19.453682 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:10:19.453682 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:19.453682 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:19.453682 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:19.453682 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:19.453682 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:19.453682 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:19.453682 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:19.453682 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:19.453682 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:19.453682 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:19.453682 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:19.453682 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:19.454707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:19.454707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:19.454707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:19.454707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:19.454707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:10:19.454707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:10:19.454707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:10:19.454707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:10:19.454707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:10:19.454707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:10:19.454707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 20:10:19.454707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:10:19.454707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 614/1235] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Sep 6 20:10:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:19.459789 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bec83c-c246-466f-b21f-90329a3a47db None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:19.506977 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:19.559110 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bec83c-c246-466f-b21f-90329a3a47db None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:19.592593 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e6fb7-9b35-4ea7-ae7f-692924663df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:19.593219 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e6fb7-9b35-4ea7-ae7f-692924663df6 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:19.593506 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e6fb7-9b35-4ea7-ae7f-692924663df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:19.593775 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e6fb7-9b35-4ea7-ae7f-692924663df6 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:19.594432 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e6fb7-9b35-4ea7-ae7f-692924663df6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:19.594735 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e6fb7-9b35-4ea7-ae7f-692924663df6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:19.596132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e6fb7-9b35-4ea7-ae7f-692924663df6 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:19.604519 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 622/1236] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Sep 6 20:10:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:19.610505 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d3a4a-92de-4cc2-a277-fbce9f2e4cf0 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:19.695590 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:19.711024 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d3a4a-92de-4cc2-a277-fbce9f2e4cf0 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:19.745428 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77380f15-a94a-4134-af35-94d7b28959a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:19.746087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77380f15-a94a-4134-af35-94d7b28959a5 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:19.746365 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77380f15-a94a-4134-af35-94d7b28959a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:19.746641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77380f15-a94a-4134-af35-94d7b28959a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:19.758833 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77380f15-a94a-4134-af35-94d7b28959a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:19.760349 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77380f15-a94a-4134-af35-94d7b28959a5 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:19.776016 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-77380f15-a94a-4134-af35-94d7b28959a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:10:19.776016 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:19.776016 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:19.776016 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:19.776016 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:19.776016 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:19.776016 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:19.776016 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:19.776016 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:19.776016 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:19.776016 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:19.776016 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:19.776016 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:10:19.776016 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:10:19.776016 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:10:19.776016 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:10:19.777225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:19.777225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:19.777225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:19.777225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:19.777225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:19.777225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:19.777225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:19.777225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:19.777225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:19.777225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:19.777225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:19.777225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:19.777225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:19.777225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:19.777225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:19.777225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:19.777225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:10:19.778274 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:10:19.778274 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:10:19.778274 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:10:19.778578 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 615/1237] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:10:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:19.783168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e6fb7-9b35-4ea7-ae7f-692924663df6 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:19.890941 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e6fb7-9b35-4ea7-ae7f-692924663df6 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:19.899868 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:19.926235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02618d-3f31-4667-9ee8-c6ae0748d6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:19.926846 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02618d-3f31-4667-9ee8-c6ae0748d6cd None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:19.927128 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02618d-3f31-4667-9ee8-c6ae0748d6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:19.927402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02618d-3f31-4667-9ee8-c6ae0748d6cd None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:19.928070 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02618d-3f31-4667-9ee8-c6ae0748d6cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:19.928381 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02618d-3f31-4667-9ee8-c6ae0748d6cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:19.929751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02618d-3f31-4667-9ee8-c6ae0748d6cd None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:19.942883 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 623/1238] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:19.948937 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77380f15-a94a-4134-af35-94d7b28959a5 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:20.055688 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77380f15-a94a-4134-af35-94d7b28959a5 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:20.094047 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfeccaa-d844-4a3d-a984-cd5913e9e771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:20.094602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfeccaa-d844-4a3d-a984-cd5913e9e771 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:20.094875 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfeccaa-d844-4a3d-a984-cd5913e9e771 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:20.095140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfeccaa-d844-4a3d-a984-cd5913e9e771 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:20.098069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:20.103254 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfeccaa-d844-4a3d-a984-cd5913e9e771 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:20.104800 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfeccaa-d844-4a3d-a984-cd5913e9e771 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:20.116435 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-0bfeccaa-d844-4a3d-a984-cd5913e9e771 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 20:10:20.116435 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:20.116435 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:20.116435 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:20.116435 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:20.116435 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:20.116435 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:20.116435 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:20.116435 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:20.116435 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:20.116435 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:20.116435 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:20.116435 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:10:20.116435 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:10:20.116435 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:10:20.116435 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:10:20.122639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:20.122639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:20.122639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:10:20.122639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:10:20.122639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:10:20.122639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:10:20.122639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:20.122639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:20.122639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:20.122639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:20.122639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:20.122639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:20.122639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:20.122639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:20.122639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:20.122639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:20.122639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:20.122639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:20.124090 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:20.124090 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:20.124090 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:10:20.124090 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:10:20.124090 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:10:20.124090 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:10:20.124090 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:10:20.124090 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:10:20.124090 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 20:10:20.124090 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:10:20.124090 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 616/1239] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:10:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:10:20.124796 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02618d-3f31-4667-9ee8-c6ae0748d6cd None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:20.223927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02618d-3f31-4667-9ee8-c6ae0748d6cd None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:20.263883 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468530f-0cb5-4109-a39f-949c08b97eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:20.264488 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468530f-0cb5-4109-a39f-949c08b97eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:20.264765 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468530f-0cb5-4109-a39f-949c08b97eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:20.265096 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468530f-0cb5-4109-a39f-949c08b97eb7 None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:20.266306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468530f-0cb5-4109-a39f-949c08b97eb7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:20.266785 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468530f-0cb5-4109-a39f-949c08b97eb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:20.269131 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468530f-0cb5-4109-a39f-949c08b97eb7 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:20.288081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 624/1240] 10.222.0.77 () {56 vars in 1143 bytes} [Tue Sep 6 20:10:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:20.294069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfeccaa-d844-4a3d-a984-cd5913e9e771 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:20.396147 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfeccaa-d844-4a3d-a984-cd5913e9e771 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:20.430256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2e990-93aa-4a24-b16c-8481234d6b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:20.430859 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2e990-93aa-4a24-b16c-8481234d6b3f None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:20.431139 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2e990-93aa-4a24-b16c-8481234d6b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:20.431534 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2e990-93aa-4a24-b16c-8481234d6b3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:20.493424 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:20.500828 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2e990-93aa-4a24-b16c-8481234d6b3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:20.502375 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2e990-93aa-4a24-b16c-8481234d6b3f None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:20.609322 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 617/1241] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:10:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 20:10:20.615628 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468530f-0cb5-4109-a39f-949c08b97eb7 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:20.644070 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:20.715641 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468530f-0cb5-4109-a39f-949c08b97eb7 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:20.751012 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b896a-0d77-48b0-b7e1-ffbdb87d7531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:20.751669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b896a-0d77-48b0-b7e1-ffbdb87d7531 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:20.751948 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b896a-0d77-48b0-b7e1-ffbdb87d7531 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:20.752217 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b896a-0d77-48b0-b7e1-ffbdb87d7531 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:20.766235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b896a-0d77-48b0-b7e1-ffbdb87d7531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:20.767796 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b896a-0d77-48b0-b7e1-ffbdb87d7531 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:20.784590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-5b6b896a-0d77-48b0-b7e1-ffbdb87d7531 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:10:20.784590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:20.784590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:20.784590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:20.784590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:20.784590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:20.784590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:20.784590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:20.784590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:20.784590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:20.784590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:20.784590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:20.784590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:10:20.784590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:10:20.784590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:10:20.784590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:10:20.789848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:20.789848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:20.789848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:20.789848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:20.789848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:20.789848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:20.789848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:20.789848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:20.789848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:20.789848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:20.789848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:20.789848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:20.789848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:20.789848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:20.789848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:20.789848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:20.789848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:10:20.791027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:10:20.791027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:10:20.791027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:10:20.791027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 625/1242] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:10:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:20.791634 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2e990-93aa-4a24-b16c-8481234d6b3f None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:20.887038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:20.892711 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2e990-93aa-4a24-b16c-8481234d6b3f None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:20.929870 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c57fb-7ba1-4053-847e-0cc5d9c71f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:20.930528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c57fb-7ba1-4053-847e-0cc5d9c71f5e None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:20.930813 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c57fb-7ba1-4053-847e-0cc5d9c71f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:20.931087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c57fb-7ba1-4053-847e-0cc5d9c71f5e None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:20.931759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c57fb-7ba1-4053-847e-0cc5d9c71f5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:20.932066 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c57fb-7ba1-4053-847e-0cc5d9c71f5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:20.933427 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c57fb-7ba1-4053-847e-0cc5d9c71f5e None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:20.944768 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 618/1243] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:10:20.950645 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b896a-0d77-48b0-b7e1-ffbdb87d7531 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:21.032943 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:21.055153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b896a-0d77-48b0-b7e1-ffbdb87d7531 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:21.088125 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028c296-5d22-421f-b107-f473c868dedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:21.088723 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028c296-5d22-421f-b107-f473c868dedc None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:21.089004 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028c296-5d22-421f-b107-f473c868dedc None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:21.089277 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028c296-5d22-421f-b107-f473c868dedc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:21.096396 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2028c296-5d22-421f-b107-f473c868dedc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:21.097839 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2028c296-5d22-421f-b107-f473c868dedc None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:21.110146 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-2028c296-5d22-421f-b107-f473c868dedc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:10:21.110146 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:21.110146 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:21.110146 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:21.110146 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:21.110146 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:21.110146 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:21.110146 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:21.110146 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:21.110146 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:21.110146 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:21.110146 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:21.110146 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:10:21.110146 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:10:21.110146 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:10:21.120835 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:10:21.120835 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:21.120835 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:21.120835 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:21.120835 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:21.120835 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:21.120835 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:21.120835 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:21.120835 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:21.120835 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:21.120835 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:21.120835 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:21.120835 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:21.120835 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:21.120835 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:21.120835 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:21.120835 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:21.122022 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:10:21.122022 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:10:21.122022 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:10:21.122022 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:10:21.122022 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:10:21.122022 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:10:21.122022 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:10:21.122022 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:10:21.122022 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 626/1244] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:10:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:21.122625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c57fb-7ba1-4053-847e-0cc5d9c71f5e None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:21.222491 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c57fb-7ba1-4053-847e-0cc5d9c71f5e None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:21.255888 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1005cf-9378-4b40-857c-6e4c577f8b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:21.263039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1005cf-9378-4b40-857c-6e4c577f8b0f None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:21.263039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1005cf-9378-4b40-857c-6e4c577f8b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:21.263039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1005cf-9378-4b40-857c-6e4c577f8b0f None admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:21.263039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1005cf-9378-4b40-857c-6e4c577f8b0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:21.263039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1005cf-9378-4b40-857c-6e4c577f8b0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:21.263039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1005cf-9378-4b40-857c-6e4c577f8b0f None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:21.271769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 619/1245] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:10:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:21.277933 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028c296-5d22-421f-b107-f473c868dedc None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:21.384970 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028c296-5d22-421f-b107-f473c868dedc None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:21.427821 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc6d09-b817-480f-adfa-0840c59421b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:21.428433 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc6d09-b817-480f-adfa-0840c59421b0 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:21.428699 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc6d09-b817-480f-adfa-0840c59421b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:21.428990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc6d09-b817-480f-adfa-0840c59421b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:21.429702 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc6d09-b817-480f-adfa-0840c59421b0 None admin] RBAC: Adding query filter params (role.id=140b49dfcc2b489ca0504d2e7abfdbdb, scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343, user.id=2a486663ec144db0bbde6bf3deb35a8d) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:21.430006 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc6d09-b817-480f-adfa-0840c59421b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:21.431455 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc6d09-b817-480f-adfa-0840c59421b0 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:21.437417 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 627/1246] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:10:21 2022] GET /identity/v3/role_assignments?user.id=2a486663ec144db0bbde6bf3deb35a8d&scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343&role.id=140b49dfcc2b489ca0504d2e7abfdbdb => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:23.682401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5ec24-4cee-496d-9430-fdc8743ca47c None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:23.682960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5ec24-4cee-496d-9430-fdc8743ca47c None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:23.682960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5ec24-4cee-496d-9430-fdc8743ca47c None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:23.684465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 620/1247] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:10:23.690134 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f8019-7398-487c-81b2-f85cc25f9d10 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:23.690559 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f8019-7398-487c-81b2-f85cc25f9d10 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:23.690707 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f8019-7398-487c-81b2-f85cc25f9d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:23.697063 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:23.710450 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-499f8019-7398-487c-81b2-f85cc25f9d10 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:10:23.711691 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-499f8019-7398-487c-81b2-f85cc25f9d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:10:23.779394 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 628/1248] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:10:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:10:24.051411 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5ec24-4cee-496d-9430-fdc8743ca47c None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:24.071139 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:24.161210 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5ec24-4cee-496d-9430-fdc8743ca47c None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:24.196751 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc016614-3993-4703-86c8-b699f6f5436e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:24.197363 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc016614-3993-4703-86c8-b699f6f5436e None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:24.197638 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc016614-3993-4703-86c8-b699f6f5436e None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:24.197912 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc016614-3993-4703-86c8-b699f6f5436e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:24.207746 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc016614-3993-4703-86c8-b699f6f5436e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:10:24.212528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-cc016614-3993-4703-86c8-b699f6f5436e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:10:24.212528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:24.212528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:24.212528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:24.212528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:24.212528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:24.212528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:24.212528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:24.212528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:24.212528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:24.212528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:24.212528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:24.212528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:10:24.212528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:10:24.212528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:10:24.212528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:10:24.213612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:10:24.213612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:10:24.213612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:10:24.213612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:10:24.213612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:24.213612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:24.213612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:24.213612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:24.213612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:24.213612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:24.213612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:24.213612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:24.213612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:24.213612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:24.213612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:24.213612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:24.214555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:24.214555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:24.214555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:24.214555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:24.214555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:10:24.214555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:10:24.214555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:10:24.214555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:10:24.214555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:10:24.214555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:10:24.214555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:10:24.214555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:10:24.214555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 621/1249] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:10:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:24.219800 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f8019-7398-487c-81b2-f85cc25f9d10 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:24.320355 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f8019-7398-487c-81b2-f85cc25f9d10 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:24.351146 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:24.356424 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153552e-ffe1-4fcb-840b-1941d300f855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:24.357042 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153552e-ffe1-4fcb-840b-1941d300f855 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:24.357316 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153552e-ffe1-4fcb-840b-1941d300f855 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:24.357589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153552e-ffe1-4fcb-840b-1941d300f855 None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:24.358244 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153552e-ffe1-4fcb-840b-1941d300f855 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:24.358548 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153552e-ffe1-4fcb-840b-1941d300f855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:24.359997 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153552e-ffe1-4fcb-840b-1941d300f855 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:24.368042 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 629/1250] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:10:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:24.374653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc016614-3993-4703-86c8-b699f6f5436e None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:24.454708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:24.479644 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc016614-3993-4703-86c8-b699f6f5436e None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:24.513031 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890439bb-a603-42b5-8a24-14c5dae5d330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:24.517008 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890439bb-a603-42b5-8a24-14c5dae5d330 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:24.517008 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890439bb-a603-42b5-8a24-14c5dae5d330 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:24.517008 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890439bb-a603-42b5-8a24-14c5dae5d330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:24.525561 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890439bb-a603-42b5-8a24-14c5dae5d330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:24.527039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890439bb-a603-42b5-8a24-14c5dae5d330 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:24.542839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-890439bb-a603-42b5-8a24-14c5dae5d330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:10:24.542839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:24.542839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:24.542839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:24.542839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:24.542839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:24.542839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:24.542839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:24.542839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:24.542839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:24.542839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:24.542839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:24.542839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:10:24.542839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:10:24.542839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:10:24.542839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:10:24.544186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:24.544186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:24.544186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:24.544186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:24.544186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:24.544186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:24.544186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:24.544186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:24.544186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:24.544186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:24.544186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:24.544186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:24.544186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:24.544186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:24.544186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:24.544186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:24.544186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:10:24.545445 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:10:24.545445 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:10:24.545445 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:10:24.545445 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 622/1251] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:24.550153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153552e-ffe1-4fcb-840b-1941d300f855 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:24.651957 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153552e-ffe1-4fcb-840b-1941d300f855 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:24.684411 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742ce9a-0b2d-4f30-82c4-75158fe32aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:24.685015 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742ce9a-0b2d-4f30-82c4-75158fe32aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:24.685294 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742ce9a-0b2d-4f30-82c4-75158fe32aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:24.685560 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742ce9a-0b2d-4f30-82c4-75158fe32aa8 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:24.686194 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742ce9a-0b2d-4f30-82c4-75158fe32aa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:24.686496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742ce9a-0b2d-4f30-82c4-75158fe32aa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:24.688507 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742ce9a-0b2d-4f30-82c4-75158fe32aa8 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:24.700492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 630/1252] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:24.707115 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890439bb-a603-42b5-8a24-14c5dae5d330 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:24.808728 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890439bb-a603-42b5-8a24-14c5dae5d330 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:24.837395 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:24.848044 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c9dc6-68bb-494a-911c-16a65481eb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:24.848691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c9dc6-68bb-494a-911c-16a65481eb73 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:24.848973 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c9dc6-68bb-494a-911c-16a65481eb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:24.849244 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c9dc6-68bb-494a-911c-16a65481eb73 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:24.857326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c9dc6-68bb-494a-911c-16a65481eb73 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:24.858786 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c9dc6-68bb-494a-911c-16a65481eb73 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:24.870374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-e38c9dc6-68bb-494a-911c-16a65481eb73 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 20:10:24.870374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:24.870374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:24.870374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:24.870374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:24.870374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:24.870374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:24.870374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:24.870374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:24.870374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:24.870374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:24.870374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:24.870374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:10:24.870374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:10:24.870374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:10:24.870374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:10:24.871623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:24.871623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:24.871623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:10:24.871623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:10:24.871623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:10:24.871623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:10:24.871623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:24.871623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:24.871623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:24.871623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:24.871623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:24.871623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:24.871623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:24.871623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:24.871623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:24.871623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:24.871623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:24.871623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:24.872788 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:24.872788 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:24.872788 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:10:24.872788 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:10:24.872788 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:10:24.872788 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:10:24.872788 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:10:24.872788 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:10:24.872788 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 20:10:24.872788 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:10:24.872788 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 623/1253] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:10:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:24.878968 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742ce9a-0b2d-4f30-82c4-75158fe32aa8 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:24.936497 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:24.981109 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742ce9a-0b2d-4f30-82c4-75158fe32aa8 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:25.021823 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abd305-dd58-468a-9186-f470c4bc83e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:25.022450 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abd305-dd58-468a-9186-f470c4bc83e2 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:25.022734 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abd305-dd58-468a-9186-f470c4bc83e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:25.023006 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abd305-dd58-468a-9186-f470c4bc83e2 None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:25.023782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34abd305-dd58-468a-9186-f470c4bc83e2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:25.024093 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34abd305-dd58-468a-9186-f470c4bc83e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:25.025570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34abd305-dd58-468a-9186-f470c4bc83e2 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:25.045142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 631/1254] 10.222.0.77 () {56 vars in 1143 bytes} [Tue Sep 6 20:10:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:25.052023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c9dc6-68bb-494a-911c-16a65481eb73 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:25.164002 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c9dc6-68bb-494a-911c-16a65481eb73 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:25.203007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97453553-7273-4e36-8fe4-84d9087ed798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:25.203007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97453553-7273-4e36-8fe4-84d9087ed798 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:25.203007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97453553-7273-4e36-8fe4-84d9087ed798 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:25.203007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97453553-7273-4e36-8fe4-84d9087ed798 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:25.269515 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:25.287124 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97453553-7273-4e36-8fe4-84d9087ed798 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:25.288628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97453553-7273-4e36-8fe4-84d9087ed798 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:25.402367 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 624/1255] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:10:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 20:10:25.408304 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abd305-dd58-468a-9186-f470c4bc83e2 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:25.516511 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abd305-dd58-468a-9186-f470c4bc83e2 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:25.529870 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:25.550349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0984042-ab3e-4c29-8d0b-6be4e467c6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:25.550980 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0984042-ab3e-4c29-8d0b-6be4e467c6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:25.551253 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0984042-ab3e-4c29-8d0b-6be4e467c6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:25.551560 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0984042-ab3e-4c29-8d0b-6be4e467c6a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:25.561483 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0984042-ab3e-4c29-8d0b-6be4e467c6a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:25.565603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0984042-ab3e-4c29-8d0b-6be4e467c6a5 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:25.579851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-d0984042-ab3e-4c29-8d0b-6be4e467c6a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:10:25.579851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:25.579851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:25.579851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:25.579851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:25.579851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:25.579851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:25.579851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:25.579851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:25.579851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:25.579851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:25.579851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:25.579851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:10:25.579851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:10:25.579851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:10:25.579851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:10:25.581619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:25.581619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:25.581619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:25.581619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:25.581619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:25.581619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:25.581619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:25.581619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:25.581619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:25.581619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:25.581619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:25.581619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:25.581619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:25.581619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:25.581619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:25.581619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:25.581619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:10:25.583430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:10:25.583430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:10:25.583430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:10:25.583430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 632/1256] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:10:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:25.588143 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97453553-7273-4e36-8fe4-84d9087ed798 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:25.676931 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:25.689001 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97453553-7273-4e36-8fe4-84d9087ed798 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:25.722250 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fcbc1-088c-47cd-aaa2-3a6d9a10506a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:25.722904 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fcbc1-088c-47cd-aaa2-3a6d9a10506a None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:25.723120 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fcbc1-088c-47cd-aaa2-3a6d9a10506a None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:25.723387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fcbc1-088c-47cd-aaa2-3a6d9a10506a None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:25.724064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fcbc1-088c-47cd-aaa2-3a6d9a10506a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:25.724365 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fcbc1-088c-47cd-aaa2-3a6d9a10506a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:25.725716 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fcbc1-088c-47cd-aaa2-3a6d9a10506a None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:25.737620 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 625/1257] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:25.743418 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0984042-ab3e-4c29-8d0b-6be4e467c6a5 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:25.847736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0984042-ab3e-4c29-8d0b-6be4e467c6a5 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:25.884839 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2450167-c87c-4e71-885b-7e41ae1488be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:25.885463 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2450167-c87c-4e71-885b-7e41ae1488be None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:25.885736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2450167-c87c-4e71-885b-7e41ae1488be None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:25.886001 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2450167-c87c-4e71-885b-7e41ae1488be None admin] PATH_INFO: `/v3/projects/service` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:25.894289 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2450167-c87c-4e71-885b-7e41ae1488be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:25.895771 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2450167-c87c-4e71-885b-7e41ae1488be None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:25.907201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-e2450167-c87c-4e71-885b-7e41ae1488be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:10:25.907201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:25.907201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:25.907201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:25.907201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:25.907201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:25.907201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:25.907201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:25.907201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:25.907201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:25.907201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:25.907201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:25.907201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:10:25.907201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:10:25.907201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:10:25.908235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:10:25.908235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:25.908235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:25.908235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:25.908235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:25.908235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:25.908235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:25.908235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:25.908235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:25.908235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:25.908235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:25.908235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:25.908235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:25.908235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:25.908235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:25.908235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:25.908235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:25.909379 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:10:25.909379 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:10:25.909379 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:10:25.909379 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:10:25.909379 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:10:25.909379 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:10:25.909379 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:10:25.909379 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:10:25.909379 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 633/1258] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:10:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:25.914396 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fcbc1-088c-47cd-aaa2-3a6d9a10506a None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:26.017798 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fcbc1-088c-47cd-aaa2-3a6d9a10506a None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:26.055268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3698080-8ef7-456f-9744-30dce1535d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:26.055912 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3698080-8ef7-456f-9744-30dce1535d51 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:26.056187 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3698080-8ef7-456f-9744-30dce1535d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:26.056452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3698080-8ef7-456f-9744-30dce1535d51 None admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:26.057143 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3698080-8ef7-456f-9744-30dce1535d51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:26.057443 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3698080-8ef7-456f-9744-30dce1535d51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:26.058864 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3698080-8ef7-456f-9744-30dce1535d51 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:26.071563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 626/1259] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:10:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:26.077553 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2450167-c87c-4e71-885b-7e41ae1488be None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:26.103625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:26.186042 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2450167-c87c-4e71-885b-7e41ae1488be None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:26.222065 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb9ac0-8bfe-4da8-8714-36a3e66b0bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:26.222690 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb9ac0-8bfe-4da8-8714-36a3e66b0bab None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:26.222949 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb9ac0-8bfe-4da8-8714-36a3e66b0bab None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:26.223221 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb9ac0-8bfe-4da8-8714-36a3e66b0bab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:26.223988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb9ac0-8bfe-4da8-8714-36a3e66b0bab None admin] RBAC: Adding query filter params (role.id=1e2ac44410664e6b8f42ab3c37e2643f, scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343, user.id=2a486663ec144db0bbde6bf3deb35a8d) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:26.224303 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb9ac0-8bfe-4da8-8714-36a3e66b0bab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:26.225729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb9ac0-8bfe-4da8-8714-36a3e66b0bab None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:26.231114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 634/1260] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:10:26 2022] GET /identity/v3/role_assignments?user.id=2a486663ec144db0bbde6bf3deb35a8d&scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343&role.id=1e2ac44410664e6b8f42ab3c37e2643f => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:28.378530 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebd6b3-901c-4c2d-97bc-bbccbfefedf9 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:28.379085 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebd6b3-901c-4c2d-97bc-bbccbfefedf9 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:28.379183 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebd6b3-901c-4c2d-97bc-bbccbfefedf9 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:28.380541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 627/1261] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:10:28.386116 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b9945-94a0-4740-8e9b-5132b40fecb2 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:28.386529 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b9945-94a0-4740-8e9b-5132b40fecb2 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:28.386658 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b9945-94a0-4740-8e9b-5132b40fecb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:28.405821 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-322b9945-94a0-4740-8e9b-5132b40fecb2 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:10:28.407020 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-322b9945-94a0-4740-8e9b-5132b40fecb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:10:28.479680 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 635/1262] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:10:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:10:28.750321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebd6b3-901c-4c2d-97bc-bbccbfefedf9 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:28.762156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:28.865153 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebd6b3-901c-4c2d-97bc-bbccbfefedf9 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:28.902318 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad000e1-290d-476d-bbf7-82a997650cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:28.902990 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad000e1-290d-476d-bbf7-82a997650cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:28.903245 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad000e1-290d-476d-bbf7-82a997650cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:28.903547 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad000e1-290d-476d-bbf7-82a997650cc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:28.915057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad000e1-290d-476d-bbf7-82a997650cc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:10:28.920068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-fad000e1-290d-476d-bbf7-82a997650cc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:10:28.920068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:28.920068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:28.920068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:28.920068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:28.920068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:28.920068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:28.920068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:28.920068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:28.920068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:28.920068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:28.920068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:28.920068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:10:28.920068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:10:28.920068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:10:28.920068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:10:28.921758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:10:28.921758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:10:28.921758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:10:28.921758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:10:28.921758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:28.921758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:28.921758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:28.921758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:28.921758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:28.921758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:28.921758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:28.921758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:28.921758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:28.921758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:28.921758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:28.921758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:28.923094 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:28.923094 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:28.923094 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:28.923094 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:28.923094 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:10:28.923094 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:10:28.923094 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:10:28.923094 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:10:28.923094 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:10:28.923094 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:10:28.923094 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:10:28.923094 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:10:28.923094 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 628/1263] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:10:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:28.928267 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b9945-94a0-4740-8e9b-5132b40fecb2 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:28.949366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:29.040998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b9945-94a0-4740-8e9b-5132b40fecb2 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:29.079667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26882a44-f2ff-4dc6-a3a4-e6bd7a9493fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:29.080280 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26882a44-f2ff-4dc6-a3a4-e6bd7a9493fc None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:29.080564 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26882a44-f2ff-4dc6-a3a4-e6bd7a9493fc None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:29.080837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26882a44-f2ff-4dc6-a3a4-e6bd7a9493fc None admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:29.081506 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26882a44-f2ff-4dc6-a3a4-e6bd7a9493fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:29.081810 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26882a44-f2ff-4dc6-a3a4-e6bd7a9493fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:29.083228 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26882a44-f2ff-4dc6-a3a4-e6bd7a9493fc None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:29.091750 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 636/1264] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:10:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:29.098480 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad000e1-290d-476d-bbf7-82a997650cc7 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:29.169925 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:29.204038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad000e1-290d-476d-bbf7-82a997650cc7 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:29.239588 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3b56c-030b-4a92-a205-5ceaccd46b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:29.240213 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3b56c-030b-4a92-a205-5ceaccd46b08 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:29.240491 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3b56c-030b-4a92-a205-5ceaccd46b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:29.240761 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3b56c-030b-4a92-a205-5ceaccd46b08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:29.251026 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3b56c-030b-4a92-a205-5ceaccd46b08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:29.252496 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3b56c-030b-4a92-a205-5ceaccd46b08 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:29.269443 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-4db3b56c-030b-4a92-a205-5ceaccd46b08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:10:29.269443 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:29.269443 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:29.269443 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:29.269443 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:29.269443 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:29.269443 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:29.269443 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:29.269443 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:29.269443 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:29.269443 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:29.269443 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:29.269443 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:10:29.269443 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:10:29.269443 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:10:29.269443 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:10:29.270602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:29.270602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:29.270602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:29.270602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:29.270602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:29.270602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:29.270602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:29.270602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:29.270602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:29.270602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:29.270602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:29.270602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:29.270602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:29.270602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:29.270602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:29.270602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:29.270602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:10:29.271603 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:10:29.271603 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:10:29.271603 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:10:29.271888 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 629/1265] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:29.277783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26882a44-f2ff-4dc6-a3a4-e6bd7a9493fc None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:29.364938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:29.384904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26882a44-f2ff-4dc6-a3a4-e6bd7a9493fc None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:29.419986 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263c658-91fa-4f28-9ee6-67a3fde2b713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:29.420671 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263c658-91fa-4f28-9ee6-67a3fde2b713 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:29.420857 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263c658-91fa-4f28-9ee6-67a3fde2b713 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:29.421185 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263c658-91fa-4f28-9ee6-67a3fde2b713 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:29.422354 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263c658-91fa-4f28-9ee6-67a3fde2b713 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:29.422653 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263c658-91fa-4f28-9ee6-67a3fde2b713 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:29.424122 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263c658-91fa-4f28-9ee6-67a3fde2b713 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:29.436088 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 637/1266] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:29.442089 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3b56c-030b-4a92-a205-5ceaccd46b08 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:29.545867 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3b56c-030b-4a92-a205-5ceaccd46b08 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:29.567168 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:29.581795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4dcac-d4e1-407b-9c03-f270bc3ba651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:29.582482 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4dcac-d4e1-407b-9c03-f270bc3ba651 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:29.582758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4dcac-d4e1-407b-9c03-f270bc3ba651 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:29.583029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4dcac-d4e1-407b-9c03-f270bc3ba651 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:29.590968 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f4dcac-d4e1-407b-9c03-f270bc3ba651 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:29.592446 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f4dcac-d4e1-407b-9c03-f270bc3ba651 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:29.604857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-44f4dcac-d4e1-407b-9c03-f270bc3ba651 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 20:10:29.604857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:29.604857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:29.604857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:29.604857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:29.604857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:29.604857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:29.604857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:29.604857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:29.604857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:29.604857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:29.604857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:29.604857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:10:29.604857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:10:29.604857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:10:29.604857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:10:29.606055 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:29.606055 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:29.606055 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:10:29.606055 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:10:29.606055 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:10:29.606055 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:10:29.606055 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:29.606055 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:29.606055 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:29.606055 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:29.606055 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:29.606055 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:29.606055 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:29.606055 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:29.606055 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:29.606055 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:29.606055 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:29.606055 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:29.607245 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:29.607245 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:29.607245 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:10:29.607245 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:10:29.607245 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:10:29.607245 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:10:29.607245 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:10:29.607245 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:10:29.607245 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 20:10:29.607245 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:10:29.607245 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 630/1267] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:10:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:29.612822 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263c658-91fa-4f28-9ee6-67a3fde2b713 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:29.715685 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263c658-91fa-4f28-9ee6-67a3fde2b713 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:29.754635 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52db89-3f42-467a-a85a-ebe3db461844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:29.755249 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52db89-3f42-467a-a85a-ebe3db461844 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:29.755551 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52db89-3f42-467a-a85a-ebe3db461844 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:29.755818 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52db89-3f42-467a-a85a-ebe3db461844 None admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:29.756535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52db89-3f42-467a-a85a-ebe3db461844 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:29.756839 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52db89-3f42-467a-a85a-ebe3db461844 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:29.758381 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52db89-3f42-467a-a85a-ebe3db461844 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:29.768325 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:29.776807 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 638/1268] 10.222.0.77 () {56 vars in 1143 bytes} [Tue Sep 6 20:10:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:29.783419 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4dcac-d4e1-407b-9c03-f270bc3ba651 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:29.886876 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4dcac-d4e1-407b-9c03-f270bc3ba651 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:29.921823 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423aaa3e-fc14-4b65-9396-efb62ec5fe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:29.922355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423aaa3e-fc14-4b65-9396-efb62ec5fe48 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:29.922629 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423aaa3e-fc14-4b65-9396-efb62ec5fe48 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:29.922896 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423aaa3e-fc14-4b65-9396-efb62ec5fe48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:29.933947 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423aaa3e-fc14-4b65-9396-efb62ec5fe48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:29.935387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423aaa3e-fc14-4b65-9396-efb62ec5fe48 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:29.949449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-423aaa3e-fc14-4b65-9396-efb62ec5fe48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:10:29.949449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:29.949449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:29.949449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:29.949449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:29.949449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:29.949449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:29.949449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:29.949449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:29.949449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:29.949449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:29.949449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:29.949449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:10:29.949449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:10:29.949449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:10:29.949449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:10:29.950672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:29.950672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:29.950672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:29.950672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:29.950672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:29.950672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:29.950672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:29.950672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:29.950672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:29.950672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:29.950672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:29.950672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:29.950672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:29.950672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:29.950672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:29.950672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:29.950672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:10:29.951988 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:10:29.951988 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:10:29.951988 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:10:29.951988 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 631/1269] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:29.956654 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52db89-3f42-467a-a85a-ebe3db461844 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:30.063738 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52db89-3f42-467a-a85a-ebe3db461844 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:30.102102 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dc6a7-cdf0-4e25-bd87-26ae61a988f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:30.102710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dc6a7-cdf0-4e25-bd87-26ae61a988f1 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:30.102985 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dc6a7-cdf0-4e25-bd87-26ae61a988f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:30.103251 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dc6a7-cdf0-4e25-bd87-26ae61a988f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:30.103922 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633dc6a7-cdf0-4e25-bd87-26ae61a988f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:30.104222 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633dc6a7-cdf0-4e25-bd87-26ae61a988f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:30.105697 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633dc6a7-cdf0-4e25-bd87-26ae61a988f1 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:30.119179 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 639/1270] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:30.125399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423aaa3e-fc14-4b65-9396-efb62ec5fe48 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:30.160341 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:30.238725 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423aaa3e-fc14-4b65-9396-efb62ec5fe48 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:30.276114 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d16346-642f-47f3-955c-748e41be5d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:30.276746 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d16346-642f-47f3-955c-748e41be5d3f None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:30.277022 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d16346-642f-47f3-955c-748e41be5d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:30.277294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d16346-642f-47f3-955c-748e41be5d3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:30.285876 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d16346-642f-47f3-955c-748e41be5d3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:30.287590 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d16346-642f-47f3-955c-748e41be5d3f None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:30.299571 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-b1d16346-642f-47f3-955c-748e41be5d3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:10:30.299571 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:30.299571 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:30.299571 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:30.299571 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:30.299571 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:30.299571 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:30.299571 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:30.299571 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:30.299571 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:30.299571 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:30.299571 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:30.299571 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:10:30.299571 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:10:30.299571 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:10:30.300721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:10:30.300721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:30.300721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:30.300721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:30.300721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:30.300721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:30.300721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:30.300721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:30.300721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:30.300721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:30.300721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:30.300721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:30.300721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:30.300721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:30.300721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:30.300721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:30.300721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:30.302079 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:10:30.302079 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:10:30.302079 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:10:30.302079 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:10:30.302079 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:10:30.302079 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:10:30.302079 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:10:30.302079 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:10:30.302079 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 632/1271] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:10:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:10:30.306837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dc6a7-cdf0-4e25-bd87-26ae61a988f1 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:30.370550 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:30.414974 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dc6a7-cdf0-4e25-bd87-26ae61a988f1 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:30.449512 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c345b-d860-4cf9-9c6c-e4ac9eb54ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:30.450251 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c345b-d860-4cf9-9c6c-e4ac9eb54ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:30.450347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c345b-d860-4cf9-9c6c-e4ac9eb54ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:30.450620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c345b-d860-4cf9-9c6c-e4ac9eb54ee2 None admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:30.451307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c345b-d860-4cf9-9c6c-e4ac9eb54ee2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:30.451638 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c345b-d860-4cf9-9c6c-e4ac9eb54ee2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:30.453574 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c345b-d860-4cf9-9c6c-e4ac9eb54ee2 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:30.467001 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 640/1272] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:10:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:30.473844 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d16346-642f-47f3-955c-748e41be5d3f None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:30.576252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:30.585920 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d16346-642f-47f3-955c-748e41be5d3f None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:30.643671 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a6383-d379-438f-bf5c-8fa9c6d15697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:30.643671 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a6383-d379-438f-bf5c-8fa9c6d15697 None admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:30.643671 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a6383-d379-438f-bf5c-8fa9c6d15697 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:30.643671 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a6383-d379-438f-bf5c-8fa9c6d15697 None admin] PATH_INFO: `/v3/projects/1b4323c35aef456b90ba9f1b7eb2b343/users/2a486663ec144db0bbde6bf3deb35a8d/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:30.644152 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a6383-d379-438f-bf5c-8fa9c6d15697 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b4323c35aef456b90ba9f1b7eb2b343, user_id=2a486663ec144db0bbde6bf3deb35a8d, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:30.644152 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a6383-d379-438f-bf5c-8fa9c6d15697 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:30.902184 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 633/1273] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Sep 6 20:10:30 2022] PUT /identity/v3/projects/1b4323c35aef456b90ba9f1b7eb2b343/users/2a486663ec144db0bbde6bf3deb35a8d/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:10:33.114001 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078e3cc-c3e0-436f-9a9d-195cc3ec19f2 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:33.114617 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078e3cc-c3e0-436f-9a9d-195cc3ec19f2 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:33.114617 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078e3cc-c3e0-436f-9a9d-195cc3ec19f2 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:33.115870 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 641/1274] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:10:33.121662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef0d20-4cf2-4b6c-94da-1e1fa73a5743 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:33.122150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef0d20-4cf2-4b6c-94da-1e1fa73a5743 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:33.122259 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef0d20-4cf2-4b6c-94da-1e1fa73a5743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:33.142685 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-12ef0d20-4cf2-4b6c-94da-1e1fa73a5743 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:10:33.143924 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-12ef0d20-4cf2-4b6c-94da-1e1fa73a5743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:10:33.216256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 634/1275] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:10:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 20:10:33.490381 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078e3cc-c3e0-436f-9a9d-195cc3ec19f2 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:33.600798 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078e3cc-c3e0-436f-9a9d-195cc3ec19f2 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:33.620024 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:33.638127 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f8d84-2d39-49a1-b223-11f67d5f9924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:33.638764 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f8d84-2d39-49a1-b223-11f67d5f9924 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:33.639044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f8d84-2d39-49a1-b223-11f67d5f9924 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:33.639361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f8d84-2d39-49a1-b223-11f67d5f9924 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:33.651346 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f8d84-2d39-49a1-b223-11f67d5f9924 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 20:10:33.656790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-c80f8d84-2d39-49a1-b223-11f67d5f9924 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:10:33.656790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:33.656790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:33.656790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:33.656790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:33.656790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:33.656790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:33.656790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:33.656790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:33.656790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:33.656790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:33.656790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:33.656790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 20:10:33.656790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 20:10:33.656790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 20:10:33.656790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 20:10:33.658603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 20:10:33.658603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 20:10:33.658603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 20:10:33.658603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 20:10:33.658603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:33.658603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:33.658603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:33.658603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:33.658603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:33.658603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:33.658603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:33.658603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:33.658603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:33.658603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:33.658603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:33.658603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:33.660531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:33.660531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:33.660531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:33.660531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:33.660531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 20:10:33.660531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 20:10:33.660531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 20:10:33.660531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 20:10:33.660531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 20:10:33.660531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 20:10:33.660531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 20:10:33.660531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:10:33.660531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 642/1276] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Sep 6 20:10:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 20:10:33.664056 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef0d20-4cf2-4b6c-94da-1e1fa73a5743 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:33.757198 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:33.774841 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef0d20-4cf2-4b6c-94da-1e1fa73a5743 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:33.808965 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19386db9-1a87-4319-921a-405e5a58bc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:33.809612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19386db9-1a87-4319-921a-405e5a58bc56 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:33.809889 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19386db9-1a87-4319-921a-405e5a58bc56 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:33.810159 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19386db9-1a87-4319-921a-405e5a58bc56 None admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:33.810826 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19386db9-1a87-4319-921a-405e5a58bc56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:33.811123 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19386db9-1a87-4319-921a-405e5a58bc56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:33.812535 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19386db9-1a87-4319-921a-405e5a58bc56 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:33.820764 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 635/1277] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Sep 6 20:10:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:33.826847 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f8d84-2d39-49a1-b223-11f67d5f9924 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:33.931219 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f8d84-2d39-49a1-b223-11f67d5f9924 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:33.967140 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c462d6-9641-4bb6-b167-2bf14df84642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:33.970491 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c462d6-9641-4bb6-b167-2bf14df84642 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:33.970491 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c462d6-9641-4bb6-b167-2bf14df84642 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:33.970491 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c462d6-9641-4bb6-b167-2bf14df84642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:33.979880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c462d6-9641-4bb6-b167-2bf14df84642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:33.981326 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c462d6-9641-4bb6-b167-2bf14df84642 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:33.996261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-14c462d6-9641-4bb6-b167-2bf14df84642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:10:33.996261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:33.996261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:33.996261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:33.996261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:33.996261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:33.996261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:33.996261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:33.996261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:33.996261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:33.996261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:33.996261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:33.996261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:10:33.996261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:10:33.996261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:10:33.996261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:10:34.010071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:34.010071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:34.010071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:34.010071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:34.010071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:34.010071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:34.010071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:34.010071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:34.010071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:34.010071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:34.010071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:34.010071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:34.010071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:34.010071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:34.010071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:34.010071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:34.010071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:10:34.011958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:10:34.011958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:10:34.011958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:10:34.011958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 643/1278] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:10:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:34.012379 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19386db9-1a87-4319-921a-405e5a58bc56 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:34.112174 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19386db9-1a87-4319-921a-405e5a58bc56 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:34.151008 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361e49a-f62d-4359-84cc-f59b73d118f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:34.151773 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361e49a-f62d-4359-84cc-f59b73d118f4 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:34.151925 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361e49a-f62d-4359-84cc-f59b73d118f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:34.152193 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361e49a-f62d-4359-84cc-f59b73d118f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:34.152835 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361e49a-f62d-4359-84cc-f59b73d118f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:34.153141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361e49a-f62d-4359-84cc-f59b73d118f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:34.154645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361e49a-f62d-4359-84cc-f59b73d118f4 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:34.168052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 636/1279] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:34.174335 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c462d6-9641-4bb6-b167-2bf14df84642 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:34.206471 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:34.280942 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c462d6-9641-4bb6-b167-2bf14df84642 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:34.315531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0dd4e-9d2c-4b85-b43c-4a49b0ca983d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:34.316157 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0dd4e-9d2c-4b85-b43c-4a49b0ca983d None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:34.316425 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0dd4e-9d2c-4b85-b43c-4a49b0ca983d None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:34.316691 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0dd4e-9d2c-4b85-b43c-4a49b0ca983d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:34.323755 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0dd4e-9d2c-4b85-b43c-4a49b0ca983d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:34.325178 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0dd4e-9d2c-4b85-b43c-4a49b0ca983d None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:34.337440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-61a0dd4e-9d2c-4b85-b43c-4a49b0ca983d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 20:10:34.337440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:34.337440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:34.337440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:34.337440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:34.337440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:34.337440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:34.337440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:34.337440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:34.337440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:34.337440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:34.337440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:34.337440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 20:10:34.337440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 20:10:34.337440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 20:10:34.337440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 20:10:34.339397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:34.339397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:34.339397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 20:10:34.339397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:10:34.339397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 20:10:34.339397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 20:10:34.339397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:34.339397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:34.339397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:34.339397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:34.339397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:34.339397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:34.339397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:34.339397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:34.339397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:34.339397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:34.339397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:34.339397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:34.341542 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:34.341542 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:34.341542 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 20:10:34.341542 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 20:10:34.341542 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 20:10:34.341542 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 20:10:34.341542 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 20:10:34.341542 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 20:10:34.341542 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 20:10:34.341542 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:10:34.341542 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 644/1280] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:10:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:34.345327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361e49a-f62d-4359-84cc-f59b73d118f4 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:34.349432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:34.454896 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361e49a-f62d-4359-84cc-f59b73d118f4 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:34.489588 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1bb915-3059-4d1d-b931-803a0adff405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:34.490580 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bb915-3059-4d1d-b931-803a0adff405 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:34.491010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bb915-3059-4d1d-b931-803a0adff405 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:34.491380 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bb915-3059-4d1d-b931-803a0adff405 None admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:34.492669 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1bb915-3059-4d1d-b931-803a0adff405 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:34.493183 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1bb915-3059-4d1d-b931-803a0adff405 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:34.495254 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1bb915-3059-4d1d-b931-803a0adff405 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:34.524434 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 637/1281] 10.222.0.77 () {56 vars in 1143 bytes} [Tue Sep 6 20:10:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:10:34.530714 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0dd4e-9d2c-4b85-b43c-4a49b0ca983d None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:34.628293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:34.637853 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0dd4e-9d2c-4b85-b43c-4a49b0ca983d None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:34.672301 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5eff8b-5351-4d23-961c-196189ee2feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:34.672903 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5eff8b-5351-4d23-961c-196189ee2feb None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:34.673180 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5eff8b-5351-4d23-961c-196189ee2feb None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:34.673501 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5eff8b-5351-4d23-961c-196189ee2feb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:34.756508 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5eff8b-5351-4d23-961c-196189ee2feb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:34.757978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5eff8b-5351-4d23-961c-196189ee2feb None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:34.861697 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:34.873058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 645/1282] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Sep 6 20:10:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 06 20:10:34.880320 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1bb915-3059-4d1d-b931-803a0adff405 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:34.945077 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:34.984823 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1bb915-3059-4d1d-b931-803a0adff405 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:35.020539 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86addb3-6f18-4c62-859c-ea364698408d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:35.021279 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86addb3-6f18-4c62-859c-ea364698408d None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:35.021559 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86addb3-6f18-4c62-859c-ea364698408d None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:35.021831 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86addb3-6f18-4c62-859c-ea364698408d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:35.033273 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86addb3-6f18-4c62-859c-ea364698408d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:35.034772 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86addb3-6f18-4c62-859c-ea364698408d None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:35.051769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-e86addb3-6f18-4c62-859c-ea364698408d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:10:35.051769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:35.051769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:35.051769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:35.051769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:35.051769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:35.051769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:35.051769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:35.051769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:35.051769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:35.051769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:35.051769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:35.051769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 20:10:35.051769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 20:10:35.051769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 20:10:35.051769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 20:10:35.056863 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:35.056863 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:35.056863 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:35.056863 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:35.056863 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:35.056863 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:35.056863 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:35.056863 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:35.056863 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:35.056863 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:35.056863 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:35.056863 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:35.056863 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:35.056863 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:35.056863 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:35.056863 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:35.056863 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 20:10:35.058511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 20:10:35.058511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 20:10:35.058511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:10:35.058511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 638/1283] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:10:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:35.059597 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5eff8b-5351-4d23-961c-196189ee2feb None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:35.178944 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5eff8b-5351-4d23-961c-196189ee2feb None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:35.215716 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb6679-cb36-465c-913d-76b1f9bd0721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:35.216334 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb6679-cb36-465c-913d-76b1f9bd0721 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:35.216611 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb6679-cb36-465c-913d-76b1f9bd0721 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:35.216879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb6679-cb36-465c-913d-76b1f9bd0721 None admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:35.217516 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb6679-cb36-465c-913d-76b1f9bd0721 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:35.218749 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb6679-cb36-465c-913d-76b1f9bd0721 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:35.219740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb6679-cb36-465c-913d-76b1f9bd0721 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:35.231685 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 646/1284] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Sep 6 20:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:35.238234 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86addb3-6f18-4c62-859c-ea364698408d None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:35.350649 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86addb3-6f18-4c62-859c-ea364698408d None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:35.366497 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:35.386981 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1f6e0-d495-4291-9f2f-1fbf3b6a5ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:35.387690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1f6e0-d495-4291-9f2f-1fbf3b6a5ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:35.387965 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1f6e0-d495-4291-9f2f-1fbf3b6a5ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:35.403228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1f6e0-d495-4291-9f2f-1fbf3b6a5ac5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:35.403228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1f6e0-d495-4291-9f2f-1fbf3b6a5ac5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:35.403228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1f6e0-d495-4291-9f2f-1fbf3b6a5ac5 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:35.410564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application [None req-a9c1f6e0-d495-4291-9f2f-1fbf3b6a5ac5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:10:35.410564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:35.410564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:35.410564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:35.410564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:35.410564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:35.410564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:35.410564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:35.410564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:35.410564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:35.410564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:35.410564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:35.410564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 20:10:35.410564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 20:10:35.410564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 20:10:35.411825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 20:10:35.411825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:35.411825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:35.411825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:35.411825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:35.411825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:35.411825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:35.411825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:35.411825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:35.411825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:35.411825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:35.411825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:35.411825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:35.411825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:35.411825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:35.411825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:35.411825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:35.412795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 20:10:35.412795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 20:10:35.412795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 20:10:35.412795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 20:10:35.412795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 20:10:35.412795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 20:10:35.412795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 20:10:35.412795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: ERROR keystone.server.flask.application Sep 06 20:10:35.412795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 639/1285] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Sep 6 20:10:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:35.418073 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb6679-cb36-465c-913d-76b1f9bd0721 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:35.472067 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:35.526524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb6679-cb36-465c-913d-76b1f9bd0721 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:35.563296 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c7a7b-3c1e-4ff8-8973-a7f0414ec674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:35.563922 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c7a7b-3c1e-4ff8-8973-a7f0414ec674 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:35.564196 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c7a7b-3c1e-4ff8-8973-a7f0414ec674 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:35.564457 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c7a7b-3c1e-4ff8-8973-a7f0414ec674 None admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:35.565169 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c7a7b-3c1e-4ff8-8973-a7f0414ec674 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:35.565467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c7a7b-3c1e-4ff8-8973-a7f0414ec674 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:35.566881 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c7a7b-3c1e-4ff8-8973-a7f0414ec674 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:35.580242 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 647/1286] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Sep 6 20:10:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:35.586858 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1f6e0-d495-4291-9f2f-1fbf3b6a5ac5 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:35.694628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1f6e0-d495-4291-9f2f-1fbf3b6a5ac5 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:35.729780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492138d7-a71f-453b-bc4d-c1d2747dc54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:35.730290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492138d7-a71f-453b-bc4d-c1d2747dc54e None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:35.730561 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492138d7-a71f-453b-bc4d-c1d2747dc54e None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:35.730828 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492138d7-a71f-453b-bc4d-c1d2747dc54e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:35.731567 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492138d7-a71f-453b-bc4d-c1d2747dc54e None admin] RBAC: Adding query filter params (role.id=1e2ac44410664e6b8f42ab3c37e2643f, scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343, user.id=2a486663ec144db0bbde6bf3deb35a8d) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:35.731872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492138d7-a71f-453b-bc4d-c1d2747dc54e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:35.733291 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492138d7-a71f-453b-bc4d-c1d2747dc54e None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:35.741682 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 640/1287] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Sep 6 20:10:35 2022] GET /identity/v3/role_assignments?user.id=2a486663ec144db0bbde6bf3deb35a8d&scope.project.id=1b4323c35aef456b90ba9f1b7eb2b343&role.id=1e2ac44410664e6b8f42ab3c37e2643f => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:38.010796 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea6e8f-03b3-4369-b773-beab9ada3a3e None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:38.011330 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea6e8f-03b3-4369-b773-beab9ada3a3e None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:38.011513 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea6e8f-03b3-4369-b773-beab9ada3a3e None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:38.012925 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 648/1288] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:10:38.019176 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61373cb5-b27c-43eb-995b-1fdc6736440f None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:38.019692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61373cb5-b27c-43eb-995b-1fdc6736440f None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:38.019800 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61373cb5-b27c-43eb-995b-1fdc6736440f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:38.038888 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-61373cb5-b27c-43eb-995b-1fdc6736440f None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:10:38.041406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-61373cb5-b27c-43eb-995b-1fdc6736440f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:10:38.070552 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:38.109206 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 641/1289] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:10:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:10:38.387738 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea6e8f-03b3-4369-b773-beab9ada3a3e None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:38.492950 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea6e8f-03b3-4369-b773-beab9ada3a3e None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:38.504244 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:38.528223 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301a8b8-e746-4a78-bf93-1574388bb940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:38.528862 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301a8b8-e746-4a78-bf93-1574388bb940 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:38.529139 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301a8b8-e746-4a78-bf93-1574388bb940 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:38.529411 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301a8b8-e746-4a78-bf93-1574388bb940 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:38.530000 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301a8b8-e746-4a78-bf93-1574388bb940 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:38.532023 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301a8b8-e746-4a78-bf93-1574388bb940 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:38.541758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-8301a8b8-e746-4a78-bf93-1574388bb940 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 20:10:38.541758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:38.541758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 20:10:38.541758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 20:10:38.541758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 20:10:38.541758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 20:10:38.541758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 20:10:38.541758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:10:38.541758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 20:10:38.541758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:10:38.541758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:10:38.541758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:10:38.541758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:38.541758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:38.541758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:38.541758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:38.541758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:38.542927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:38.542927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:38.542927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:38.542927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:38.542927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:38.542927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:38.542927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 20:10:38.542927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 20:10:38.542927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 20:10:38.542927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 20:10:38.542927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:38.542927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:38.542927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:38.542927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:38.542927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:38.542927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:38.543850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:38.543850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:38.543850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:38.543850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:38.543850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:38.543850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:38.543850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:38.543850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:38.543850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:38.543850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:38.543850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 20:10:38.543850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:10:38.543850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 20:10:38.543850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:10:38.543850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 649/1290] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Sep 6 20:10:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:38.549999 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61373cb5-b27c-43eb-995b-1fdc6736440f None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:38.652770 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61373cb5-b27c-43eb-995b-1fdc6736440f None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:38.689057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e160a-ea10-45b2-a84e-35414da2b110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:38.689674 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e160a-ea10-45b2-a84e-35414da2b110 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:38.689949 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e160a-ea10-45b2-a84e-35414da2b110 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:38.690218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e160a-ea10-45b2-a84e-35414da2b110 None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:38.690850 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e160a-ea10-45b2-a84e-35414da2b110 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:38.691153 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e160a-ea10-45b2-a84e-35414da2b110 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:38.692561 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e160a-ea10-45b2-a84e-35414da2b110 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:38.698400 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 642/1291] 10.222.0.77 () {56 vars in 1116 bytes} [Tue Sep 6 20:10:38 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:38.704476 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301a8b8-e746-4a78-bf93-1574388bb940 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:38.810783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301a8b8-e746-4a78-bf93-1574388bb940 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:38.848936 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ba131-eb25-47fb-af2d-0ee1c5ad152e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:38.849554 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ba131-eb25-47fb-af2d-0ee1c5ad152e None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:38.849833 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ba131-eb25-47fb-af2d-0ee1c5ad152e None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:38.850106 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ba131-eb25-47fb-af2d-0ee1c5ad152e None admin] PATH_INFO: `/v3/services` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:38.850737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ba131-eb25-47fb-af2d-0ee1c5ad152e None admin] RBAC: Adding query filter params (type=placement) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:38.851038 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ba131-eb25-47fb-af2d-0ee1c5ad152e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:38.852678 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ba131-eb25-47fb-af2d-0ee1c5ad152e None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:38.857717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 650/1292] 10.222.0.77 () {56 vars in 1116 bytes} [Tue Sep 6 20:10:38 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:41.051278 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ea6e4-7687-4944-81c1-af9fc4fa44cb None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:41.052072 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ea6e4-7687-4944-81c1-af9fc4fa44cb None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:41.052072 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ea6e4-7687-4944-81c1-af9fc4fa44cb None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:41.053218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 643/1293] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:10:41.059880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bf2aa-65c5-4c6b-ac0d-3a01272f0b2a None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:41.060483 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bf2aa-65c5-4c6b-ac0d-3a01272f0b2a None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:41.060483 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bf2aa-65c5-4c6b-ac0d-3a01272f0b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:41.096262 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-236bf2aa-65c5-4c6b-ac0d-3a01272f0b2a None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:10:41.096262 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-236bf2aa-65c5-4c6b-ac0d-3a01272f0b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:10:41.113156 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:41.152364 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 651/1294] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:10:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:10:41.425223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ea6e4-7687-4944-81c1-af9fc4fa44cb None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:41.457236 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:41.529944 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ea6e4-7687-4944-81c1-af9fc4fa44cb None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:41.570286 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6803bf-0d73-4853-aff0-10bc615748e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:41.570943 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6803bf-0d73-4853-aff0-10bc615748e6 None admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:41.571178 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6803bf-0d73-4853-aff0-10bc615748e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:41.571467 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6803bf-0d73-4853-aff0-10bc615748e6 None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:41.572135 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6803bf-0d73-4853-aff0-10bc615748e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:41.573480 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6803bf-0d73-4853-aff0-10bc615748e6 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:41.708516 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 644/1295] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Sep 6 20:10:41 2022] POST /identity/v3/services => generated 246 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:10:43.916093 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5191f61-880d-41f4-a171-0549f3e9978d None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:43.916616 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5191f61-880d-41f4-a171-0549f3e9978d None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:43.916616 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5191f61-880d-41f4-a171-0549f3e9978d None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:43.918045 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 652/1296] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:10:43.923885 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3fd52-665c-4b29-8811-1fd3413f4948 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:43.924449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3fd52-665c-4b29-8811-1fd3413f4948 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:43.924449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3fd52-665c-4b29-8811-1fd3413f4948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:43.943728 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-7eb3fd52-665c-4b29-8811-1fd3413f4948 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:10:43.944957 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-7eb3fd52-665c-4b29-8811-1fd3413f4948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:10:44.027589 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 645/1297] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:10:43 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:10:44.296765 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5191f61-880d-41f4-a171-0549f3e9978d None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:44.410089 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5191f61-880d-41f4-a171-0549f3e9978d None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:44.449473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d2c9b-8650-4372-8947-099247d5fb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:44.450121 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d2c9b-8650-4372-8947-099247d5fb4c None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:44.450364 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d2c9b-8650-4372-8947-099247d5fb4c None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:44.450637 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d2c9b-8650-4372-8947-099247d5fb4c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:44.451229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d2c9b-8650-4372-8947-099247d5fb4c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:44.453158 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d2c9b-8650-4372-8947-099247d5fb4c None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:44.462068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-9c3d2c9b-8650-4372-8947-099247d5fb4c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 20:10:44.462068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:44.462068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 20:10:44.462068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 20:10:44.462068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 20:10:44.462068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 20:10:44.462068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 20:10:44.462068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:10:44.462068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 20:10:44.462068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:10:44.462068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:10:44.462068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:10:44.462068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:44.462068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:44.462068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:44.462068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:44.462068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:44.463215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:44.463215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:44.463215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:44.463215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:44.463215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:44.463215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:44.463215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 20:10:44.463215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 20:10:44.463215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 20:10:44.463215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 20:10:44.463215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:44.463215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:44.463215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:44.463215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:44.463215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:44.463215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:44.472293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:44.472293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:44.472293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:44.472293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:44.472293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:44.472293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:44.472293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:44.472293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:44.472293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:44.472293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:44.472293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 20:10:44.472293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:10:44.472293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 20:10:44.472293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:10:44.472293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 653/1298] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Sep 6 20:10:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:44.473322 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3fd52-665c-4b29-8811-1fd3413f4948 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:44.491378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:44.571681 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3fd52-665c-4b29-8811-1fd3413f4948 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:44.607429 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a0d72-bc45-48fc-9de9-80f642776e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:44.608298 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a0d72-bc45-48fc-9de9-80f642776e90 None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:44.608513 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a0d72-bc45-48fc-9de9-80f642776e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:44.608786 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a0d72-bc45-48fc-9de9-80f642776e90 None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:44.609424 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a0d72-bc45-48fc-9de9-80f642776e90 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:44.609731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a0d72-bc45-48fc-9de9-80f642776e90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:44.611929 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a0d72-bc45-48fc-9de9-80f642776e90 None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:44.616563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 646/1299] 10.222.0.77 () {56 vars in 1116 bytes} [Tue Sep 6 20:10:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:44.622770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d2c9b-8650-4372-8947-099247d5fb4c None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:44.655789 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:44.722073 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d2c9b-8650-4372-8947-099247d5fb4c None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:44.756412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1a7d6-10a4-4b05-a107-57eb55856138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:44.757018 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1a7d6-10a4-4b05-a107-57eb55856138 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:44.757354 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1a7d6-10a4-4b05-a107-57eb55856138 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:44.757584 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1a7d6-10a4-4b05-a107-57eb55856138 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:44.758256 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1a7d6-10a4-4b05-a107-57eb55856138 None admin] RBAC: Adding query filter params (interface=public, service_id=91bca6d0c5004355a1ebbaf979e0f1ce, region_id=RegionOne) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:44.758561 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1a7d6-10a4-4b05-a107-57eb55856138 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:44.759995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1a7d6-10a4-4b05-a107-57eb55856138 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:44.766631 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 654/1300] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Sep 6 20:10:44 2022] GET /identity/v3/endpoints?service_id=91bca6d0c5004355a1ebbaf979e0f1ce&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:44.772421 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a0d72-bc45-48fc-9de9-80f642776e90 None admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:44.864685 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:44.884034 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a0d72-bc45-48fc-9de9-80f642776e90 None admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:44.919153 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58876a-3eec-47d7-98a4-8efbe92e48be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:44.919791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58876a-3eec-47d7-98a4-8efbe92e48be None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:44.920069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58876a-3eec-47d7-98a4-8efbe92e48be None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:44.920344 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58876a-3eec-47d7-98a4-8efbe92e48be None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:44.920969 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58876a-3eec-47d7-98a4-8efbe92e48be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:44.922327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58876a-3eec-47d7-98a4-8efbe92e48be None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:44.929101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 647/1301] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Sep 6 20:10:44 2022] GET /identity/v3/services => generated 2191 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:10:47.127196 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97d7d9-98a6-4a04-b324-d4b350ac5950 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:47.127810 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97d7d9-98a6-4a04-b324-d4b350ac5950 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:47.127810 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97d7d9-98a6-4a04-b324-d4b350ac5950 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:47.129076 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 655/1302] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:10:47.134399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7a2f0-e84f-4892-85d6-dfcc156fef30 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:47.134848 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7a2f0-e84f-4892-85d6-dfcc156fef30 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:47.134943 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7a2f0-e84f-4892-85d6-dfcc156fef30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:47.154224 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-c4c7a2f0-e84f-4892-85d6-dfcc156fef30 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:10:47.155470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c4c7a2f0-e84f-4892-85d6-dfcc156fef30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:10:47.223255 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 648/1303] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:10:47 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 20:10:47.496098 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97d7d9-98a6-4a04-b324-d4b350ac5950 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:47.593496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:47.600474 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97d7d9-98a6-4a04-b324-d4b350ac5950 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:47.635541 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8d7d0-1725-4318-a08f-5983be4948a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:47.636170 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8d7d0-1725-4318-a08f-5983be4948a2 None admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:47.636445 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8d7d0-1725-4318-a08f-5983be4948a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:47.636712 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8d7d0-1725-4318-a08f-5983be4948a2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:47.637288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8d7d0-1725-4318-a08f-5983be4948a2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:47.638652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8d7d0-1725-4318-a08f-5983be4948a2 None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:47.647464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application [None req-82a8d7d0-1725-4318-a08f-5983be4948a2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 20:10:47.647464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:47.647464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 20:10:47.647464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 20:10:47.647464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 20:10:47.647464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 20:10:47.647464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 20:10:47.647464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:10:47.647464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 20:10:47.647464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:10:47.647464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 20:10:47.647464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:10:47.647464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 20:10:47.647464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 20:10:47.647464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 20:10:47.647464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 20:10:47.647464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 20:10:47.648622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 20:10:47.648622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 20:10:47.648622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 20:10:47.648622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 20:10:47.648622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 20:10:47.648622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 20:10:47.648622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 20:10:47.648622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 20:10:47.648622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 20:10:47.648622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 20:10:47.648622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 20:10:47.648622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 20:10:47.648622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 20:10:47.648622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 20:10:47.648622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 20:10:47.648622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 20:10:47.649530 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 20:10:47.649530 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application with Lock( Sep 06 20:10:47.649530 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 20:10:47.649530 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self._enter() Sep 06 20:10:47.649530 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 20:10:47.649530 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 20:10:47.649530 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 20:10:47.649530 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application return self.creator() Sep 06 20:10:47.649530 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 20:10:47.649530 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application created_value = creator( Sep 06 20:10:47.649530 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 20:10:47.649530 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 20:10:47.649530 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 20:10:47.649530 dv-cinder-847732-4-smb devstack@keystone.service[81846]: ERROR keystone.server.flask.application Sep 06 20:10:47.649530 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 656/1304] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Sep 6 20:10:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 20:10:47.654883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7a2f0-e84f-4892-85d6-dfcc156fef30 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:47.733219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:47.755906 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7a2f0-e84f-4892-85d6-dfcc156fef30 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:47.790108 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fa098-11ed-4484-8f4a-1431c94df93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:47.790728 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fa098-11ed-4484-8f4a-1431c94df93f None admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:47.790998 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fa098-11ed-4484-8f4a-1431c94df93f None admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:47.791262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fa098-11ed-4484-8f4a-1431c94df93f None admin] PATH_INFO: `/v3/services` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:47.791910 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fa098-11ed-4484-8f4a-1431c94df93f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:10:47.792209 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fa098-11ed-4484-8f4a-1431c94df93f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:47.793561 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fa098-11ed-4484-8f4a-1431c94df93f None admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:47.798724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 649/1305] 10.222.0.77 () {56 vars in 1116 bytes} [Tue Sep 6 20:10:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:10:47.804890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8d7d0-1725-4318-a08f-5983be4948a2 None admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:10:47.914224 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8d7d0-1725-4318-a08f-5983be4948a2 None admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:10:47.953781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2522899-82d4-482e-9cd8-2033f147d5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:10:47.954430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2522899-82d4-482e-9cd8-2033f147d5ba None admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:10:47.954706 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2522899-82d4-482e-9cd8-2033f147d5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:10:47.954975 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2522899-82d4-482e-9cd8-2033f147d5ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:10:47.955666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2522899-82d4-482e-9cd8-2033f147d5ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:10:47.957220 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2522899-82d4-482e-9cd8-2033f147d5ba None admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:10:48.052801 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 657/1306] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:10:47 2022] POST /identity/v3/endpoints => generated 331 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:10:57.818867 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=30 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:10:58.048024 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:04.539724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cb3cc-f4a3-4e7f-bba3-b8f30985605f None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:04.540225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cb3cc-f4a3-4e7f-bba3-b8f30985605f None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:04.540308 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cb3cc-f4a3-4e7f-bba3-b8f30985605f None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:04.548092 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea8514-5706-472b-9bad-a9977f9fb1fa None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:04.548546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea8514-5706-472b-9bad-a9977f9fb1fa None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:04.548546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea8514-5706-472b-9bad-a9977f9fb1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:04.551679 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 650/1307] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:18:04 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:18:04.672970 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-e2ea8514-5706-472b-9bad-a9977f9fb1fa None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:18:04.674264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-e2ea8514-5706-472b-9bad-a9977f9fb1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:04.800145 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 658/1308] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:18:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:18:05.126047 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a600a-d741-4527-983b-8c054e1d3517 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:05.126377 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a600a-d741-4527-983b-8c054e1d3517 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:05.126633 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a600a-d741-4527-983b-8c054e1d3517 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:05.128234 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 651/1309] 10.222.0.77 () {54 vars in 965 bytes} [Tue Sep 6 20:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:18:05.135155 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699d7fa-0ede-4bb7-98e3-e60c5f1bfe02 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:05.135665 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699d7fa-0ede-4bb7-98e3-e60c5f1bfe02 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:05.136026 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699d7fa-0ede-4bb7-98e3-e60c5f1bfe02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:05.231401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-2699d7fa-0ede-4bb7-98e3-e60c5f1bfe02 None None] MFA Rules not processed for user `5a876d70d9634bf59af5f138e856f75f`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:18:05.233290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-2699d7fa-0ede-4bb7-98e3-e60c5f1bfe02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:05.256515 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:05.316229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 659/1310] 10.222.0.77 () {58 vars in 1062 bytes} [Tue Sep 6 20:18:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:18:05.326023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a600a-d741-4527-983b-8c054e1d3517 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:18:05.327959 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f00a600a-d741-4527-983b-8c054e1d3517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:05.466321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a600a-d741-4527-983b-8c054e1d3517 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:18:05.559028 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b56db-35ba-4927-be6e-425a1aac698b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:18:05.559790 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b56db-35ba-4927-be6e-425a1aac698b service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:05.560040 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b56db-35ba-4927-be6e-425a1aac698b service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:05.560218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b56db-35ba-4927-be6e-425a1aac698b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:05.561822 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-0f5b56db-35ba-4927-be6e-425a1aac698b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:05.623757 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:05.688971 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b56db-35ba-4927-be6e-425a1aac698b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:18:05.690452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b56db-35ba-4927-be6e-425a1aac698b service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:18:05.712193 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 652/1311] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:18:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:18:08.217154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c21ba1-bd94-4ec3-b017-b1aa44df849f None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:08.217667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c21ba1-bd94-4ec3-b017-b1aa44df849f None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:08.217667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c21ba1-bd94-4ec3-b017-b1aa44df849f None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:08.219069 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 660/1312] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:18:08.224777 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b2f9d-f43c-492b-9451-c21380f32795 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:08.225247 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b2f9d-f43c-492b-9451-c21380f32795 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:08.225396 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b2f9d-f43c-492b-9451-c21380f32795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:08.315101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-6b7b2f9d-f43c-492b-9451-c21380f32795 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:18:08.316415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6b7b2f9d-f43c-492b-9451-c21380f32795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:08.439422 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 653/1313] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:18:08.724782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c21ba1-bd94-4ec3-b017-b1aa44df849f None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:18:08.726339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-92c21ba1-bd94-4ec3-b017-b1aa44df849f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:08.831554 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c21ba1-bd94-4ec3-b017-b1aa44df849f None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:18:08.905461 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:08.908205 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04695139-2fd0-4f98-99e6-ff52252fd837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:18:08.908823 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04695139-2fd0-4f98-99e6-ff52252fd837 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:08.909103 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04695139-2fd0-4f98-99e6-ff52252fd837 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:08.909379 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04695139-2fd0-4f98-99e6-ff52252fd837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:08.911040 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-04695139-2fd0-4f98-99e6-ff52252fd837 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:09.026257 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04695139-2fd0-4f98-99e6-ff52252fd837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:18:09.027729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04695139-2fd0-4f98-99e6-ff52252fd837 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:18:09.046641 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 661/1314] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:18:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:18:11.800203 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8d99e-bf5f-406b-89db-fb001df57dd3 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:11.800736 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8d99e-bf5f-406b-89db-fb001df57dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:11.800736 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8d99e-bf5f-406b-89db-fb001df57dd3 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:11.802082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 654/1315] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:18:11.807547 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0efeaf-a072-4645-ba38-b480de96053d None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:11.808093 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0efeaf-a072-4645-ba38-b480de96053d None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:11.808189 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0efeaf-a072-4645-ba38-b480de96053d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:11.882617 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-ef0efeaf-a072-4645-ba38-b480de96053d None None] MFA Rules not processed for user `e3a2729e92ec4f42844ed3a9746d1b14`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:18:11.884058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ef0efeaf-a072-4645-ba38-b480de96053d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:11.941004 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:11.986372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 662/1316] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:18:11 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:18:12.290327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d0a5b-7c4b-4341-bdea-a8b7de152d1a None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:12.290613 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d0a5b-7c4b-4341-bdea-a8b7de152d1a None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:12.290889 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d0a5b-7c4b-4341-bdea-a8b7de152d1a None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:12.292267 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 655/1317] 10.222.0.77 () {54 vars in 965 bytes} [Tue Sep 6 20:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:18:12.298464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce9917-62cd-4dd3-8c50-02a16af64b1f None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:12.298748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce9917-62cd-4dd3-8c50-02a16af64b1f None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:12.299044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce9917-62cd-4dd3-8c50-02a16af64b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:12.376449 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-11ce9917-62cd-4dd3-8c50-02a16af64b1f None None] MFA Rules not processed for user `5a876d70d9634bf59af5f138e856f75f`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:18:12.377665 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-11ce9917-62cd-4dd3-8c50-02a16af64b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:12.456895 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 663/1318] 10.222.0.77 () {58 vars in 1062 bytes} [Tue Sep 6 20:18:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:18:12.465989 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d0a5b-7c4b-4341-bdea-a8b7de152d1a None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:18:12.467662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-e73d0a5b-7c4b-4341-bdea-a8b7de152d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:12.477531 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:12.572394 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d0a5b-7c4b-4341-bdea-a8b7de152d1a None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:18:12.645746 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f6e1a-1515-433d-aa33-592c6badc59b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:18:12.646350 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f6e1a-1515-433d-aa33-592c6badc59b service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:12.646621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f6e1a-1515-433d-aa33-592c6badc59b service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:12.646888 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f6e1a-1515-433d-aa33-592c6badc59b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:12.648502 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-8f2f6e1a-1515-433d-aa33-592c6badc59b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:12.711968 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:12.759563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f6e1a-1515-433d-aa33-592c6badc59b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:18:12.760999 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f6e1a-1515-433d-aa33-592c6badc59b service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:18:12.781176 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 656/1319] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:18:12 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:18:16.138923 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a350d-bcb0-474b-b15a-cd8479b2d572 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:16.139432 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a350d-bcb0-474b-b15a-cd8479b2d572 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:16.139432 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a350d-bcb0-474b-b15a-cd8479b2d572 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:16.140793 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 664/1320] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:18:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:18:16.146256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dede5-6884-4de0-8ca1-ef675ba0c777 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:16.146733 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dede5-6884-4de0-8ca1-ef675ba0c777 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:16.146830 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dede5-6884-4de0-8ca1-ef675ba0c777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:16.212076 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-432dede5-6884-4de0-8ca1-ef675ba0c777 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:18:16.213281 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-432dede5-6884-4de0-8ca1-ef675ba0c777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:16.308668 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 657/1321] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:18:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:18:16.613909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a350d-bcb0-474b-b15a-cd8479b2d572 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:18:16.615474 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-097a350d-bcb0-474b-b15a-cd8479b2d572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:16.665751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:16.722417 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a350d-bcb0-474b-b15a-cd8479b2d572 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:18:16.800266 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13c250-c4ad-49a4-a4c7-01c6ba52785d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:18:16.800879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13c250-c4ad-49a4-a4c7-01c6ba52785d service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:16.801156 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13c250-c4ad-49a4-a4c7-01c6ba52785d service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:16.801426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13c250-c4ad-49a4-a4c7-01c6ba52785d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:16.803058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-4e13c250-c4ad-49a4-a4c7-01c6ba52785d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:16.907030 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:16.922189 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13c250-c4ad-49a4-a4c7-01c6ba52785d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:18:16.923730 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13c250-c4ad-49a4-a4c7-01c6ba52785d service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:18:16.943280 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 665/1322] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:18:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:18:20.315424 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b1184-fa3e-4eae-8fe9-42334cf7417c None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:20.316011 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b1184-fa3e-4eae-8fe9-42334cf7417c None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:20.316011 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b1184-fa3e-4eae-8fe9-42334cf7417c None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:20.317352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 658/1323] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:18:20.322726 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a6edc-506a-47a2-a7b1-0cf018275578 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:20.323155 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a6edc-506a-47a2-a7b1-0cf018275578 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:20.323306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a6edc-506a-47a2-a7b1-0cf018275578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:20.402407 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-b81a6edc-506a-47a2-a7b1-0cf018275578 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:18:20.404414 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-b81a6edc-506a-47a2-a7b1-0cf018275578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:20.522807 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 666/1324] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:18:20.805551 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b1184-fa3e-4eae-8fe9-42334cf7417c None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:18:20.807180 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-2d2b1184-fa3e-4eae-8fe9-42334cf7417c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:20.830710 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:20.917043 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b1184-fa3e-4eae-8fe9-42334cf7417c None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:18:20.991639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116b7ef-16c6-47b5-9532-7969680fb90b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:18:20.992250 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116b7ef-16c6-47b5-9532-7969680fb90b service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:20.992529 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116b7ef-16c6-47b5-9532-7969680fb90b service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:20.992795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116b7ef-16c6-47b5-9532-7969680fb90b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:20.994437 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-7116b7ef-16c6-47b5-9532-7969680fb90b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:21.078034 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:21.117970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116b7ef-16c6-47b5-9532-7969680fb90b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:18:21.119921 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116b7ef-16c6-47b5-9532-7969680fb90b service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:18:21.139820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 659/1325] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:18:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:18:23.416231 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b6e5b-3713-4a47-8467-c465a53d8e3d None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:23.416867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b6e5b-3713-4a47-8467-c465a53d8e3d None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:23.416867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b6e5b-3713-4a47-8467-c465a53d8e3d None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:23.418769 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 667/1326] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:18:23.424642 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cf454-5c36-4145-a557-2cd1a5f63deb None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:23.425430 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cf454-5c36-4145-a557-2cd1a5f63deb None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:23.425430 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cf454-5c36-4145-a557-2cd1a5f63deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:23.496755 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-837cf454-5c36-4145-a557-2cd1a5f63deb None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:18:23.497991 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-837cf454-5c36-4145-a557-2cd1a5f63deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:23.600203 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 660/1327] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:18:23.890153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b6e5b-3713-4a47-8467-c465a53d8e3d None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:18:23.891887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-027b6e5b-3713-4a47-8467-c465a53d8e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:23.957219 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:24.004602 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b6e5b-3713-4a47-8467-c465a53d8e3d None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:18:24.083679 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced755b5-ec8b-4035-b21c-f0c1c342f029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:18:24.084289 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced755b5-ec8b-4035-b21c-f0c1c342f029 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:24.084570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced755b5-ec8b-4035-b21c-f0c1c342f029 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:24.084834 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced755b5-ec8b-4035-b21c-f0c1c342f029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:24.086448 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ced755b5-ec8b-4035-b21c-f0c1c342f029 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:24.201494 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:24.204138 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced755b5-ec8b-4035-b21c-f0c1c342f029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:18:24.205599 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced755b5-ec8b-4035-b21c-f0c1c342f029 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:18:24.224504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 668/1328] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:18:26.488848 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6206e5e-b506-46c1-898e-9fa15db013cd None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:26.489376 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6206e5e-b506-46c1-898e-9fa15db013cd None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:26.489488 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6206e5e-b506-46c1-898e-9fa15db013cd None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:26.490746 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 661/1329] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:18:26.496499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dce2b-4d58-4435-af8b-a3f7dc7911aa None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:26.496990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dce2b-4d58-4435-af8b-a3f7dc7911aa None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:26.497192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dce2b-4d58-4435-af8b-a3f7dc7911aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:26.569872 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-fc4dce2b-4d58-4435-af8b-a3f7dc7911aa None None] MFA Rules not processed for user `e3a2729e92ec4f42844ed3a9746d1b14`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:18:26.571026 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-fc4dce2b-4d58-4435-af8b-a3f7dc7911aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:26.670213 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 669/1330] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:18:26 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:18:26.955942 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6206e5e-b506-46c1-898e-9fa15db013cd None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:18:26.957541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c6206e5e-b506-46c1-898e-9fa15db013cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:27.000472 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:27.085993 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6206e5e-b506-46c1-898e-9fa15db013cd None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:18:27.166864 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99fd7f-4d99-4cf2-a711-ead4c0ed029e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:18:27.167652 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99fd7f-4d99-4cf2-a711-ead4c0ed029e service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:27.168531 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99fd7f-4d99-4cf2-a711-ead4c0ed029e service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:27.177696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99fd7f-4d99-4cf2-a711-ead4c0ed029e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:27.177696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-cf99fd7f-4d99-4cf2-a711-ead4c0ed029e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:27.257888 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:27.289243 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99fd7f-4d99-4cf2-a711-ead4c0ed029e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:18:27.291148 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99fd7f-4d99-4cf2-a711-ead4c0ed029e service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:18:27.310964 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 662/1331] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:18:26 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:18:29.987761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe847a-ae26-4b4b-bf7f-f477d8369adc None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:29.988306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe847a-ae26-4b4b-bf7f-f477d8369adc None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:29.988306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe847a-ae26-4b4b-bf7f-f477d8369adc None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:29.989665 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 670/1332] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:18:29.995469 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ddef1-b636-4967-867c-3d9a045186e4 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:29.996621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ddef1-b636-4967-867c-3d9a045186e4 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:29.996621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ddef1-b636-4967-867c-3d9a045186e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:30.065101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-470ddef1-b636-4967-867c-3d9a045186e4 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:18:30.066341 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-470ddef1-b636-4967-867c-3d9a045186e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:30.170082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 663/1333] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:18:30.460744 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe847a-ae26-4b4b-bf7f-f477d8369adc None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:18:30.462297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-0ebe847a-ae26-4b4b-bf7f-f477d8369adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:30.534948 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:30.571366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe847a-ae26-4b4b-bf7f-f477d8369adc None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:18:30.652963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75472e6c-e6bb-486f-931f-90461b3151f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:18:30.653569 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75472e6c-e6bb-486f-931f-90461b3151f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:30.653853 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75472e6c-e6bb-486f-931f-90461b3151f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:30.654127 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75472e6c-e6bb-486f-931f-90461b3151f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:30.655763 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-75472e6c-e6bb-486f-931f-90461b3151f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:30.779164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75472e6c-e6bb-486f-931f-90461b3151f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:18:30.780871 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75472e6c-e6bb-486f-931f-90461b3151f1 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:18:30.793991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:30.802363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 671/1334] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:18:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:18:33.037485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5a9e8-fe21-4821-bc48-16ed712f2d41 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:33.038029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5a9e8-fe21-4821-bc48-16ed712f2d41 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:33.038029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5a9e8-fe21-4821-bc48-16ed712f2d41 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:33.039477 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 664/1335] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:18:33.045219 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9467d5-9dc7-4325-8fc2-806accc3f7c9 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:33.045705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9467d5-9dc7-4325-8fc2-806accc3f7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:33.045809 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9467d5-9dc7-4325-8fc2-806accc3f7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:33.112647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-ed9467d5-9dc7-4325-8fc2-806accc3f7c9 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:18:33.113759 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ed9467d5-9dc7-4325-8fc2-806accc3f7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:33.211896 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 672/1336] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:18:33.502695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5a9e8-fe21-4821-bc48-16ed712f2d41 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:18:33.504308 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-b1e5a9e8-fe21-4821-bc48-16ed712f2d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:33.544759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:33.609659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5a9e8-fe21-4821-bc48-16ed712f2d41 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:18:33.685108 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9d2ac-b301-4523-b502-246de1428c62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:18:33.685626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9d2ac-b301-4523-b502-246de1428c62 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:33.685900 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9d2ac-b301-4523-b502-246de1428c62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:33.686167 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9d2ac-b301-4523-b502-246de1428c62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:33.687914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-01b9d2ac-b301-4523-b502-246de1428c62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:33.772753 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:33.798182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9d2ac-b301-4523-b502-246de1428c62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:18:33.799646 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9d2ac-b301-4523-b502-246de1428c62 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:18:33.818334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 665/1337] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:18:36.821344 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66eeda-3c1c-43ac-828e-7f9e0499b2ef None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:36.821752 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66eeda-3c1c-43ac-828e-7f9e0499b2ef None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:36.821917 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66eeda-3c1c-43ac-828e-7f9e0499b2ef None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:36.823286 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 673/1338] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:18:36.829459 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cef693-8773-434a-b583-3459552b1c52 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:36.830048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cef693-8773-434a-b583-3459552b1c52 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:36.830048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cef693-8773-434a-b583-3459552b1c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:36.896891 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-85cef693-8773-434a-b583-3459552b1c52 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:18:36.898110 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-85cef693-8773-434a-b583-3459552b1c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:37.009569 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 666/1339] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:18:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:18:37.294709 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66eeda-3c1c-43ac-828e-7f9e0499b2ef None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:18:37.296303 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-cb66eeda-3c1c-43ac-828e-7f9e0499b2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:37.376251 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:37.404943 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66eeda-3c1c-43ac-828e-7f9e0499b2ef None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:18:37.483543 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70963d68-edd2-47d4-ba52-b0435d1ed51e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:18:37.484159 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70963d68-edd2-47d4-ba52-b0435d1ed51e service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:37.484439 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70963d68-edd2-47d4-ba52-b0435d1ed51e service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:37.484710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70963d68-edd2-47d4-ba52-b0435d1ed51e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:37.486387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-70963d68-edd2-47d4-ba52-b0435d1ed51e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:37.599111 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70963d68-edd2-47d4-ba52-b0435d1ed51e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:18:37.600506 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70963d68-edd2-47d4-ba52-b0435d1ed51e service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:18:37.622110 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 674/1340] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:18:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:18:42.148957 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce29512-782d-4fad-bbf3-e05bb020f66e None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:42.149519 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce29512-782d-4fad-bbf3-e05bb020f66e None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:42.149519 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce29512-782d-4fad-bbf3-e05bb020f66e None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:42.150825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 667/1341] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:18:42.156735 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b8c9a-5d85-4a05-947c-ec4e7d156976 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:42.157336 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b8c9a-5d85-4a05-947c-ec4e7d156976 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:42.157336 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b8c9a-5d85-4a05-947c-ec4e7d156976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:42.162780 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:42.228739 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-a48b8c9a-5d85-4a05-947c-ec4e7d156976 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:18:42.229970 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-a48b8c9a-5d85-4a05-947c-ec4e7d156976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:42.338708 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 675/1342] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:18:42.624121 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce29512-782d-4fad-bbf3-e05bb020f66e None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:18:42.625663 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-bce29512-782d-4fad-bbf3-e05bb020f66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:42.675400 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:42.738564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce29512-782d-4fad-bbf3-e05bb020f66e None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:18:42.819638 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f28b9d-bbf0-43e1-8244-adca0a716051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:18:42.820298 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f28b9d-bbf0-43e1-8244-adca0a716051 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:42.820580 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f28b9d-bbf0-43e1-8244-adca0a716051 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:42.820853 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f28b9d-bbf0-43e1-8244-adca0a716051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:42.822597 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-58f28b9d-bbf0-43e1-8244-adca0a716051 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:42.928089 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:42.945078 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f28b9d-bbf0-43e1-8244-adca0a716051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:18:42.946501 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f28b9d-bbf0-43e1-8244-adca0a716051 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:18:42.964418 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 668/1343] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:18:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:18:46.354894 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826840dd-489b-416e-a6c2-64b462268e84 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:46.355393 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826840dd-489b-416e-a6c2-64b462268e84 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:46.355528 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826840dd-489b-416e-a6c2-64b462268e84 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:46.356906 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 676/1344] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:18:46.362488 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a07398-8a9f-429d-ac16-a50da819225f None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:46.363117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a07398-8a9f-429d-ac16-a50da819225f None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:46.363117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a07398-8a9f-429d-ac16-a50da819225f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:46.431852 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-a6a07398-8a9f-429d-ac16-a50da819225f None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:18:46.433612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-a6a07398-8a9f-429d-ac16-a50da819225f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:46.538683 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 669/1345] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:18:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:18:46.829768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826840dd-489b-416e-a6c2-64b462268e84 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:18:46.833547 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-826840dd-489b-416e-a6c2-64b462268e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:46.923324 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:46.939557 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826840dd-489b-416e-a6c2-64b462268e84 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:18:47.046886 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57793f5-bd0e-481c-80af-5b3d0a6d6a56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:18:47.047535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57793f5-bd0e-481c-80af-5b3d0a6d6a56 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:47.047820 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57793f5-bd0e-481c-80af-5b3d0a6d6a56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:47.048132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57793f5-bd0e-481c-80af-5b3d0a6d6a56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:47.049894 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-c57793f5-bd0e-481c-80af-5b3d0a6d6a56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:47.172198 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57793f5-bd0e-481c-80af-5b3d0a6d6a56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:18:47.173674 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57793f5-bd0e-481c-80af-5b3d0a6d6a56 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:18:47.193580 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 677/1346] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:18:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:18:52.033420 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470bc70-353e-4fc1-b3d2-3bdb53cd4dce None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:52.033952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470bc70-353e-4fc1-b3d2-3bdb53cd4dce None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:52.033952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470bc70-353e-4fc1-b3d2-3bdb53cd4dce None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:52.035334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 670/1347] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:18:52.040953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab17fd-7668-4ed5-99bd-62d344c01e20 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:52.041459 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab17fd-7668-4ed5-99bd-62d344c01e20 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:52.041576 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab17fd-7668-4ed5-99bd-62d344c01e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:52.063607 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:52.121008 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-3cab17fd-7668-4ed5-99bd-62d344c01e20 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:18:52.122304 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-3cab17fd-7668-4ed5-99bd-62d344c01e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:52.266273 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 678/1348] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:18:52.555737 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470bc70-353e-4fc1-b3d2-3bdb53cd4dce None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:18:52.557280 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-b470bc70-353e-4fc1-b3d2-3bdb53cd4dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:52.618522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:52.670045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470bc70-353e-4fc1-b3d2-3bdb53cd4dce None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:18:52.743415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6aa78-7af3-4e72-afaa-2890ce665162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:18:52.744045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6aa78-7af3-4e72-afaa-2890ce665162 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:52.744323 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6aa78-7af3-4e72-afaa-2890ce665162 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:52.744591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6aa78-7af3-4e72-afaa-2890ce665162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:52.746754 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-70a6aa78-7af3-4e72-afaa-2890ce665162 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:52.857496 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:18:52.861112 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6aa78-7af3-4e72-afaa-2890ce665162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:18:52.862534 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6aa78-7af3-4e72-afaa-2890ce665162 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:18:52.891261 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 671/1349] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:18:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:18:58.005649 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99197f-860a-44cd-9f43-1421443661e9 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:58.006520 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99197f-860a-44cd-9f43-1421443661e9 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:58.006962 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99197f-860a-44cd-9f43-1421443661e9 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:58.008487 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 679/1350] 10.222.0.77 () {54 vars in 921 bytes} [Tue Sep 6 20:18:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:18:58.017479 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e23e00-7428-406e-b5b5-5099d78d498f None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:18:58.017479 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e23e00-7428-406e-b5b5-5099d78d498f None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:18:58.017479 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e23e00-7428-406e-b5b5-5099d78d498f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:18:58.163827 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-b5e23e00-7428-406e-b5b5-5099d78d498f None None] MFA Rules not processed for user `2a486663ec144db0bbde6bf3deb35a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:18:58.165634 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-b5e23e00-7428-406e-b5b5-5099d78d498f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:18:58.312015 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 672/1351] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Sep 6 20:18:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:19:02.263318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=59 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:02.538684 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d410f-6bb3-45de-a26c-974bd625d594 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:02.539329 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d410f-6bb3-45de-a26c-974bd625d594 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:02.539713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d410f-6bb3-45de-a26c-974bd625d594 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:02.541160 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 680/1352] 10.222.0.77 () {54 vars in 921 bytes} [Tue Sep 6 20:19:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:19:02.549293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15c0b7-6926-4fb6-a305-629fbc7a0a87 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:02.549967 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15c0b7-6926-4fb6-a305-629fbc7a0a87 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:02.549967 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15c0b7-6926-4fb6-a305-629fbc7a0a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:02.609608 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:02.634792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-eb15c0b7-6926-4fb6-a305-629fbc7a0a87 None None] MFA Rules not processed for user `2a486663ec144db0bbde6bf3deb35a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:19:02.636785 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-eb15c0b7-6926-4fb6-a305-629fbc7a0a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:02.754397 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 673/1353] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Sep 6 20:19:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:19:04.143333 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad99a7-73b7-42af-93c4-ff1ebade3c97 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:04.143333 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad99a7-73b7-42af-93c4-ff1ebade3c97 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:04.143333 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad99a7-73b7-42af-93c4-ff1ebade3c97 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:04.144155 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 681/1354] 10.222.0.77 () {54 vars in 921 bytes} [Tue Sep 6 20:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:19:04.149582 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981c12e-259b-4c95-b0f8-e19b3483c0c6 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:04.150243 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981c12e-259b-4c95-b0f8-e19b3483c0c6 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:04.150243 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981c12e-259b-4c95-b0f8-e19b3483c0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:04.237288 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-0981c12e-259b-4c95-b0f8-e19b3483c0c6 None None] MFA Rules not processed for user `2a486663ec144db0bbde6bf3deb35a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:19:04.238526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-0981c12e-259b-4c95-b0f8-e19b3483c0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:04.284406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:04.351550 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 674/1355] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Sep 6 20:19:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:19:07.988044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ace913-2f31-4f93-b6fb-0cbb0b8439dc None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:07.988044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ace913-2f31-4f93-b6fb-0cbb0b8439dc None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:07.988044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ace913-2f31-4f93-b6fb-0cbb0b8439dc None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:07.988044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 682/1356] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:19:07.993898 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396bd7b-e514-4c4d-85be-7d71ab467c28 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:07.994913 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396bd7b-e514-4c4d-85be-7d71ab467c28 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:07.995492 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396bd7b-e514-4c4d-85be-7d71ab467c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:08.085362 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-4396bd7b-e514-4c4d-85be-7d71ab467c28 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:19:08.086504 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-4396bd7b-e514-4c4d-85be-7d71ab467c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:08.199487 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 675/1357] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:19:08.499876 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a598a44-b844-451e-adce-fe72e39aa91c None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:08.501108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a598a44-b844-451e-adce-fe72e39aa91c None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:08.501599 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a598a44-b844-451e-adce-fe72e39aa91c None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:08.503313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 683/1358] 10.222.0.77 () {54 vars in 962 bytes} [Tue Sep 6 20:19:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:19:08.512829 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97d2b5-3273-4942-9081-53a67a929d3a None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:08.513387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97d2b5-3273-4942-9081-53a67a929d3a None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:08.514725 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97d2b5-3273-4942-9081-53a67a929d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:08.533810 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:08.614080 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-cc97d2b5-3273-4942-9081-53a67a929d3a None None] MFA Rules not processed for user `b09ce16da49b4af38491ad4eb6287d70`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:19:08.615657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-cc97d2b5-3273-4942-9081-53a67a929d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:08.747614 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 676/1359] 10.222.0.77 () {58 vars in 1059 bytes} [Tue Sep 6 20:19:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:19:08.752910 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a598a44-b844-451e-adce-fe72e39aa91c None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:19:08.754614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-7a598a44-b844-451e-adce-fe72e39aa91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:08.917916 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a598a44-b844-451e-adce-fe72e39aa91c None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:19:08.997524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:09.039656 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b2f5e-899d-4451-973d-81ab6ea59649 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:19:09.040271 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b2f5e-899d-4451-973d-81ab6ea59649 service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:09.040546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b2f5e-899d-4451-973d-81ab6ea59649 service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:09.040852 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b2f5e-899d-4451-973d-81ab6ea59649 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:09.042983 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-156b2f5e-899d-4451-973d-81ab6ea59649 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:09.142113 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b2f5e-899d-4451-973d-81ab6ea59649 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:19:09.143791 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b2f5e-899d-4451-973d-81ab6ea59649 service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:19:09.165818 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 684/1360] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:19:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:19:11.605214 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570fa7b-013e-4561-83d9-de1d9786c5a6 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:11.605744 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570fa7b-013e-4561-83d9-de1d9786c5a6 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:11.606243 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570fa7b-013e-4561-83d9-de1d9786c5a6 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:11.608096 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 677/1361] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:19:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:19:11.613564 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6b907-c729-4d56-ac95-468696e760dc None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:11.614167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6b907-c729-4d56-ac95-468696e760dc None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:11.614167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6b907-c729-4d56-ac95-468696e760dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:11.686715 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-86a6b907-c729-4d56-ac95-468696e760dc None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:19:11.687736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-86a6b907-c729-4d56-ac95-468696e760dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:11.727343 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:11.799880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 685/1362] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:19:12.093492 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570fa7b-013e-4561-83d9-de1d9786c5a6 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:19:12.095186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6570fa7b-013e-4561-83d9-de1d9786c5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:12.171517 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:12.272380 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570fa7b-013e-4561-83d9-de1d9786c5a6 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:19:12.424206 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ba5ea-4e7e-4453-8b1e-515a90602090 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:19:12.424820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ba5ea-4e7e-4453-8b1e-515a90602090 service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:12.425218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ba5ea-4e7e-4453-8b1e-515a90602090 service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:12.425380 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ba5ea-4e7e-4453-8b1e-515a90602090 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:12.426984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-546ba5ea-4e7e-4453-8b1e-515a90602090 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:12.452474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:12.527306 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ba5ea-4e7e-4453-8b1e-515a90602090 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:19:12.528957 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ba5ea-4e7e-4453-8b1e-515a90602090 service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:19:12.548271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 678/1363] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:19:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:19:15.239772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2b532-065c-4d5a-8e9a-f543f886d5f2 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:15.240309 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2b532-065c-4d5a-8e9a-f543f886d5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:15.240309 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2b532-065c-4d5a-8e9a-f543f886d5f2 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:15.241787 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 686/1364] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:19:15.247575 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90b279-7944-442e-bb29-5af09c6f1ba8 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:15.248176 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90b279-7944-442e-bb29-5af09c6f1ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:15.248176 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90b279-7944-442e-bb29-5af09c6f1ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:15.324132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-7a90b279-7944-442e-bb29-5af09c6f1ba8 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:19:15.325334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-7a90b279-7944-442e-bb29-5af09c6f1ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:15.432802 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:15.443486 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 679/1365] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:19:15.777933 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0ebb8-2245-4162-82ce-23cb6608c8be None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:15.778355 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0ebb8-2245-4162-82ce-23cb6608c8be None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:15.778844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0ebb8-2245-4162-82ce-23cb6608c8be None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:15.780843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 687/1366] 10.222.0.77 () {54 vars in 962 bytes} [Tue Sep 6 20:19:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:19:15.787004 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06c4c5-78dc-462a-a81d-281cb03210d6 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:15.789922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06c4c5-78dc-462a-a81d-281cb03210d6 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:15.789922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06c4c5-78dc-462a-a81d-281cb03210d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:15.871221 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-3a06c4c5-78dc-462a-a81d-281cb03210d6 None None] MFA Rules not processed for user `b09ce16da49b4af38491ad4eb6287d70`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:19:15.872513 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-3a06c4c5-78dc-462a-a81d-281cb03210d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:16.006577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 680/1367] 10.222.0.77 () {58 vars in 1059 bytes} [Tue Sep 6 20:19:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:19:16.015770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0ebb8-2245-4162-82ce-23cb6608c8be None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:19:16.017228 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-79d0ebb8-2245-4162-82ce-23cb6608c8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:16.184429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0ebb8-2245-4162-82ce-23cb6608c8be None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:19:16.207144 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:16.313320 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373addb5-df37-45b2-a150-fcbd02586e5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:19:16.314074 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373addb5-df37-45b2-a150-fcbd02586e5a service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:16.314337 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373addb5-df37-45b2-a150-fcbd02586e5a service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:16.314443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373addb5-df37-45b2-a150-fcbd02586e5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:16.316722 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-373addb5-df37-45b2-a150-fcbd02586e5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:16.429968 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373addb5-df37-45b2-a150-fcbd02586e5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:19:16.431993 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373addb5-df37-45b2-a150-fcbd02586e5a service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:19:16.436950 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b882c55-27e9-4f67-a6ba-6a000ac9973e None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:16.437494 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b882c55-27e9-4f67-a6ba-6a000ac9973e None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:16.437494 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b882c55-27e9-4f67-a6ba-6a000ac9973e None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:16.439300 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 681/1368] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:19:16.444348 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603dc33-ca7e-4947-89dd-792854ae79db None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:16.444625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603dc33-ca7e-4947-89dd-792854ae79db None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:16.444906 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603dc33-ca7e-4947-89dd-792854ae79db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:16.452795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 688/1369] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:19:16.513341 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:16.522458 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-7603dc33-ca7e-4947-89dd-792854ae79db None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:19:16.523742 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-7603dc33-ca7e-4947-89dd-792854ae79db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:16.635586 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 682/1370] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:19:16.978935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951af8d-f964-4216-9b07-030ce3e28aee None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:16.978935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951af8d-f964-4216-9b07-030ce3e28aee None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:16.978935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951af8d-f964-4216-9b07-030ce3e28aee None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:16.985371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 689/1371] 10.222.0.77 () {54 vars in 964 bytes} [Tue Sep 6 20:19:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:19:16.985700 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d3ec8-6931-4fc4-a826-7c129d70850b None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:16.985994 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d3ec8-6931-4fc4-a826-7c129d70850b None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:16.986353 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d3ec8-6931-4fc4-a826-7c129d70850b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:17.080259 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-3d4d3ec8-6931-4fc4-a826-7c129d70850b None None] MFA Rules not processed for user `c6d2bb1c23484010bcc9238f9a9203a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:19:17.081520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-3d4d3ec8-6931-4fc4-a826-7c129d70850b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:17.176801 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:17.187093 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 683/1372] 10.222.0.77 () {58 vars in 1061 bytes} [Tue Sep 6 20:19:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:19:17.195634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951af8d-f964-4216-9b07-030ce3e28aee None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:19:17.197757 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-c951af8d-f964-4216-9b07-030ce3e28aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:17.232502 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:17.331384 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951af8d-f964-4216-9b07-030ce3e28aee None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:19:17.423677 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff97e4f-4670-4674-b9c9-c9531af6917e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:19:17.424337 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff97e4f-4670-4674-b9c9-c9531af6917e service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:17.424754 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff97e4f-4670-4674-b9c9-c9531af6917e service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:17.424951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff97e4f-4670-4674-b9c9-c9531af6917e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:17.426629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-5ff97e4f-4670-4674-b9c9-c9531af6917e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:17.526365 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:17.568563 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff97e4f-4670-4674-b9c9-c9531af6917e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:19:17.570163 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff97e4f-4670-4674-b9c9-c9531af6917e service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:19:17.612365 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 690/1373] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:19:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:19:18.937471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccd678-a0d1-4b71-90fa-9ba2447e9030 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:18.938067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccd678-a0d1-4b71-90fa-9ba2447e9030 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:18.938067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccd678-a0d1-4b71-90fa-9ba2447e9030 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:18.939371 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 684/1374] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:19:18.944980 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a334430-12d5-4341-82ff-31c3f3f92484 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:18.945427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a334430-12d5-4341-82ff-31c3f3f92484 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:18.945543 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a334430-12d5-4341-82ff-31c3f3f92484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:19.017725 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-6a334430-12d5-4341-82ff-31c3f3f92484 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:19:19.018986 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-6a334430-12d5-4341-82ff-31c3f3f92484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:19.128565 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 691/1375] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:19:19.428775 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccd678-a0d1-4b71-90fa-9ba2447e9030 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:19:19.430370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-95ccd678-a0d1-4b71-90fa-9ba2447e9030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:19.586813 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccd678-a0d1-4b71-90fa-9ba2447e9030 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:19:19.657559 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:19.711513 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236eafe9-9caa-47a1-ba40-19ac4331f5e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:19:19.712167 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236eafe9-9caa-47a1-ba40-19ac4331f5e7 service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:19.712447 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236eafe9-9caa-47a1-ba40-19ac4331f5e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:19.712713 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236eafe9-9caa-47a1-ba40-19ac4331f5e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:19.714334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-236eafe9-9caa-47a1-ba40-19ac4331f5e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:19.826361 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236eafe9-9caa-47a1-ba40-19ac4331f5e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:19:19.828017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236eafe9-9caa-47a1-ba40-19ac4331f5e7 service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:19:19.847785 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 685/1376] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:19:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:19:22.445542 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9df14-e58b-4a99-9d99-6fa539e18dd5 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:22.446104 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9df14-e58b-4a99-9d99-6fa539e18dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:22.446104 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9df14-e58b-4a99-9d99-6fa539e18dd5 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:22.448084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 692/1377] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:19:22.453321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3131ae-d63c-446a-be0c-1a0d235cede5 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:22.453809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3131ae-d63c-446a-be0c-1a0d235cede5 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:22.453903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3131ae-d63c-446a-be0c-1a0d235cede5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:22.528550 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-0b3131ae-d63c-446a-be0c-1a0d235cede5 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:19:22.529753 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-0b3131ae-d63c-446a-be0c-1a0d235cede5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:22.561551 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:22.639163 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 686/1378] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:19:22.928707 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9df14-e58b-4a99-9d99-6fa539e18dd5 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:19:22.930334 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-6aa9df14-e58b-4a99-9d99-6fa539e18dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:22.971857 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:23.096534 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9df14-e58b-4a99-9d99-6fa539e18dd5 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:19:23.222301 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:23.229419 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181113e-a0be-4bd0-90ac-a91c58a14bea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:19:23.230027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181113e-a0be-4bd0-90ac-a91c58a14bea service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:23.230304 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181113e-a0be-4bd0-90ac-a91c58a14bea service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:23.230572 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181113e-a0be-4bd0-90ac-a91c58a14bea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:23.233165 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-8181113e-a0be-4bd0-90ac-a91c58a14bea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:23.336310 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181113e-a0be-4bd0-90ac-a91c58a14bea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:19:23.338516 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181113e-a0be-4bd0-90ac-a91c58a14bea service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:19:23.358953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 693/1379] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:19:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:19:25.797138 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2862a10-0fc9-4f97-9c96-144c407ed1be None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:25.797866 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2862a10-0fc9-4f97-9c96-144c407ed1be None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:25.797866 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2862a10-0fc9-4f97-9c96-144c407ed1be None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:25.799068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 687/1380] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:19:25.804872 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23286745-d541-4fa7-ad08-847a99b0359c None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:25.805488 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23286745-d541-4fa7-ad08-847a99b0359c None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:25.805488 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23286745-d541-4fa7-ad08-847a99b0359c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:25.884787 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-23286745-d541-4fa7-ad08-847a99b0359c None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:19:25.885970 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-23286745-d541-4fa7-ad08-847a99b0359c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:25.966034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:26.013273 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 694/1381] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:19:26.382621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2862a10-0fc9-4f97-9c96-144c407ed1be None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:19:26.384828 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f2862a10-0fc9-4f97-9c96-144c407ed1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:26.549136 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2862a10-0fc9-4f97-9c96-144c407ed1be None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:19:26.563151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:26.675700 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbfbc9-5ddf-4857-bc15-009baf0760af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:19:26.676358 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbfbc9-5ddf-4857-bc15-009baf0760af service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:26.676708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbfbc9-5ddf-4857-bc15-009baf0760af service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:26.677060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbfbc9-5ddf-4857-bc15-009baf0760af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:26.679130 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6abbfbc9-5ddf-4857-bc15-009baf0760af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:26.801729 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbfbc9-5ddf-4857-bc15-009baf0760af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:19:26.804047 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbfbc9-5ddf-4857-bc15-009baf0760af service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:19:26.829364 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 688/1382] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:19:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:19:29.284650 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d05a1c-f753-4e2d-bfe5-f2436ff42784 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:29.285772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d05a1c-f753-4e2d-bfe5-f2436ff42784 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:29.285772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d05a1c-f753-4e2d-bfe5-f2436ff42784 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:29.286580 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 695/1383] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:19:29.292413 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78c03c-fe0a-46fa-8f7e-62e8d50d5843 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:29.292964 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78c03c-fe0a-46fa-8f7e-62e8d50d5843 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:29.293149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78c03c-fe0a-46fa-8f7e-62e8d50d5843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:29.316222 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:29.375347 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-6c78c03c-fe0a-46fa-8f7e-62e8d50d5843 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:19:29.376947 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6c78c03c-fe0a-46fa-8f7e-62e8d50d5843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:29.487860 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 689/1384] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:19:29.788678 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d05a1c-f753-4e2d-bfe5-f2436ff42784 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:19:29.791711 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-a9d05a1c-f753-4e2d-bfe5-f2436ff42784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:29.979007 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d05a1c-f753-4e2d-bfe5-f2436ff42784 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:19:30.042653 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:30.121850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e5b35-15f8-4517-92dc-a25183f55fda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:19:30.123033 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e5b35-15f8-4517-92dc-a25183f55fda service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:30.123210 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e5b35-15f8-4517-92dc-a25183f55fda service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:30.123815 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e5b35-15f8-4517-92dc-a25183f55fda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:30.125977 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-977e5b35-15f8-4517-92dc-a25183f55fda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:30.293990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e5b35-15f8-4517-92dc-a25183f55fda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:19:30.296236 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e5b35-15f8-4517-92dc-a25183f55fda service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:19:30.324239 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 696/1385] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:19:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:19:32.567625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706dc80-55c9-427f-8857-4a584a38edc1 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:32.568177 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706dc80-55c9-427f-8857-4a584a38edc1 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:32.568177 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706dc80-55c9-427f-8857-4a584a38edc1 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:32.569514 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 690/1386] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:19:32.575519 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e2c14-004f-44bc-8b06-0fededdf9545 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:32.576485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e2c14-004f-44bc-8b06-0fededdf9545 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:32.576485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e2c14-004f-44bc-8b06-0fededdf9545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:32.643731 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-014e2c14-004f-44bc-8b06-0fededdf9545 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:19:32.644944 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-014e2c14-004f-44bc-8b06-0fededdf9545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:32.653419 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:32.745946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 697/1387] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:19:33.035043 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706dc80-55c9-427f-8857-4a584a38edc1 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:19:33.036597 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-e706dc80-55c9-427f-8857-4a584a38edc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:33.134368 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:33.188922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706dc80-55c9-427f-8857-4a584a38edc1 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:19:33.326933 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5b386-6abd-45ac-9b1c-a8b683d98498 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:19:33.327847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5b386-6abd-45ac-9b1c-a8b683d98498 service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:33.334494 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5b386-6abd-45ac-9b1c-a8b683d98498 service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:33.334494 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5b386-6abd-45ac-9b1c-a8b683d98498 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:33.334494 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-d9c5b386-6abd-45ac-9b1c-a8b683d98498 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:33.388661 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc5498-459a-4db9-bc58-e6a30663386f None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:33.388861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc5498-459a-4db9-bc58-e6a30663386f None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:33.389127 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc5498-459a-4db9-bc58-e6a30663386f None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:33.390572 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 698/1388] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:19:33.396465 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc44f1e-d759-4c85-bc90-3fe9bb21b618 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:33.396837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc44f1e-d759-4c85-bc90-3fe9bb21b618 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:33.397120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc44f1e-d759-4c85-bc90-3fe9bb21b618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:33.400669 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:33.433585 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5b386-6abd-45ac-9b1c-a8b683d98498 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:19:33.435261 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5b386-6abd-45ac-9b1c-a8b683d98498 service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:19:33.454630 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 691/1389] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:19:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:19:33.470465 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-fdc44f1e-d759-4c85-bc90-3fe9bb21b618 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:19:33.471730 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-fdc44f1e-d759-4c85-bc90-3fe9bb21b618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:33.560458 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:33.573141 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 699/1390] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:19:33.881234 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf41c7-cdc2-4568-b5ef-6fe3c64f4d25 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:33.881737 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf41c7-cdc2-4568-b5ef-6fe3c64f4d25 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:33.881984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf41c7-cdc2-4568-b5ef-6fe3c64f4d25 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:33.883465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 692/1391] 10.222.0.77 () {54 vars in 961 bytes} [Tue Sep 6 20:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:19:33.889609 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5218ff-7fdf-4692-9e7a-80968c4abb03 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:33.890044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5218ff-7fdf-4692-9e7a-80968c4abb03 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:33.890164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5218ff-7fdf-4692-9e7a-80968c4abb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:33.971528 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-1f5218ff-7fdf-4692-9e7a-80968c4abb03 None None] MFA Rules not processed for user `871f208a13ba435491022b9ea9b735e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:19:33.972747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-1f5218ff-7fdf-4692-9e7a-80968c4abb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:34.054106 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 700/1392] 10.222.0.77 () {58 vars in 1058 bytes} [Tue Sep 6 20:19:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:19:34.063210 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf41c7-cdc2-4568-b5ef-6fe3c64f4d25 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:19:34.064785 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-32cf41c7-cdc2-4568-b5ef-6fe3c64f4d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:34.189796 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf41c7-cdc2-4568-b5ef-6fe3c64f4d25 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:19:34.272704 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f411d-d69b-4c29-a5dc-bc16ee096a36 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '871f208a13ba435491022b9ea9b735e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:19:34.273318 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f411d-d69b-4c29-a5dc-bc16ee096a36 service glance] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:34.273597 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f411d-d69b-4c29-a5dc-bc16ee096a36 service glance] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:34.273868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f411d-d69b-4c29-a5dc-bc16ee096a36 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:34.275849 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f89f411d-d69b-4c29-a5dc-bc16ee096a36 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:34.286860 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:34.395577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f411d-d69b-4c29-a5dc-bc16ee096a36 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:19:34.396875 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f411d-d69b-4c29-a5dc-bc16ee096a36 service glance] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:19:34.418320 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 693/1393] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:19:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:19:35.388036 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a37661-8b30-4a2d-8dc8-a6bccfa9e16e None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:35.388511 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a37661-8b30-4a2d-8dc8-a6bccfa9e16e None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:35.388624 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a37661-8b30-4a2d-8dc8-a6bccfa9e16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:35.461114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-88a37661-8b30-4a2d-8dc8-a6bccfa9e16e None None] MFA Rules not processed for user `c314372147b2491cb4481d538056472c`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:19:35.462927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-88a37661-8b30-4a2d-8dc8-a6bccfa9e16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:35.499592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:35.557248 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 701/1394] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Sep 6 20:19:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:19:35.605494 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e8e38-fe79-406d-b40a-bba00c24a044 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:35.606040 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e8e38-fe79-406d-b40a-bba00c24a044 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:35.606120 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e8e38-fe79-406d-b40a-bba00c24a044 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:35.607561 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 694/1395] 10.222.0.77 () {54 vars in 943 bytes} [Tue Sep 6 20:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:19:35.614435 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8d43e-dc42-41b8-9d2e-1fbf6a051807 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:35.614741 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8d43e-dc42-41b8-9d2e-1fbf6a051807 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:35.615020 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8d43e-dc42-41b8-9d2e-1fbf6a051807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:35.702866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-ada8d43e-dc42-41b8-9d2e-1fbf6a051807 None None] MFA Rules not processed for user `5a6c4f91a59548fd979e7232a2afd6ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:19:35.704048 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ada8d43e-dc42-41b8-9d2e-1fbf6a051807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:35.817849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 702/1396] 10.222.0.77 () {58 vars in 1040 bytes} [Tue Sep 6 20:19:35 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:19:35.821077 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449de66a-daf4-4148-93b7-7cae93780824 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:35.822081 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449de66a-daf4-4148-93b7-7cae93780824 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:35.822201 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449de66a-daf4-4148-93b7-7cae93780824 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:35.823531 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 695/1397] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:19:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:19:35.829121 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8d43e-dc42-41b8-9d2e-1fbf6a051807 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:19:35.829315 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0e95c-9638-40e5-ab01-2ecccc440bea None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:35.829315 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0e95c-9638-40e5-ab01-2ecccc440bea None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:35.829567 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0e95c-9638-40e5-ab01-2ecccc440bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:35.838309 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8d43e-dc42-41b8-9d2e-1fbf6a051807 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:19:35.841363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:35.899450 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-c3c0e95c-9638-40e5-ab01-2ecccc440bea None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:19:35.900785 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c3c0e95c-9638-40e5-ab01-2ecccc440bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:35.954074 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2347ec9-08ea-4853-a991-6761a003209a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6c4f91a59548fd979e7232a2afd6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:19:35.954692 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2347ec9-08ea-4853-a991-6761a003209a service swift] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:35.954692 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2347ec9-08ea-4853-a991-6761a003209a service swift] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:35.954896 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2347ec9-08ea-4853-a991-6761a003209a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:35.956578 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-d2347ec9-08ea-4853-a991-6761a003209a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:35.965411 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:36.008074 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 696/1398] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:19:36.043182 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2347ec9-08ea-4853-a991-6761a003209a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:19:36.044778 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2347ec9-08ea-4853-a991-6761a003209a service swift] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:19:36.055287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 703/1399] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Sep 6 20:19:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 20:19:36.303562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0e95c-9638-40e5-ab01-2ecccc440bea None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:19:36.304898 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c3c0e95c-9638-40e5-ab01-2ecccc440bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:36.434752 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0e95c-9638-40e5-ab01-2ecccc440bea None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:19:36.511459 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:36.552890 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056194ae-9e10-4629-8c57-eb26c60403b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:19:36.553424 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056194ae-9e10-4629-8c57-eb26c60403b8 service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:36.553704 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056194ae-9e10-4629-8c57-eb26c60403b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:36.553973 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056194ae-9e10-4629-8c57-eb26c60403b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:36.555657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-056194ae-9e10-4629-8c57-eb26c60403b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:36.775920 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056194ae-9e10-4629-8c57-eb26c60403b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:19:36.777537 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056194ae-9e10-4629-8c57-eb26c60403b8 service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:19:36.799125 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 697/1400] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:19:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:19:39.248732 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0e0c0-1490-4a37-889b-9e8c7f4a770b None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:39.249331 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0e0c0-1490-4a37-889b-9e8c7f4a770b None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:39.249331 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0e0c0-1490-4a37-889b-9e8c7f4a770b None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:39.250709 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 704/1401] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:19:39.256012 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785b306-6272-4529-a078-5d0ef8a62bf3 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:39.256485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785b306-6272-4529-a078-5d0ef8a62bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:39.256788 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785b306-6272-4529-a078-5d0ef8a62bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:39.329785 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-8785b306-6272-4529-a078-5d0ef8a62bf3 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:19:39.329785 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-8785b306-6272-4529-a078-5d0ef8a62bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:39.371373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:39.450951 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 698/1402] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:19:39.744683 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0e0c0-1490-4a37-889b-9e8c7f4a770b None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:19:39.746220 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-c7f0e0c0-1490-4a37-889b-9e8c7f4a770b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:39.791893 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:39.944989 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f0e0c0-1490-4a37-889b-9e8c7f4a770b None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:19:40.125255 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:40.131572 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c19ce-21d1-41c3-90a6-405687015254 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:19:40.132210 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c19ce-21d1-41c3-90a6-405687015254 service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:40.132488 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c19ce-21d1-41c3-90a6-405687015254 service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:40.132759 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c19ce-21d1-41c3-90a6-405687015254 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:40.134970 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-6e7c19ce-21d1-41c3-90a6-405687015254 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:40.241298 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c19ce-21d1-41c3-90a6-405687015254 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:19:40.243112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c19ce-21d1-41c3-90a6-405687015254 service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:19:40.264942 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 705/1403] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:19:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:19:42.784248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e71122-aabe-4a15-afcb-ac7a155e4256 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:42.784816 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e71122-aabe-4a15-afcb-ac7a155e4256 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:42.784816 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e71122-aabe-4a15-afcb-ac7a155e4256 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:42.786136 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 699/1404] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:19:42.791798 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a5e7c-3b8a-4df0-8214-3fbf0b37507d None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:42.792267 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a5e7c-3b8a-4df0-8214-3fbf0b37507d None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:42.792358 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a5e7c-3b8a-4df0-8214-3fbf0b37507d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:42.868355 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-f32a5e7c-3b8a-4df0-8214-3fbf0b37507d None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:19:42.869677 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-f32a5e7c-3b8a-4df0-8214-3fbf0b37507d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:43.066361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:43.106363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 706/1405] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:19:43.408632 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e71122-aabe-4a15-afcb-ac7a155e4256 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:19:43.410153 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f4e71122-aabe-4a15-afcb-ac7a155e4256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:43.593394 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e71122-aabe-4a15-afcb-ac7a155e4256 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:19:43.655967 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:43.801371 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6b3ab-d69a-42f7-8cd0-ba897ae0c2da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:19:43.802153 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6b3ab-d69a-42f7-8cd0-ba897ae0c2da service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:43.802263 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6b3ab-d69a-42f7-8cd0-ba897ae0c2da service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:43.802509 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6b3ab-d69a-42f7-8cd0-ba897ae0c2da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:43.804258 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-46a6b3ab-d69a-42f7-8cd0-ba897ae0c2da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:43.906836 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6b3ab-d69a-42f7-8cd0-ba897ae0c2da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:19:43.908374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6b3ab-d69a-42f7-8cd0-ba897ae0c2da service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:19:43.927477 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 700/1406] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:19:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:19:47.272087 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ed99d-1da6-4c6b-ad31-fcd73a195911 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:47.272616 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ed99d-1da6-4c6b-ad31-fcd73a195911 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:47.272616 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ed99d-1da6-4c6b-ad31-fcd73a195911 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:47.275489 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 707/1407] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:19:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:19:47.280523 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36086141-3ccf-4955-9095-0358f5a8a221 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:47.281345 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36086141-3ccf-4955-9095-0358f5a8a221 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:47.281345 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36086141-3ccf-4955-9095-0358f5a8a221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:47.315662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:47.357807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-36086141-3ccf-4955-9095-0358f5a8a221 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:19:47.359071 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-36086141-3ccf-4955-9095-0358f5a8a221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:47.470249 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 701/1408] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:19:47.770746 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ed99d-1da6-4c6b-ad31-fcd73a195911 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:19:47.773612 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-b47ed99d-1da6-4c6b-ad31-fcd73a195911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:47.940392 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ed99d-1da6-4c6b-ad31-fcd73a195911 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:19:48.000905 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:48.069124 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d480c-ad94-4229-bc8e-51a7ac45c23d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:19:48.069731 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d480c-ad94-4229-bc8e-51a7ac45c23d service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:19:48.070011 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d480c-ad94-4229-bc8e-51a7ac45c23d service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:19:48.070281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d480c-ad94-4229-bc8e-51a7ac45c23d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:19:48.071928 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-5b7d480c-ad94-4229-bc8e-51a7ac45c23d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:19:48.178734 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d480c-ad94-4229-bc8e-51a7ac45c23d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:19:48.181803 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d480c-ad94-4229-bc8e-51a7ac45c23d service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:19:48.202204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 708/1409] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:19:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:19:57.468527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=54 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:19:58.199629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=74 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:01.196538 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdadbbc-0cf9-4e81-8cf4-c51b2e5c5393 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:01.197100 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdadbbc-0cf9-4e81-8cf4-c51b2e5c5393 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:01.197100 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdadbbc-0cf9-4e81-8cf4-c51b2e5c5393 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:01.198392 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 702/1410] 10.222.0.77 () {54 vars in 918 bytes} [Tue Sep 6 20:20:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:20:01.203824 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cce82-1c50-40a5-971c-b994896541e3 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:01.204416 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cce82-1c50-40a5-971c-b994896541e3 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:01.204416 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cce82-1c50-40a5-971c-b994896541e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:01.282445 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-327cce82-1c50-40a5-971c-b994896541e3 None None] MFA Rules not processed for user `2a486663ec144db0bbde6bf3deb35a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:20:01.283690 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-327cce82-1c50-40a5-971c-b994896541e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:01.390595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 709/1411] 10.222.0.77 () {58 vars in 1015 bytes} [Tue Sep 6 20:20:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:20:01.412062 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e33dad-92c6-401a-8df1-711e15f862f3 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:01.412436 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e33dad-92c6-401a-8df1-711e15f862f3 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:01.412667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e33dad-92c6-401a-8df1-711e15f862f3 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:01.413938 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 703/1412] 10.222.0.77 () {54 vars in 918 bytes} [Tue Sep 6 20:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:20:01.419560 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f698efc-4e92-41c3-a367-f117d5174f44 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:01.419880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f698efc-4e92-41c3-a367-f117d5174f44 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:01.420165 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f698efc-4e92-41c3-a367-f117d5174f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:01.496475 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:01.499415 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-5f698efc-4e92-41c3-a367-f117d5174f44 None None] MFA Rules not processed for user `b09ce16da49b4af38491ad4eb6287d70`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:20:01.500693 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-5f698efc-4e92-41c3-a367-f117d5174f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:01.620887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 710/1413] 10.222.0.77 () {58 vars in 1015 bytes} [Tue Sep 6 20:20:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:20:04.304423 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be442ed-7211-4ae5-a60e-4c50f17f25e4 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:04.305322 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be442ed-7211-4ae5-a60e-4c50f17f25e4 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:04.305564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be442ed-7211-4ae5-a60e-4c50f17f25e4 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:04.306985 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 20:20:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:20:04.312776 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7b206-0740-4fca-bb3d-674e920a2a19 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:04.313224 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7b206-0740-4fca-bb3d-674e920a2a19 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:04.313402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7b206-0740-4fca-bb3d-674e920a2a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:04.400344 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-18d7b206-0740-4fca-bb3d-674e920a2a19 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:20:04.401623 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-18d7b206-0740-4fca-bb3d-674e920a2a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:04.462267 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:04.505934 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 20:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:20:04.799893 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be442ed-7211-4ae5-a60e-4c50f17f25e4 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:20:04.801459 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-9be442ed-7211-4ae5-a60e-4c50f17f25e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:04.952476 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be442ed-7211-4ae5-a60e-4c50f17f25e4 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:20:05.027577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:05.066821 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b09867-c876-4d33-8f6f-53e1093d61c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:20:05.067423 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b09867-c876-4d33-8f6f-53e1093d61c4 service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:05.067724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b09867-c876-4d33-8f6f-53e1093d61c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:05.067988 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b09867-c876-4d33-8f6f-53e1093d61c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:05.069745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-e1b09867-c876-4d33-8f6f-53e1093d61c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:05.163982 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b09867-c876-4d33-8f6f-53e1093d61c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:20:05.165605 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b09867-c876-4d33-8f6f-53e1093d61c4 service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:20:05.184133 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 705/1416] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:20:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:20:06.355533 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e3c8e-cea9-40a1-8534-7fa3d907e75d None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:06.355942 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e3c8e-cea9-40a1-8534-7fa3d907e75d None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:06.356086 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e3c8e-cea9-40a1-8534-7fa3d907e75d None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:06.357461 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 20:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:20:06.364662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20cecd-ec6d-48d6-91a2-2cc1bca3d06d None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:06.365148 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20cecd-ec6d-48d6-91a2-2cc1bca3d06d None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:06.365250 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20cecd-ec6d-48d6-91a2-2cc1bca3d06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:06.443887 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-6b20cecd-ec6d-48d6-91a2-2cc1bca3d06d None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:20:06.445006 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6b20cecd-ec6d-48d6-91a2-2cc1bca3d06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:06.472372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:06.542648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 20:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:20:06.694136 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e3c8e-cea9-40a1-8534-7fa3d907e75d None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:20:06.696161 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-427e3c8e-cea9-40a1-8534-7fa3d907e75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:06.843744 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e3c8e-cea9-40a1-8534-7fa3d907e75d None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:20:06.886122 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:06.958855 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83eecb-e474-42f1-951d-9caac6f98e36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:20:06.959377 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83eecb-e474-42f1-951d-9caac6f98e36 service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:06.959674 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83eecb-e474-42f1-951d-9caac6f98e36 service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:06.959934 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83eecb-e474-42f1-951d-9caac6f98e36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:06.961772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-8b83eecb-e474-42f1-951d-9caac6f98e36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:07.057382 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83eecb-e474-42f1-951d-9caac6f98e36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:20:07.058991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83eecb-e474-42f1-951d-9caac6f98e36 service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:20:07.077114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 713/1419] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:20:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:20:08.234606 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abd31d-339a-4066-ae4b-1c0dc76e938f None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:08.235157 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abd31d-339a-4066-ae4b-1c0dc76e938f None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:08.235157 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abd31d-339a-4066-ae4b-1c0dc76e938f None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:08.236445 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 20:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:20:08.243543 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012e7c5-c287-4717-bead-384ab7b7d155 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:08.244014 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012e7c5-c287-4717-bead-384ab7b7d155 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:08.244110 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012e7c5-c287-4717-bead-384ab7b7d155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:08.299509 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:08.322381 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-4012e7c5-c287-4717-bead-384ab7b7d155 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:20:08.323633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-4012e7c5-c287-4717-bead-384ab7b7d155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:08.447909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 20:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:20:08.600079 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abd31d-339a-4066-ae4b-1c0dc76e938f None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:20:08.602243 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f5abd31d-339a-4066-ae4b-1c0dc76e938f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:08.761333 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abd31d-339a-4066-ae4b-1c0dc76e938f None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:20:08.776232 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:08.881769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777cd5a-1f2c-4237-9eaa-8d825e9a5ed6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:20:08.882293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777cd5a-1f2c-4237-9eaa-8d825e9a5ed6 service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:08.882571 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777cd5a-1f2c-4237-9eaa-8d825e9a5ed6 service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:08.882858 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777cd5a-1f2c-4237-9eaa-8d825e9a5ed6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:08.884499 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-2777cd5a-1f2c-4237-9eaa-8d825e9a5ed6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:08.974910 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777cd5a-1f2c-4237-9eaa-8d825e9a5ed6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:20:08.976503 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777cd5a-1f2c-4237-9eaa-8d825e9a5ed6 service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:20:08.994374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 708/1422] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:20:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:20:10.143924 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8d8ab-df8c-4be4-bd7f-991c0e670386 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:10.144749 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8d8ab-df8c-4be4-bd7f-991c0e670386 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:10.144749 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8d8ab-df8c-4be4-bd7f-991c0e670386 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:10.145754 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 20:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:20:10.152580 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b2e24-036a-4ac5-93bd-4b5e717aec7b None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:10.153080 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b2e24-036a-4ac5-93bd-4b5e717aec7b None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:10.153195 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b2e24-036a-4ac5-93bd-4b5e717aec7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:10.173764 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:10.231222 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-002b2e24-036a-4ac5-93bd-4b5e717aec7b None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:20:10.232463 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-002b2e24-036a-4ac5-93bd-4b5e717aec7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:10.332011 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 20:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:20:10.485162 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8d8ab-df8c-4be4-bd7f-991c0e670386 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:20:10.486627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-53b8d8ab-df8c-4be4-bd7f-991c0e670386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:10.597162 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:10.633846 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8d8ab-df8c-4be4-bd7f-991c0e670386 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:20:10.753047 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1697a8-eb15-492d-96d3-6f7015833a8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:20:10.753570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1697a8-eb15-492d-96d3-6f7015833a8b service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:10.753847 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1697a8-eb15-492d-96d3-6f7015833a8b service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:10.754116 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1697a8-eb15-492d-96d3-6f7015833a8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:10.755747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-7d1697a8-eb15-492d-96d3-6f7015833a8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:10.842985 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:10.856768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1697a8-eb15-492d-96d3-6f7015833a8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:20:10.858364 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1697a8-eb15-492d-96d3-6f7015833a8b service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:20:10.876877 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 716/1425] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:20:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:20:12.014252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee657c-3ab9-4041-b18a-ac17bc96b2d7 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:12.014829 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee657c-3ab9-4041-b18a-ac17bc96b2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:12.014829 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee657c-3ab9-4041-b18a-ac17bc96b2d7 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:12.016167 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 20:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:20:12.022649 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2038234-1585-412a-91e1-6e579ebc6dcc None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:12.023139 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2038234-1585-412a-91e1-6e579ebc6dcc None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:12.023870 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2038234-1585-412a-91e1-6e579ebc6dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:12.108053 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-e2038234-1585-412a-91e1-6e579ebc6dcc None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:20:12.109136 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-e2038234-1585-412a-91e1-6e579ebc6dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:12.208388 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 20:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:20:12.361248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee657c-3ab9-4041-b18a-ac17bc96b2d7 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:20:12.362687 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-d9ee657c-3ab9-4041-b18a-ac17bc96b2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:12.454487 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:12.519970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee657c-3ab9-4041-b18a-ac17bc96b2d7 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:20:12.635673 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462e9ed-960f-4b21-bdc2-d927b32cc3d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:20:12.636191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462e9ed-960f-4b21-bdc2-d927b32cc3d4 service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:12.636467 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462e9ed-960f-4b21-bdc2-d927b32cc3d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:12.636766 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462e9ed-960f-4b21-bdc2-d927b32cc3d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:12.638378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6462e9ed-960f-4b21-bdc2-d927b32cc3d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:12.687093 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:12.733539 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462e9ed-960f-4b21-bdc2-d927b32cc3d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:20:12.735125 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462e9ed-960f-4b21-bdc2-d927b32cc3d4 service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:20:12.754744 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 711/1428] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:20:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:20:13.908386 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcba500-9efb-4e1b-9fde-8b4f8abac5c4 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:13.908957 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcba500-9efb-4e1b-9fde-8b4f8abac5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:13.908957 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcba500-9efb-4e1b-9fde-8b4f8abac5c4 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:13.910335 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 20:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:20:13.917666 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158cc3c-5690-41d8-8300-56f7d5ec020e None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:13.918143 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158cc3c-5690-41d8-8300-56f7d5ec020e None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:13.918243 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158cc3c-5690-41d8-8300-56f7d5ec020e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:13.996783 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-0158cc3c-5690-41d8-8300-56f7d5ec020e None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:20:13.998016 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-0158cc3c-5690-41d8-8300-56f7d5ec020e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:14.097787 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 20:20:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:20:14.249906 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcba500-9efb-4e1b-9fde-8b4f8abac5c4 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:20:14.251581 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-6dcba500-9efb-4e1b-9fde-8b4f8abac5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:14.302741 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:14.402618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcba500-9efb-4e1b-9fde-8b4f8abac5c4 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:20:14.518099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd0ee0-5ec7-466d-8cd8-a2e28e933aae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:20:14.518713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd0ee0-5ec7-466d-8cd8-a2e28e933aae service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:14.518988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd0ee0-5ec7-466d-8cd8-a2e28e933aae service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:14.519256 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd0ee0-5ec7-466d-8cd8-a2e28e933aae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:14.521009 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-fdbd0ee0-5ec7-466d-8cd8-a2e28e933aae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:14.528746 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:14.612884 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd0ee0-5ec7-466d-8cd8-a2e28e933aae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:20:14.614526 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd0ee0-5ec7-466d-8cd8-a2e28e933aae service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:20:14.634175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 719/1431] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:20:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:20:15.786379 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c995f23-af70-47ee-90e6-15ad0a1d099e None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:15.787014 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c995f23-af70-47ee-90e6-15ad0a1d099e None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:15.787014 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c995f23-af70-47ee-90e6-15ad0a1d099e None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:15.788292 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 20:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:20:15.795350 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22816b-5ed7-49fb-b176-7f5a3ba98f83 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:15.796137 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22816b-5ed7-49fb-b176-7f5a3ba98f83 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:15.801636 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22816b-5ed7-49fb-b176-7f5a3ba98f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:15.883637 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-5f22816b-5ed7-49fb-b176-7f5a3ba98f83 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:20:15.884848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-5f22816b-5ed7-49fb-b176-7f5a3ba98f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:15.952748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:15.982478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 20:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:20:16.138991 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c995f23-af70-47ee-90e6-15ad0a1d099e None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:20:16.140464 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-9c995f23-af70-47ee-90e6-15ad0a1d099e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:16.159781 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:16.298380 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c995f23-af70-47ee-90e6-15ad0a1d099e None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:20:16.386299 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:16.417000 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568cdf1-ff85-41cf-9eca-5fcca20dda18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:20:16.417460 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568cdf1-ff85-41cf-9eca-5fcca20dda18 service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:16.417781 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568cdf1-ff85-41cf-9eca-5fcca20dda18 service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:16.418053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568cdf1-ff85-41cf-9eca-5fcca20dda18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:16.419855 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-a568cdf1-ff85-41cf-9eca-5fcca20dda18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:16.533182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568cdf1-ff85-41cf-9eca-5fcca20dda18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:20:16.534768 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568cdf1-ff85-41cf-9eca-5fcca20dda18 service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:20:16.553163 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 714/1434] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:20:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:20:17.705539 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21ac85-66ba-4424-a499-3eea97aba93e None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:17.706153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21ac85-66ba-4424-a499-3eea97aba93e None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:17.706153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21ac85-66ba-4424-a499-3eea97aba93e None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:17.707524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 20:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:20:17.714136 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f12f00-9937-42fb-9969-a39e43d806eb None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:17.714618 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f12f00-9937-42fb-9969-a39e43d806eb None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:17.714745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f12f00-9937-42fb-9969-a39e43d806eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:17.792691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-14f12f00-9937-42fb-9969-a39e43d806eb None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:20:17.793921 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-14f12f00-9937-42fb-9969-a39e43d806eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:17.854716 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:17.910642 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 20:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:20:18.061822 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21ac85-66ba-4424-a499-3eea97aba93e None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:20:18.063348 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ee21ac85-66ba-4424-a499-3eea97aba93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:18.209701 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21ac85-66ba-4424-a499-3eea97aba93e None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:20:18.265656 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:18.326491 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cd456-c7bd-4eb8-8619-2f22b4409952 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:20:18.327003 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cd456-c7bd-4eb8-8619-2f22b4409952 service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:18.327275 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cd456-c7bd-4eb8-8619-2f22b4409952 service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:18.327567 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cd456-c7bd-4eb8-8619-2f22b4409952 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:18.329162 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-dc9cd456-c7bd-4eb8-8619-2f22b4409952 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:18.422669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cd456-c7bd-4eb8-8619-2f22b4409952 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:20:18.424396 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cd456-c7bd-4eb8-8619-2f22b4409952 service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:20:18.443933 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 722/1437] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:20:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:20:19.611788 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ce182-f3ca-47e4-8637-379b5439eb9e None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:19.612345 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ce182-f3ca-47e4-8637-379b5439eb9e None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:19.612345 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ce182-f3ca-47e4-8637-379b5439eb9e None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:19.613730 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 20:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:20:19.620976 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb2467-0814-4a24-9ed8-fd255caef679 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:19.621448 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb2467-0814-4a24-9ed8-fd255caef679 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:19.621544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb2467-0814-4a24-9ed8-fd255caef679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:19.700367 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-8ebb2467-0814-4a24-9ed8-fd255caef679 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:20:19.701593 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-8ebb2467-0814-4a24-9ed8-fd255caef679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:19.703664 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:19.802867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 20:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:20:19.964252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ce182-f3ca-47e4-8637-379b5439eb9e None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:20:19.965798 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-268ce182-f3ca-47e4-8637-379b5439eb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:20.118024 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ce182-f3ca-47e4-8637-379b5439eb9e None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:20:20.145240 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:20.237904 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce7f11-bb39-49cf-87db-adeb562e5e2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:20:20.238415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce7f11-bb39-49cf-87db-adeb562e5e2c service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:20.238694 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce7f11-bb39-49cf-87db-adeb562e5e2c service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:20.238966 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce7f11-bb39-49cf-87db-adeb562e5e2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:20.240635 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-39ce7f11-bb39-49cf-87db-adeb562e5e2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:20.333749 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce7f11-bb39-49cf-87db-adeb562e5e2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:20:20.335343 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce7f11-bb39-49cf-87db-adeb562e5e2c service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:20:20.354517 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 717/1440] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:20:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:20:22.493651 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb79d18-4207-48dd-8613-53782c73fed7 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:22.494227 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb79d18-4207-48dd-8613-53782c73fed7 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:22.494227 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb79d18-4207-48dd-8613-53782c73fed7 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:22.495579 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 20:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:20:22.501188 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be632f38-2bf3-46d1-b6c0-dff6961b07f6 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:22.501632 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be632f38-2bf3-46d1-b6c0-dff6961b07f6 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:22.501770 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be632f38-2bf3-46d1-b6c0-dff6961b07f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:22.543588 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:22.569092 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-be632f38-2bf3-46d1-b6c0-dff6961b07f6 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:20:22.570828 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-be632f38-2bf3-46d1-b6c0-dff6961b07f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:22.667375 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 20:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:20:22.960814 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb79d18-4207-48dd-8613-53782c73fed7 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:20:22.962403 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-bdb79d18-4207-48dd-8613-53782c73fed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:23.071022 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb79d18-4207-48dd-8613-53782c73fed7 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:20:23.104288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:23.146383 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9c580-0b5b-42fa-9b28-4563d9004396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:20:23.146991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9c580-0b5b-42fa-9b28-4563d9004396 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:23.147269 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9c580-0b5b-42fa-9b28-4563d9004396 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:23.147572 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9c580-0b5b-42fa-9b28-4563d9004396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:23.149264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-41d9c580-0b5b-42fa-9b28-4563d9004396 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:23.260919 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9c580-0b5b-42fa-9b28-4563d9004396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:20:23.262402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9c580-0b5b-42fa-9b28-4563d9004396 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:20:23.280943 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 725/1443] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:20:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:20:25.682652 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ed2a3-202d-4712-895f-e9e007f2ed20 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:25.683262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ed2a3-202d-4712-895f-e9e007f2ed20 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:25.683262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ed2a3-202d-4712-895f-e9e007f2ed20 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:25.684583 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 20:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:20:25.690212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5caf8-a5f5-47ab-9faf-025a85bbe13a None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:25.690636 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5caf8-a5f5-47ab-9faf-025a85bbe13a None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:25.690764 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5caf8-a5f5-47ab-9faf-025a85bbe13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:25.758920 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-f5b5caf8-a5f5-47ab-9faf-025a85bbe13a None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:20:25.760230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-f5b5caf8-a5f5-47ab-9faf-025a85bbe13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:25.774951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:25.867388 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 20:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:20:26.157349 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ed2a3-202d-4712-895f-e9e007f2ed20 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:20:26.158929 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-515ed2a3-202d-4712-895f-e9e007f2ed20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:26.265145 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ed2a3-202d-4712-895f-e9e007f2ed20 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:20:26.278106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:26.339599 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2793496-176b-4d79-9e9f-e47229f3008f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:20:26.340232 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2793496-176b-4d79-9e9f-e47229f3008f service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:26.340506 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2793496-176b-4d79-9e9f-e47229f3008f service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:26.340773 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2793496-176b-4d79-9e9f-e47229f3008f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:26.342364 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-b2793496-176b-4d79-9e9f-e47229f3008f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:26.453758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2793496-176b-4d79-9e9f-e47229f3008f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:20:26.455204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2793496-176b-4d79-9e9f-e47229f3008f service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:20:26.475543 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 720/1446] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:20:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:20:29.091487 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5105dda-966a-49cf-9dcb-697deb8072eb None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:29.092052 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5105dda-966a-49cf-9dcb-697deb8072eb None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:29.092052 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5105dda-966a-49cf-9dcb-697deb8072eb None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:29.093276 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 20:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:20:29.098994 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de33814-5a03-46d8-8c16-2d87788af188 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:29.099429 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de33814-5a03-46d8-8c16-2d87788af188 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:29.099567 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de33814-5a03-46d8-8c16-2d87788af188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:29.155550 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:29.175874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-6de33814-5a03-46d8-8c16-2d87788af188 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:20:29.177217 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6de33814-5a03-46d8-8c16-2d87788af188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:29.283940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 20:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:20:29.570814 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5105dda-966a-49cf-9dcb-697deb8072eb None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:20:29.572620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-b5105dda-966a-49cf-9dcb-697deb8072eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:29.696531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5105dda-966a-49cf-9dcb-697deb8072eb None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:20:29.740875 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:29.779008 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23319784-697c-4a2b-9637-fe078f5cdb46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:20:29.779732 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23319784-697c-4a2b-9637-fe078f5cdb46 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:29.780057 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23319784-697c-4a2b-9637-fe078f5cdb46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:29.780382 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23319784-697c-4a2b-9637-fe078f5cdb46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:29.783136 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-23319784-697c-4a2b-9637-fe078f5cdb46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:29.910364 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23319784-697c-4a2b-9637-fe078f5cdb46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:20:29.912012 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23319784-697c-4a2b-9637-fe078f5cdb46 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:20:29.933252 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 728/1449] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:20:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:20:32.385547 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348879cd-67bc-4b43-8fd8-051fd4294f8d None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:32.386473 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348879cd-67bc-4b43-8fd8-051fd4294f8d None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:32.386473 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348879cd-67bc-4b43-8fd8-051fd4294f8d None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:32.388184 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 20:20:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:20:32.394537 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3460a4b-93db-4f41-a788-4e943d9942f2 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:32.395141 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3460a4b-93db-4f41-a788-4e943d9942f2 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:32.395141 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3460a4b-93db-4f41-a788-4e943d9942f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:32.472830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-e3460a4b-93db-4f41-a788-4e943d9942f2 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:20:32.474043 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-e3460a4b-93db-4f41-a788-4e943d9942f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:32.498474 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:32.592424 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 20:20:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:20:32.882846 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348879cd-67bc-4b43-8fd8-051fd4294f8d None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:20:32.884447 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-348879cd-67bc-4b43-8fd8-051fd4294f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:33.005002 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348879cd-67bc-4b43-8fd8-051fd4294f8d None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:20:33.027688 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:33.087227 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba7489-48d5-45d8-869b-0bcafc8fe5c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:20:33.087804 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba7489-48d5-45d8-869b-0bcafc8fe5c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:33.088080 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba7489-48d5-45d8-869b-0bcafc8fe5c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:33.088346 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba7489-48d5-45d8-869b-0bcafc8fe5c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:33.090123 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-66ba7489-48d5-45d8-869b-0bcafc8fe5c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:33.226306 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba7489-48d5-45d8-869b-0bcafc8fe5c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:20:33.227827 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba7489-48d5-45d8-869b-0bcafc8fe5c8 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:20:33.250683 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 723/1452] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:20:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:20:35.609035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35b2c2-510b-4be1-86dd-601740654c35 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:35.609705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35b2c2-510b-4be1-86dd-601740654c35 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:35.609705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35b2c2-510b-4be1-86dd-601740654c35 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:35.610918 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 20:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:20:35.617408 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3a24f-2472-4e50-824f-9c6f694bdb60 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:35.617917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3a24f-2472-4e50-824f-9c6f694bdb60 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:35.618016 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3a24f-2472-4e50-824f-9c6f694bdb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:35.682853 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:35.685586 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-21b3a24f-2472-4e50-824f-9c6f694bdb60 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:20:35.686812 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-21b3a24f-2472-4e50-824f-9c6f694bdb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:35.786805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 20:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:20:36.084279 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35b2c2-510b-4be1-86dd-601740654c35 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:20:36.085942 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ec35b2c2-510b-4be1-86dd-601740654c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:36.196131 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35b2c2-510b-4be1-86dd-601740654c35 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:20:36.254056 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:36.281095 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc09568-eda0-4eb0-bf6c-62897c0ab14c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:20:36.281710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc09568-eda0-4eb0-bf6c-62897c0ab14c service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:36.281987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc09568-eda0-4eb0-bf6c-62897c0ab14c service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:36.282258 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc09568-eda0-4eb0-bf6c-62897c0ab14c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:36.283929 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ddc09568-eda0-4eb0-bf6c-62897c0ab14c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:36.398382 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc09568-eda0-4eb0-bf6c-62897c0ab14c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:20:36.399850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc09568-eda0-4eb0-bf6c-62897c0ab14c service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:20:36.422527 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 731/1455] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:20:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:20:38.671915 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a9959-1021-4b44-b322-2e6f0daa09f7 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:38.672432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a9959-1021-4b44-b322-2e6f0daa09f7 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:38.672432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a9959-1021-4b44-b322-2e6f0daa09f7 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:38.673710 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 20:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:20:38.679115 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7852bb-68eb-4600-80c7-8d8c2be21bf2 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:38.679613 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7852bb-68eb-4600-80c7-8d8c2be21bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:38.679723 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7852bb-68eb-4600-80c7-8d8c2be21bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:38.748994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-5c7852bb-68eb-4600-80c7-8d8c2be21bf2 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:20:38.750205 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-5c7852bb-68eb-4600-80c7-8d8c2be21bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:38.779356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:38.848971 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 20:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:20:39.134772 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a9959-1021-4b44-b322-2e6f0daa09f7 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:20:39.136350 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-497a9959-1021-4b44-b322-2e6f0daa09f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:39.241954 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a9959-1021-4b44-b322-2e6f0daa09f7 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:20:39.271303 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:39.318520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8af69-e76c-45b6-9312-8a101563970a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:20:39.319052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8af69-e76c-45b6-9312-8a101563970a service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:39.319331 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8af69-e76c-45b6-9312-8a101563970a service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:39.319632 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8af69-e76c-45b6-9312-8a101563970a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:39.321245 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-52d8af69-e76c-45b6-9312-8a101563970a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:39.433776 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8af69-e76c-45b6-9312-8a101563970a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:20:39.435212 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8af69-e76c-45b6-9312-8a101563970a service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:20:39.455282 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 726/1458] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:20:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:20:41.747074 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20356f-746e-41f3-a6cd-fb42c7b67d40 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:41.747700 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20356f-746e-41f3-a6cd-fb42c7b67d40 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:41.748036 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20356f-746e-41f3-a6cd-fb42c7b67d40 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:41.749992 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 20:20:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:20:41.755855 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ccd8a5-4d04-4758-981d-e3ff6292a8a7 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:41.756321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ccd8a5-4d04-4758-981d-e3ff6292a8a7 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:41.756426 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ccd8a5-4d04-4758-981d-e3ff6292a8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:41.832550 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-b3ccd8a5-4d04-4758-981d-e3ff6292a8a7 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:20:41.833775 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-b3ccd8a5-4d04-4758-981d-e3ff6292a8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:41.843866 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:41.952262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 20:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:20:42.269004 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20356f-746e-41f3-a6cd-fb42c7b67d40 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:20:42.270550 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-0a20356f-746e-41f3-a6cd-fb42c7b67d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:42.389806 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20356f-746e-41f3-a6cd-fb42c7b67d40 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:20:42.452734 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:42.474116 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd8e8f-9ef1-4727-9bb5-1c6dd553e213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:20:42.474728 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd8e8f-9ef1-4727-9bb5-1c6dd553e213 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:42.475008 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd8e8f-9ef1-4727-9bb5-1c6dd553e213 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:42.475281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd8e8f-9ef1-4727-9bb5-1c6dd553e213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:42.476939 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-d6fd8e8f-9ef1-4727-9bb5-1c6dd553e213 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:42.593271 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd8e8f-9ef1-4727-9bb5-1c6dd553e213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:20:42.594855 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd8e8f-9ef1-4727-9bb5-1c6dd553e213 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:20:42.614889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 734/1461] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:20:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:20:44.930713 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593dbef-a612-4e0e-b5d4-68ef154223fd None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:44.931278 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593dbef-a612-4e0e-b5d4-68ef154223fd None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:44.931278 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593dbef-a612-4e0e-b5d4-68ef154223fd None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:44.933544 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 20:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:20:44.938427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2b117-7618-4288-a5ba-89ecc7bd8b39 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:44.938953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2b117-7618-4288-a5ba-89ecc7bd8b39 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:44.939054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2b117-7618-4288-a5ba-89ecc7bd8b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:45.008407 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-45e2b117-7618-4288-a5ba-89ecc7bd8b39 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:20:45.010158 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-45e2b117-7618-4288-a5ba-89ecc7bd8b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:45.049956 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:45.113111 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 20:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:20:45.397812 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593dbef-a612-4e0e-b5d4-68ef154223fd None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:20:45.399404 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-3593dbef-a612-4e0e-b5d4-68ef154223fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:45.504812 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593dbef-a612-4e0e-b5d4-68ef154223fd None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:20:45.543003 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:45.581651 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779747b9-dbde-449c-bf66-5ce6bf8c472e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:20:45.582252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779747b9-dbde-449c-bf66-5ce6bf8c472e service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:45.582532 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779747b9-dbde-449c-bf66-5ce6bf8c472e service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:45.582803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779747b9-dbde-449c-bf66-5ce6bf8c472e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:45.584468 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-779747b9-dbde-449c-bf66-5ce6bf8c472e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:45.694617 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779747b9-dbde-449c-bf66-5ce6bf8c472e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:20:45.695996 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779747b9-dbde-449c-bf66-5ce6bf8c472e service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:20:45.714937 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 729/1464] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:20:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:20:48.077264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd8d0b-c134-4d01-91f5-41d6779f1c00 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:48.077809 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd8d0b-c134-4d01-91f5-41d6779f1c00 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:48.077809 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd8d0b-c134-4d01-91f5-41d6779f1c00 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:48.079101 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 20:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:20:48.084860 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f033907-faae-430f-99c5-8a45cc0c9488 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:48.085480 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f033907-faae-430f-99c5-8a45cc0c9488 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:48.085480 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f033907-faae-430f-99c5-8a45cc0c9488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:48.154910 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-7f033907-faae-430f-99c5-8a45cc0c9488 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:20:48.156166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-7f033907-faae-430f-99c5-8a45cc0c9488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:48.174128 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:48.263010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 20:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:20:48.548497 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd8d0b-c134-4d01-91f5-41d6779f1c00 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:20:48.550060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-c8dd8d0b-c134-4d01-91f5-41d6779f1c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:48.660187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd8d0b-c134-4d01-91f5-41d6779f1c00 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:20:48.730023 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:48.737007 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d2e6d-5c44-4547-9e17-208b9c5a4cdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:20:48.742853 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d2e6d-5c44-4547-9e17-208b9c5a4cdb service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:48.742853 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d2e6d-5c44-4547-9e17-208b9c5a4cdb service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:48.742853 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d2e6d-5c44-4547-9e17-208b9c5a4cdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:48.742853 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-330d2e6d-5c44-4547-9e17-208b9c5a4cdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:48.854036 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d2e6d-5c44-4547-9e17-208b9c5a4cdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:20:48.855490 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d2e6d-5c44-4547-9e17-208b9c5a4cdb service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:20:48.874654 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 737/1467] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:20:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:20:51.135159 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6729e9b-c583-4ba0-af9a-54e04544a51b None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:51.135769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6729e9b-c583-4ba0-af9a-54e04544a51b None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:51.135769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6729e9b-c583-4ba0-af9a-54e04544a51b None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:51.137133 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 20:20:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:20:51.144886 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e65239-9251-4343-afde-c014502d7948 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:51.145398 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e65239-9251-4343-afde-c014502d7948 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:51.145512 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e65239-9251-4343-afde-c014502d7948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:51.218138 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-01e65239-9251-4343-afde-c014502d7948 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:20:51.219370 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-01e65239-9251-4343-afde-c014502d7948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:51.276354 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:51.327155 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 20:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:20:51.611195 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6729e9b-c583-4ba0-af9a-54e04544a51b None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:20:51.612780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f6729e9b-c583-4ba0-af9a-54e04544a51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:51.718444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6729e9b-c583-4ba0-af9a-54e04544a51b None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:20:51.770433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:20:51.797877 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059abef-b3d7-41b5-a057-8a4d7b49d867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:20:51.798486 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059abef-b3d7-41b5-a057-8a4d7b49d867 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:20:51.798766 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059abef-b3d7-41b5-a057-8a4d7b49d867 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:20:51.799035 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059abef-b3d7-41b5-a057-8a4d7b49d867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:20:51.800667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-5059abef-b3d7-41b5-a057-8a4d7b49d867 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:20:51.913762 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059abef-b3d7-41b5-a057-8a4d7b49d867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:20:51.915647 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059abef-b3d7-41b5-a057-8a4d7b49d867 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:20:51.934643 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 732/1470] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:20:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:21:01.328211 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=22 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:01.932355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=66 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:12.232749 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536ecce-10c2-4b5f-8ef7-a6d4aeb9e314 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:21:12.233294 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536ecce-10c2-4b5f-8ef7-a6d4aeb9e314 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:21:12.233294 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536ecce-10c2-4b5f-8ef7-a6d4aeb9e314 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:21:12.234614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 739/1471] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:21:12.239949 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452bccd-3670-4833-96eb-c7f975704d7b None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:21:12.240419 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452bccd-3670-4833-96eb-c7f975704d7b None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:21:12.240525 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452bccd-3670-4833-96eb-c7f975704d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:21:12.326502 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-5452bccd-3670-4833-96eb-c7f975704d7b None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:21:12.327758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-5452bccd-3670-4833-96eb-c7f975704d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:21:12.438087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 733/1472] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:21:12.734904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74eac9d-d120-4510-b31d-b3af2e7b183d None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:21:12.735205 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74eac9d-d120-4510-b31d-b3af2e7b183d None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:21:12.735507 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74eac9d-d120-4510-b31d-b3af2e7b183d None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:21:12.736909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 740/1473] 10.222.0.77 () {54 vars in 961 bytes} [Tue Sep 6 20:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:21:12.742180 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaaa4e-e134-4c4b-8383-ec5260f22dd4 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:21:12.746593 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaaa4e-e134-4c4b-8383-ec5260f22dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:21:12.746593 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaaa4e-e134-4c4b-8383-ec5260f22dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:21:12.821051 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-54aaaa4e-e134-4c4b-8383-ec5260f22dd4 None None] MFA Rules not processed for user `871f208a13ba435491022b9ea9b735e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:21:12.822292 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-54aaaa4e-e134-4c4b-8383-ec5260f22dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:21:12.844073 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:12.901120 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 734/1474] 10.222.0.77 () {58 vars in 1058 bytes} [Tue Sep 6 20:21:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:21:12.909180 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74eac9d-d120-4510-b31d-b3af2e7b183d None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:21:12.910680 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-a74eac9d-d120-4510-b31d-b3af2e7b183d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:21:13.034188 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74eac9d-d120-4510-b31d-b3af2e7b183d None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:21:13.111390 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f7fec-2549-4bd9-b8ad-8d4e68d0cc19 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '871f208a13ba435491022b9ea9b735e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:21:13.112023 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f7fec-2549-4bd9-b8ad-8d4e68d0cc19 service glance] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:21:13.112297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f7fec-2549-4bd9-b8ad-8d4e68d0cc19 service glance] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:21:13.112559 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f7fec-2549-4bd9-b8ad-8d4e68d0cc19 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:21:13.114241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-b15f7fec-2549-4bd9-b8ad-8d4e68d0cc19 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:21:13.170071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:13.226169 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f7fec-2549-4bd9-b8ad-8d4e68d0cc19 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:21:13.227764 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f7fec-2549-4bd9-b8ad-8d4e68d0cc19 service glance] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:21:13.247006 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 741/1475] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:21:15.527688 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb94acd-c07e-4fc6-8f7f-184bdf293a33 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:21:15.528265 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb94acd-c07e-4fc6-8f7f-184bdf293a33 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:21:15.528265 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb94acd-c07e-4fc6-8f7f-184bdf293a33 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:21:15.529595 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 735/1476] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:21:15.535214 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfadb0-302a-40d6-bb72-b0a5fe69b38f None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:21:15.535730 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfadb0-302a-40d6-bb72-b0a5fe69b38f None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:21:15.535840 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfadb0-302a-40d6-bb72-b0a5fe69b38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:21:15.602612 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-3cbfadb0-302a-40d6-bb72-b0a5fe69b38f None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:21:15.603928 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-3cbfadb0-302a-40d6-bb72-b0a5fe69b38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:21:15.704348 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 742/1477] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:21:15.979156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb94acd-c07e-4fc6-8f7f-184bdf293a33 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:21:15.980759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-beb94acd-c07e-4fc6-8f7f-184bdf293a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:21:16.114607 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb94acd-c07e-4fc6-8f7f-184bdf293a33 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:21:16.163515 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:16.208834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b71ec-e2ac-4f2b-8ed9-3f7e1387ecd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:21:16.209444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b71ec-e2ac-4f2b-8ed9-3f7e1387ecd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:21:16.209721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b71ec-e2ac-4f2b-8ed9-3f7e1387ecd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:21:16.209991 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b71ec-e2ac-4f2b-8ed9-3f7e1387ecd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:21:16.210649 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b71ec-e2ac-4f2b-8ed9-3f7e1387ecd2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:21:16.212956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: WARNING py.warnings [None req-a52b71ec-e2ac-4f2b-8ed9-3f7e1387ecd2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 20:21:16.212956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: warnings.warn(msg) Sep 06 20:21:16.212956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: Sep 06 20:21:16.214090 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b71ec-e2ac-4f2b-8ed9-3f7e1387ecd2 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:21:16.234548 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 736/1478] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Sep 6 20:21:15 2022] GET /identity/v3/projects => generated 2553 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:21:18.478447 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3fd5e-64e4-4cc0-af2b-936d177d6d34 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:21:18.479191 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3fd5e-64e4-4cc0-af2b-936d177d6d34 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:21:18.479191 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3fd5e-64e4-4cc0-af2b-936d177d6d34 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:21:18.480402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 743/1479] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:21:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:21:18.486180 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175f72e-eba1-4b77-a938-32163cb62142 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:21:18.486776 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175f72e-eba1-4b77-a938-32163cb62142 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:21:18.486938 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175f72e-eba1-4b77-a938-32163cb62142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:21:18.553503 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-9175f72e-eba1-4b77-a938-32163cb62142 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:21:18.554825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-9175f72e-eba1-4b77-a938-32163cb62142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:21:18.664824 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 737/1480] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:21:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:21:18.956286 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3fd5e-64e4-4cc0-af2b-936d177d6d34 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:21:18.958181 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-02c3fd5e-64e4-4cc0-af2b-936d177d6d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:21:18.968978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:19.123388 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3fd5e-64e4-4cc0-af2b-936d177d6d34 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:21:19.207254 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:19.242675 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef3148-9477-44b0-b4c3-ded95c81788e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:21:19.243284 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef3148-9477-44b0-b4c3-ded95c81788e service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:21:19.243596 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef3148-9477-44b0-b4c3-ded95c81788e service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:21:19.243867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef3148-9477-44b0-b4c3-ded95c81788e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:21:19.245476 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-f1ef3148-9477-44b0-b4c3-ded95c81788e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:21:19.342190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef3148-9477-44b0-b4c3-ded95c81788e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:21:19.343862 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef3148-9477-44b0-b4c3-ded95c81788e service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:21:19.366690 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 744/1481] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:21:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:21:21.743060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d33d60-4a19-478e-84b0-5a8417cfa44e None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:21:21.743655 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d33d60-4a19-478e-84b0-5a8417cfa44e None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:21:21.743655 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d33d60-4a19-478e-84b0-5a8417cfa44e None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:21:21.744980 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 738/1482] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:21:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:21:21.750873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ccfaa-cb24-43a4-ae66-63d2f744a915 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:21:21.751373 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ccfaa-cb24-43a4-ae66-63d2f744a915 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:21:21.751518 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ccfaa-cb24-43a4-ae66-63d2f744a915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:21:21.822484 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-cb5ccfaa-cb24-43a4-ae66-63d2f744a915 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:21:21.823709 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-cb5ccfaa-cb24-43a4-ae66-63d2f744a915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:21:21.875013 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:21.926291 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 745/1483] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:21:22.217989 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d33d60-4a19-478e-84b0-5a8417cfa44e None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:21:22.219555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-24d33d60-4a19-478e-84b0-5a8417cfa44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:21:22.244417 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:22.326645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d33d60-4a19-478e-84b0-5a8417cfa44e None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:21:22.403930 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14119edd-8fb9-491e-a9ab-132b9a062b93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:21:22.404572 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14119edd-8fb9-491e-a9ab-132b9a062b93 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:21:22.404849 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14119edd-8fb9-491e-a9ab-132b9a062b93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:21:22.405120 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14119edd-8fb9-491e-a9ab-132b9a062b93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:21:22.406769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-14119edd-8fb9-491e-a9ab-132b9a062b93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:21:22.486136 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:22.531045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14119edd-8fb9-491e-a9ab-132b9a062b93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:21:22.532494 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14119edd-8fb9-491e-a9ab-132b9a062b93 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:21:22.551370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 739/1484] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:21:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:21:24.796314 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab484ac-93e0-46f9-90a7-65114ebfc756 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:21:24.796864 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab484ac-93e0-46f9-90a7-65114ebfc756 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:21:24.796864 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab484ac-93e0-46f9-90a7-65114ebfc756 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:21:24.798207 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 746/1485] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:21:24.803820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8063a-771f-4d1a-9c67-336c90b22ffa None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:21:24.804314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8063a-771f-4d1a-9c67-336c90b22ffa None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:21:24.804905 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8063a-771f-4d1a-9c67-336c90b22ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:21:24.875465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-64f8063a-771f-4d1a-9c67-336c90b22ffa None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:21:24.876716 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-64f8063a-771f-4d1a-9c67-336c90b22ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:21:24.972831 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 740/1486] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:21:25.267037 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab484ac-93e0-46f9-90a7-65114ebfc756 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:21:25.268612 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-0ab484ac-93e0-46f9-90a7-65114ebfc756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:21:25.377599 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab484ac-93e0-46f9-90a7-65114ebfc756 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:21:25.457730 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:25.459568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee60b73-026d-455c-9dc4-1950c69b6d5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:21:25.460183 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee60b73-026d-455c-9dc4-1950c69b6d5a service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:21:25.461122 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee60b73-026d-455c-9dc4-1950c69b6d5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:21:25.461402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee60b73-026d-455c-9dc4-1950c69b6d5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:21:25.463011 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-dee60b73-026d-455c-9dc4-1950c69b6d5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:21:25.578566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee60b73-026d-455c-9dc4-1950c69b6d5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:21:25.580077 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee60b73-026d-455c-9dc4-1950c69b6d5a service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:21:25.599156 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 747/1487] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:21:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:21:28.102053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291a155-52e1-420d-bbbc-1999fb8114b9 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:21:28.102623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291a155-52e1-420d-bbbc-1999fb8114b9 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:21:28.102623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291a155-52e1-420d-bbbc-1999fb8114b9 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:21:28.103948 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 741/1488] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:21:28.109728 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99859b-a7f4-4061-95e5-10bd98b8df0d None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:21:28.110355 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99859b-a7f4-4061-95e5-10bd98b8df0d None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:21:28.110355 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99859b-a7f4-4061-95e5-10bd98b8df0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:21:28.181788 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-bd99859b-a7f4-4061-95e5-10bd98b8df0d None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:21:28.183020 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-bd99859b-a7f4-4061-95e5-10bd98b8df0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:21:28.238364 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:28.284924 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 748/1489] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:21:28.587821 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291a155-52e1-420d-bbbc-1999fb8114b9 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:21:28.589431 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-8291a155-52e1-420d-bbbc-1999fb8114b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:21:28.627666 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:28.711206 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291a155-52e1-420d-bbbc-1999fb8114b9 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:21:28.787175 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc7cf1-5978-4101-986f-3a3bf0fb425a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:21:28.788094 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc7cf1-5978-4101-986f-3a3bf0fb425a service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:21:28.788521 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc7cf1-5978-4101-986f-3a3bf0fb425a service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:21:28.788904 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc7cf1-5978-4101-986f-3a3bf0fb425a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:21:28.790793 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c0fc7cf1-5978-4101-986f-3a3bf0fb425a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:21:28.883191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:28.914722 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc7cf1-5978-4101-986f-3a3bf0fb425a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:21:28.916186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc7cf1-5978-4101-986f-3a3bf0fb425a service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:21:28.935820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 742/1490] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:21:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:21:31.639172 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2c9f6-3eeb-4571-bd9d-32b96504fcca None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:21:31.639744 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2c9f6-3eeb-4571-bd9d-32b96504fcca None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:21:31.639744 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2c9f6-3eeb-4571-bd9d-32b96504fcca None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:21:31.641138 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 749/1491] 10.222.0.77 () {54 vars in 927 bytes} [Tue Sep 6 20:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:21:31.646625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1713f-4fc9-4176-b535-962eeb2df547 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:21:31.647122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1713f-4fc9-4176-b535-962eeb2df547 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:21:31.647399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1713f-4fc9-4176-b535-962eeb2df547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:21:31.714436 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-72b1713f-4fc9-4176-b535-962eeb2df547 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:21:31.715697 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-72b1713f-4fc9-4176-b535-962eeb2df547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:21:31.814974 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 743/1492] 10.222.0.77 () {58 vars in 1024 bytes} [Tue Sep 6 20:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:21:32.110806 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2c9f6-3eeb-4571-bd9d-32b96504fcca None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:21:32.112526 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-07e2c9f6-3eeb-4571-bd9d-32b96504fcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:21:32.219873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2c9f6-3eeb-4571-bd9d-32b96504fcca None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:21:32.295723 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d027bde-780c-4194-9785-aa54aaf20446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:21:32.296330 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d027bde-780c-4194-9785-aa54aaf20446 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:21:32.296609 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d027bde-780c-4194-9785-aa54aaf20446 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:21:32.296884 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d027bde-780c-4194-9785-aa54aaf20446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:21:32.298557 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-5d027bde-780c-4194-9785-aa54aaf20446 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:21:32.308570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:32.414074 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d027bde-780c-4194-9785-aa54aaf20446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:21:32.415544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d027bde-780c-4194-9785-aa54aaf20446 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:21:32.434522 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 750/1493] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:21:41.813284 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=82 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:21:42.432298 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=50 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:22:58.642027 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50e025-9bb6-48d4-bec0-b8d70d18877a None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:22:58.642643 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50e025-9bb6-48d4-bec0-b8d70d18877a None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:22:58.642643 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50e025-9bb6-48d4-bec0-b8d70d18877a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:22:58.726249 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-1e50e025-9bb6-48d4-bec0-b8d70d18877a None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:22:58.727528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-1e50e025-9bb6-48d4-bec0-b8d70d18877a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:22:58.831606 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 744/1494] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:22:58.839792 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa144cb-e95e-4205-8518-dd283c964a23 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:22:58.840357 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa144cb-e95e-4205-8518-dd283c964a23 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:22:58.840357 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa144cb-e95e-4205-8518-dd283c964a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:22:58.924477 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-faa144cb-e95e-4205-8518-dd283c964a23 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:22:58.925555 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-faa144cb-e95e-4205-8518-dd283c964a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:22:59.032686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 751/1495] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:22:59.037834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50e025-9bb6-48d4-bec0-b8d70d18877a None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:22:59.039060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-1e50e025-9bb6-48d4-bec0-b8d70d18877a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:22:59.054172 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50e025-9bb6-48d4-bec0-b8d70d18877a None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:22:59.125251 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:22:59.161475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e97579-f5c3-4f3f-b085-b54a89888072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:22:59.162099 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e97579-f5c3-4f3f-b085-b54a89888072 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:22:59.162381 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e97579-f5c3-4f3f-b085-b54a89888072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:22:59.162654 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e97579-f5c3-4f3f-b085-b54a89888072 admin admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:22:59.163306 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e97579-f5c3-4f3f-b085-b54a89888072 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:22:59.163649 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e97579-f5c3-4f3f-b085-b54a89888072 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:22:59.164670 dv-cinder-847732-4-smb devstack@keystone.service[81847]: WARNING py.warnings [None req-72e97579-f5c3-4f3f-b085-b54a89888072 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 20:22:59.164670 dv-cinder-847732-4-smb devstack@keystone.service[81847]: warnings.warn(msg) Sep 06 20:22:59.164670 dv-cinder-847732-4-smb devstack@keystone.service[81847]: Sep 06 20:22:59.168418 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e97579-f5c3-4f3f-b085-b54a89888072 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:22:59.177995 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 745/1496] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:22:59.187095 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa144cb-e95e-4205-8518-dd283c964a23 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:22:59.196596 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa144cb-e95e-4205-8518-dd283c964a23 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:22:59.260264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:22:59.296673 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cad95a-7f6c-403f-a036-39ecce31a568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:22:59.297295 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cad95a-7f6c-403f-a036-39ecce31a568 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:22:59.297572 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cad95a-7f6c-403f-a036-39ecce31a568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:22:59.297847 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cad95a-7f6c-403f-a036-39ecce31a568 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:22:59.298496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cad95a-7f6c-403f-a036-39ecce31a568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:22:59.300280 dv-cinder-847732-4-smb devstack@keystone.service[81846]: WARNING py.warnings [None req-c9cad95a-7f6c-403f-a036-39ecce31a568 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 20:22:59.300280 dv-cinder-847732-4-smb devstack@keystone.service[81846]: warnings.warn(msg) Sep 06 20:22:59.300280 dv-cinder-847732-4-smb devstack@keystone.service[81846]: Sep 06 20:22:59.301473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cad95a-7f6c-403f-a036-39ecce31a568 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:22:59.478631 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 752/1497] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:22:59 2022] POST /identity/v3/projects => generated 379 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:22:59.483433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e97579-f5c3-4f3f-b085-b54a89888072 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:22:59.485040 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-72e97579-f5c3-4f3f-b085-b54a89888072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:22:59.521988 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e97579-f5c3-4f3f-b085-b54a89888072 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:22:59.629145 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e1c5d-4c47-4e02-972a-111729bd1a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:22:59.629780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e1c5d-4c47-4e02-972a-111729bd1a8a admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:22:59.630074 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e1c5d-4c47-4e02-972a-111729bd1a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:22:59.630446 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e1c5d-4c47-4e02-972a-111729bd1a8a admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:22:59.631108 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e1c5d-4c47-4e02-972a-111729bd1a8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:22:59.632198 dv-cinder-847732-4-smb devstack@keystone.service[81847]: WARNING py.warnings [None req-635e1c5d-4c47-4e02-972a-111729bd1a8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 20:22:59.632198 dv-cinder-847732-4-smb devstack@keystone.service[81847]: warnings.warn(msg) Sep 06 20:22:59.632198 dv-cinder-847732-4-smb devstack@keystone.service[81847]: Sep 06 20:22:59.633434 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e1c5d-4c47-4e02-972a-111729bd1a8a admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:22:59.784644 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 746/1498] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:22:59 2022] POST /identity/v3/users => generated 290 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:22:59.789515 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cad95a-7f6c-403f-a036-39ecce31a568 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:22:59.791230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-c9cad95a-7f6c-403f-a036-39ecce31a568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:22:59.861529 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cad95a-7f6c-403f-a036-39ecce31a568 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:22:59.955215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:22:59.967125 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971c625-5dca-4222-8c86-b8d01c1ce73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:22:59.968021 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971c625-5dca-4222-8c86-b8d01c1ce73a admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:22:59.968292 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971c625-5dca-4222-8c86-b8d01c1ce73a admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:22:59.968556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971c625-5dca-4222-8c86-b8d01c1ce73a admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:22:59.969271 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971c625-5dca-4222-8c86-b8d01c1ce73a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:22:59.970423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: WARNING py.warnings [None req-6971c625-5dca-4222-8c86-b8d01c1ce73a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 20:22:59.970423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: warnings.warn(msg) Sep 06 20:22:59.970423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: Sep 06 20:22:59.971313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971c625-5dca-4222-8c86-b8d01c1ce73a admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:22:59.988420 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 753/1499] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:22:59.992720 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e1c5d-4c47-4e02-972a-111729bd1a8a admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:23:00.003049 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-635e1c5d-4c47-4e02-972a-111729bd1a8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:23:00.006114 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e1c5d-4c47-4e02-972a-111729bd1a8a admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:23:00.034237 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:23:00.115150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b227df-a29d-4ef2-b732-b477c9cc89fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:23:00.115767 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b227df-a29d-4ef2-b732-b477c9cc89fe admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:23:00.116045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b227df-a29d-4ef2-b732-b477c9cc89fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:23:00.116315 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b227df-a29d-4ef2-b732-b477c9cc89fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:23:00.116959 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b227df-a29d-4ef2-b732-b477c9cc89fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:23:00.117990 dv-cinder-847732-4-smb devstack@keystone.service[81847]: WARNING py.warnings [None req-44b227df-a29d-4ef2-b732-b477c9cc89fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 20:23:00.117990 dv-cinder-847732-4-smb devstack@keystone.service[81847]: warnings.warn(msg) Sep 06 20:23:00.117990 dv-cinder-847732-4-smb devstack@keystone.service[81847]: Sep 06 20:23:00.118998 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b227df-a29d-4ef2-b732-b477c9cc89fe admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:23:00.132843 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 747/1500] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:23:00.138246 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971c625-5dca-4222-8c86-b8d01c1ce73a admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:23:00.140069 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-6971c625-5dca-4222-8c86-b8d01c1ce73a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:23:00.178060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971c625-5dca-4222-8c86-b8d01c1ce73a admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:23:00.285773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5611c7-be80-4c40-8ed7-8ae4c1aa1bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:23:00.286442 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5611c7-be80-4c40-8ed7-8ae4c1aa1bce admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:23:00.286736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5611c7-be80-4c40-8ed7-8ae4c1aa1bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:23:00.287011 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5611c7-be80-4c40-8ed7-8ae4c1aa1bce admin admin] PATH_INFO: `/v3/projects/4fc014bc79d8420daa79300243abe4bd/users/6c30db16e56e4cd08cc36158f9e2b334/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:23:00.312967 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5611c7-be80-4c40-8ed7-8ae4c1aa1bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc014bc79d8420daa79300243abe4bd, user_id=6c30db16e56e4cd08cc36158f9e2b334, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:23:00.313924 dv-cinder-847732-4-smb devstack@keystone.service[81846]: WARNING py.warnings [None req-ca5611c7-be80-4c40-8ed7-8ae4c1aa1bce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 20:23:00.313924 dv-cinder-847732-4-smb devstack@keystone.service[81846]: warnings.warn(msg) Sep 06 20:23:00.313924 dv-cinder-847732-4-smb devstack@keystone.service[81846]: Sep 06 20:23:00.315994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5611c7-be80-4c40-8ed7-8ae4c1aa1bce admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:23:00.436123 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 754/1501] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:23:00 2022] PUT /identity/v3/projects/4fc014bc79d8420daa79300243abe4bd/users/6c30db16e56e4cd08cc36158f9e2b334/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:23:00.451251 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e896b-c879-4f0d-b53e-636b749a50ce None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:23:00.451580 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e896b-c879-4f0d-b53e-636b749a50ce None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:23:00.451871 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e896b-c879-4f0d-b53e-636b749a50ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:23:00.512940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-a34e896b-c879-4f0d-b53e-636b749a50ce None None] MFA Rules not processed for user `6c30db16e56e4cd08cc36158f9e2b334`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:23:00.514165 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-a34e896b-c879-4f0d-b53e-636b749a50ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:23:00.592738 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 748/1502] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:23:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:23:00.606821 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beea931-0d02-4039-80c1-79e510d258db None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:23:00.607108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beea931-0d02-4039-80c1-79e510d258db None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:23:00.607386 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beea931-0d02-4039-80c1-79e510d258db None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:23:00.608816 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 755/1503] 10.222.0.77 () {54 vars in 964 bytes} [Tue Sep 6 20:23:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:23:00.614030 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ad5fb-c081-43b3-be5f-dafe44170b96 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:23:00.614317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ad5fb-c081-43b3-be5f-dafe44170b96 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:23:00.614595 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ad5fb-c081-43b3-be5f-dafe44170b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:23:00.647564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:23:00.694463 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-e93ad5fb-c081-43b3-be5f-dafe44170b96 None None] MFA Rules not processed for user `c6d2bb1c23484010bcc9238f9a9203a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:23:00.695758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-e93ad5fb-c081-43b3-be5f-dafe44170b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:23:00.790795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 749/1504] 10.222.0.77 () {58 vars in 1061 bytes} [Tue Sep 6 20:23:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:23:00.799109 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beea931-0d02-4039-80c1-79e510d258db None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:23:00.801038 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-5beea931-0d02-4039-80c1-79e510d258db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:23:00.867520 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:23:00.925204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beea931-0d02-4039-80c1-79e510d258db None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:23:01.002627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febeb905-9fb5-4f67-91bc-a119dd3aae19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:23:01.003230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febeb905-9fb5-4f67-91bc-a119dd3aae19 service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:23:01.003524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febeb905-9fb5-4f67-91bc-a119dd3aae19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:23:01.003789 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febeb905-9fb5-4f67-91bc-a119dd3aae19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:23:01.005394 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-febeb905-9fb5-4f67-91bc-a119dd3aae19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:23:01.112957 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febeb905-9fb5-4f67-91bc-a119dd3aae19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:23:01.115892 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febeb905-9fb5-4f67-91bc-a119dd3aae19 service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:23:01.121112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:23:01.140512 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 756/1505] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:23:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:23:01.194388 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931adaf-ec77-439f-8232-0385d91ad026 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:23:01.194673 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931adaf-ec77-439f-8232-0385d91ad026 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:23:01.194949 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931adaf-ec77-439f-8232-0385d91ad026 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:23:01.196268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 750/1506] 10.222.0.77 () {52 vars in 830 bytes} [Tue Sep 6 20:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:23:01.201805 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febeb905-9fb5-4f67-91bc-a119dd3aae19 service cinder] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:23:01.203050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-febeb905-9fb5-4f67-91bc-a119dd3aae19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:23:01.325397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febeb905-9fb5-4f67-91bc-a119dd3aae19 service cinder] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:23:01.435689 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13616e8b-9e7d-4d76-b1f4-57e65beeae97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:23:01.436376 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13616e8b-9e7d-4d76-b1f4-57e65beeae97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:23:01.436698 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13616e8b-9e7d-4d76-b1f4-57e65beeae97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:23:01.437041 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13616e8b-9e7d-4d76-b1f4-57e65beeae97 admin admin] PATH_INFO: `/v3/users/6c30db16e56e4cd08cc36158f9e2b334` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:23:01.460179 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13616e8b-9e7d-4d76-b1f4-57e65beeae97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c30db16e56e4cd08cc36158f9e2b334)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:23:01.461372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: WARNING py.warnings [None req-13616e8b-9e7d-4d76-b1f4-57e65beeae97 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 20:23:01.461372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: warnings.warn(msg) Sep 06 20:23:01.461372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: Sep 06 20:23:01.462864 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13616e8b-9e7d-4d76-b1f4-57e65beeae97 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:23:01.475511 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:23:01.745389 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-13616e8b-9e7d-4d76-b1f4-57e65beeae97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c30db16e56e4cd08cc36158f9e2b334'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:23:01.857284 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-13616e8b-9e7d-4d76-b1f4-57e65beeae97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c30db16e56e4cd08cc36158f9e2b334'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:23:01.857822 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-13616e8b-9e7d-4d76-b1f4-57e65beeae97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c30db16e56e4cd08cc36158f9e2b334'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:23:01.858257 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-13616e8b-9e7d-4d76-b1f4-57e65beeae97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c30db16e56e4cd08cc36158f9e2b334'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:23:01.875236 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-13616e8b-9e7d-4d76-b1f4-57e65beeae97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c30db16e56e4cd08cc36158f9e2b334'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:23:01.908200 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 757/1507] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:23:01 2022] DELETE /identity/v3/users/6c30db16e56e4cd08cc36158f9e2b334 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:23:01.912693 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88b237-bad9-4c3d-b18d-414878697678 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:23:01.913311 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88b237-bad9-4c3d-b18d-414878697678 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:23:01.913311 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88b237-bad9-4c3d-b18d-414878697678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:23:01.979623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-3a88b237-bad9-4c3d-b18d-414878697678 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:23:01.981368 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-3a88b237-bad9-4c3d-b18d-414878697678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:23:02.073256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:23:02.086422 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 751/1508] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:23:02.096793 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13616e8b-9e7d-4d76-b1f4-57e65beeae97 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:23:02.098051 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-13616e8b-9e7d-4d76-b1f4-57e65beeae97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:23:02.210884 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13616e8b-9e7d-4d76-b1f4-57e65beeae97 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:23:02.280405 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:23:02.301717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348456a-b0e2-4476-b1c8-72d40c0be260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:23:02.302233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348456a-b0e2-4476-b1c8-72d40c0be260 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:23:02.302512 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348456a-b0e2-4476-b1c8-72d40c0be260 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:23:02.302783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348456a-b0e2-4476-b1c8-72d40c0be260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:23:02.304473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-3348456a-b0e2-4476-b1c8-72d40c0be260 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:23:02.436387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348456a-b0e2-4476-b1c8-72d40c0be260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:23:02.437820 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348456a-b0e2-4476-b1c8-72d40c0be260 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:23:02.461775 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 758/1509] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:23:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:23:03.024614 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88b237-bad9-4c3d-b18d-414878697678 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:23:03.025994 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-3a88b237-bad9-4c3d-b18d-414878697678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:23:03.039368 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88b237-bad9-4c3d-b18d-414878697678 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:23:03.152117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca39357-35fe-47ba-afe1-bc8d4a17c3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:23:03.152753 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca39357-35fe-47ba-afe1-bc8d4a17c3d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:23:03.153030 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca39357-35fe-47ba-afe1-bc8d4a17c3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:23:03.153303 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca39357-35fe-47ba-afe1-bc8d4a17c3d0 admin admin] PATH_INFO: `/v3/projects/4fc014bc79d8420daa79300243abe4bd` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:23:03.164099 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca39357-35fe-47ba-afe1-bc8d4a17c3d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fc014bc79d8420daa79300243abe4bd)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:23:03.165174 dv-cinder-847732-4-smb devstack@keystone.service[81847]: WARNING py.warnings [None req-4ca39357-35fe-47ba-afe1-bc8d4a17c3d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 20:23:03.165174 dv-cinder-847732-4-smb devstack@keystone.service[81847]: warnings.warn(msg) Sep 06 20:23:03.165174 dv-cinder-847732-4-smb devstack@keystone.service[81847]: Sep 06 20:23:03.166380 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca39357-35fe-47ba-afe1-bc8d4a17c3d0 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:23:03.298449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-4ca39357-35fe-47ba-afe1-bc8d4a17c3d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fc014bc79d8420daa79300243abe4bd', 'request_id': 'req-4ca39357-35fe-47ba-afe1-bc8d4a17c3d0'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:23:03.313955 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-4ca39357-35fe-47ba-afe1-bc8d4a17c3d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fc014bc79d8420daa79300243abe4bd', 'request_id': 'req-4ca39357-35fe-47ba-afe1-bc8d4a17c3d0'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:23:03.394383 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-4ca39357-35fe-47ba-afe1-bc8d4a17c3d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fc014bc79d8420daa79300243abe4bd', 'request_id': 'req-4ca39357-35fe-47ba-afe1-bc8d4a17c3d0'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:23:03.425686 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-4ca39357-35fe-47ba-afe1-bc8d4a17c3d0 admin admin] The token cache is being invalidate because project 4fc014bc79d8420daa79300243abe4bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:23:03.426031 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-4ca39357-35fe-47ba-afe1-bc8d4a17c3d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:23:03.426662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-4ca39357-35fe-47ba-afe1-bc8d4a17c3d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:23:03.427962 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 752/1510] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:23:03 2022] DELETE /identity/v3/projects/4fc014bc79d8420daa79300243abe4bd => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:23:12.457470 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=62 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:23:13.423628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:24:47.651081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe5da2-999a-414b-8600-e2caabd8c6a7 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:24:47.651863 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe5da2-999a-414b-8600-e2caabd8c6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:24:47.651863 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe5da2-999a-414b-8600-e2caabd8c6a7 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:24:47.653243 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 20:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:24:47.658405 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f443f91-f690-4d1d-b7ac-0508db601c90 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:24:47.659393 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f443f91-f690-4d1d-b7ac-0508db601c90 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:24:47.659393 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f443f91-f690-4d1d-b7ac-0508db601c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:24:47.757174 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-1f443f91-f690-4d1d-b7ac-0508db601c90 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:24:47.758516 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-1f443f91-f690-4d1d-b7ac-0508db601c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:24:47.895950 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 20:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:24:48.054610 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe5da2-999a-414b-8600-e2caabd8c6a7 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:24:48.057030 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-47fe5da2-999a-414b-8600-e2caabd8c6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:24:48.193816 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe5da2-999a-414b-8600-e2caabd8c6a7 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:24:48.199962 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e711e78-7a71-4933-adce-b81b9fe50223 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:24:48.200679 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e711e78-7a71-4933-adce-b81b9fe50223 service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:24:48.201015 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e711e78-7a71-4933-adce-b81b9fe50223 service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:24:48.201292 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e711e78-7a71-4933-adce-b81b9fe50223 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:24:48.210595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e711e78-7a71-4933-adce-b81b9fe50223 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:24:48.212248 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e711e78-7a71-4933-adce-b81b9fe50223 service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:24:48.224976 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 760/1513] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:24:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:24:49.366524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df723b-c384-4f82-816c-cae7dae7555a None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:24:49.367113 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df723b-c384-4f82-816c-cae7dae7555a None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:24:49.367113 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df723b-c384-4f82-816c-cae7dae7555a None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:24:49.368506 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 20:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:24:49.376961 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16596e-d737-45f0-91ce-f113f931c426 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:24:49.377789 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16596e-d737-45f0-91ce-f113f931c426 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:24:49.377960 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16596e-d737-45f0-91ce-f113f931c426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:24:49.399801 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-ea16596e-d737-45f0-91ce-f113f931c426 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:24:49.401173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ea16596e-d737-45f0-91ce-f113f931c426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:24:49.409543 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 20:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:24:49.578594 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df723b-c384-4f82-816c-cae7dae7555a None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:24:49.594413 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df723b-c384-4f82-816c-cae7dae7555a None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:24:49.600890 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9024515-24c5-4143-8c53-90e9b90f7de7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:24:49.601627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9024515-24c5-4143-8c53-90e9b90f7de7 service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:24:49.601998 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9024515-24c5-4143-8c53-90e9b90f7de7 service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:24:49.602370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9024515-24c5-4143-8c53-90e9b90f7de7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:24:49.615972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9024515-24c5-4143-8c53-90e9b90f7de7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:24:49.617716 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9024515-24c5-4143-8c53-90e9b90f7de7 service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:24:49.629112 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 755/1516] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:24:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:24:49.705804 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a94323-31fd-4a37-9c51-cc68ce24300e None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:24:49.706179 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a94323-31fd-4a37-9c51-cc68ce24300e None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:24:49.706645 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a94323-31fd-4a37-9c51-cc68ce24300e None None] PATH_INFO: `/v3` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:24:49.708469 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 762/1517] 10.222.0.67 () {54 vars in 925 bytes} [Tue Sep 6 20:24:49 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:24:49.717474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221f836-8cdd-413a-a026-cf387867c390 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:24:49.717756 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221f836-8cdd-413a-a026-cf387867c390 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:24:49.718203 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221f836-8cdd-413a-a026-cf387867c390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:24:49.803021 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-e221f836-8cdd-413a-a026-cf387867c390 None None] MFA Rules not processed for user `2a486663ec144db0bbde6bf3deb35a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:24:49.803574 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-e221f836-8cdd-413a-a026-cf387867c390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:24:49.825076 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:24:49.898895 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 756/1518] 10.222.0.67 () {58 vars in 1015 bytes} [Tue Sep 6 20:24:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:24:59.394265 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=56 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:24:59.894556 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=23 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:25:00.937528 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6491f-0248-4113-b239-2e9160fa6f0e None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:25:00.938096 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6491f-0248-4113-b239-2e9160fa6f0e None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:25:00.938392 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6491f-0248-4113-b239-2e9160fa6f0e None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:25:00.940009 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 763/1519] 10.222.0.77 () {54 vars in 961 bytes} [Tue Sep 6 20:25:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:25:00.947096 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5a629-e66e-47b9-b4d5-32c3a3e2da81 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:25:00.947096 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5a629-e66e-47b9-b4d5-32c3a3e2da81 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:25:00.947606 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5a629-e66e-47b9-b4d5-32c3a3e2da81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:25:00.972834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-94a5a629-e66e-47b9-b4d5-32c3a3e2da81 None None] MFA Rules not processed for user `2a486663ec144db0bbde6bf3deb35a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:25:00.974033 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-94a5a629-e66e-47b9-b4d5-32c3a3e2da81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:25:00.985714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 757/1520] 10.222.0.77 () {58 vars in 1058 bytes} [Tue Sep 6 20:25:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:25:00.993856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6491f-0248-4113-b239-2e9160fa6f0e None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:25:01.008977 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6491f-0248-4113-b239-2e9160fa6f0e None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:25:01.015477 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a5f66-38e2-43ea-aba6-a74c3d9a841e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a486663ec144db0bbde6bf3deb35a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:25:01.015477 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a5f66-38e2-43ea-aba6-a74c3d9a841e service placement] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:25:01.015813 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a5f66-38e2-43ea-aba6-a74c3d9a841e service placement] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:25:01.015968 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a5f66-38e2-43ea-aba6-a74c3d9a841e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:25:01.030736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a5f66-38e2-43ea-aba6-a74c3d9a841e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:25:01.033792 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a5f66-38e2-43ea-aba6-a74c3d9a841e service placement] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:25:01.050883 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 764/1521] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:25:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:25:01.214615 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312e57f-cf8b-47c8-b12b-ffa382c13834 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:25:01.215055 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312e57f-cf8b-47c8-b12b-ffa382c13834 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:25:01.215432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312e57f-cf8b-47c8-b12b-ffa382c13834 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:25:01.217596 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 20:25:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:25:01.224898 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50add566-e304-4401-9e95-22265963a6e4 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:25:01.225367 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50add566-e304-4401-9e95-22265963a6e4 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:25:01.225701 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50add566-e304-4401-9e95-22265963a6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:25:01.253813 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-50add566-e304-4401-9e95-22265963a6e4 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:25:01.255994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-50add566-e304-4401-9e95-22265963a6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:25:01.271705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 20:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:25:01.449710 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312e57f-cf8b-47c8-b12b-ffa382c13834 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:25:01.467091 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312e57f-cf8b-47c8-b12b-ffa382c13834 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:25:01.474924 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf8e4a-3b1e-4a7f-b839-689765b7fdca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:25:01.474924 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf8e4a-3b1e-4a7f-b839-689765b7fdca service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:25:01.474924 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf8e4a-3b1e-4a7f-b839-689765b7fdca service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:25:01.475259 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf8e4a-3b1e-4a7f-b839-689765b7fdca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:25:01.486368 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf8e4a-3b1e-4a7f-b839-689765b7fdca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:25:01.488251 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf8e4a-3b1e-4a7f-b839-689765b7fdca service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:25:01.499384 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 759/1524] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:25:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:25:02.638696 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e00ab-92a0-4725-9a4f-590556ed0ec6 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:25:02.639300 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e00ab-92a0-4725-9a4f-590556ed0ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:25:02.639300 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e00ab-92a0-4725-9a4f-590556ed0ec6 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:25:02.640628 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 20:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:25:02.647323 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e422bd-a7e9-4cc8-8892-64e55683ec24 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:25:02.647935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e422bd-a7e9-4cc8-8892-64e55683ec24 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:25:02.647935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e422bd-a7e9-4cc8-8892-64e55683ec24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:25:02.668159 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-55e422bd-a7e9-4cc8-8892-64e55683ec24 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:25:02.669388 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-55e422bd-a7e9-4cc8-8892-64e55683ec24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:25:02.677432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 20:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:25:02.840361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e00ab-92a0-4725-9a4f-590556ed0ec6 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:25:02.858267 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e00ab-92a0-4725-9a4f-590556ed0ec6 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:25:02.864237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7b0fb-0e88-4937-8f24-7029f3a54b7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:25:02.864854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7b0fb-0e88-4937-8f24-7029f3a54b7b service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:25:02.865177 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7b0fb-0e88-4937-8f24-7029f3a54b7b service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:25:02.865448 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7b0fb-0e88-4937-8f24-7029f3a54b7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:25:02.875360 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7b0fb-0e88-4937-8f24-7029f3a54b7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:25:02.877024 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7b0fb-0e88-4937-8f24-7029f3a54b7b service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:25:02.887451 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 767/1527] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:25:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:25:07.135119 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302166db-57b7-41a2-b8e7-d7181c3da410 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:25:07.135666 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302166db-57b7-41a2-b8e7-d7181c3da410 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:25:07.135666 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302166db-57b7-41a2-b8e7-d7181c3da410 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:25:07.137238 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 20:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:25:07.143129 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956ce60-94e7-4fdf-b63c-95797a1d904b None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:25:07.143779 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956ce60-94e7-4fdf-b63c-95797a1d904b None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:25:07.143779 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956ce60-94e7-4fdf-b63c-95797a1d904b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:25:07.164484 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-c956ce60-94e7-4fdf-b63c-95797a1d904b None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:25:07.165742 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-c956ce60-94e7-4fdf-b63c-95797a1d904b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:25:07.174741 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 20:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:25:07.497608 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302166db-57b7-41a2-b8e7-d7181c3da410 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:25:07.499553 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-302166db-57b7-41a2-b8e7-d7181c3da410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:25:07.606082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302166db-57b7-41a2-b8e7-d7181c3da410 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:25:07.610140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd845f9f-7116-4b1d-96f2-b4f796b60040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:25:07.610774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd845f9f-7116-4b1d-96f2-b4f796b60040 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:25:07.611053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd845f9f-7116-4b1d-96f2-b4f796b60040 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:25:07.611323 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd845f9f-7116-4b1d-96f2-b4f796b60040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:25:07.621485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd845f9f-7116-4b1d-96f2-b4f796b60040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:25:07.623128 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd845f9f-7116-4b1d-96f2-b4f796b60040 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:25:07.633989 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 762/1530] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:25:09.885255 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ba383-8107-4cb8-87f9-b4853b40684d None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:25:09.885854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ba383-8107-4cb8-87f9-b4853b40684d None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:25:09.885854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ba383-8107-4cb8-87f9-b4853b40684d None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:25:09.887463 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 20:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:25:09.892921 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa00c9-9468-44c7-b87d-607476b94496 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:25:09.893564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa00c9-9468-44c7-b87d-607476b94496 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:25:09.893564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa00c9-9468-44c7-b87d-607476b94496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:25:09.913854 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-3afa00c9-9468-44c7-b87d-607476b94496 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:25:09.915106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-3afa00c9-9468-44c7-b87d-607476b94496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:25:09.923691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 20:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:25:10.217424 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ba383-8107-4cb8-87f9-b4853b40684d None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:25:10.229021 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ba383-8107-4cb8-87f9-b4853b40684d None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:25:10.233326 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfaf0c-c723-4e9d-9028-1bd0a8161d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:25:10.233991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfaf0c-c723-4e9d-9028-1bd0a8161d14 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:25:10.234268 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfaf0c-c723-4e9d-9028-1bd0a8161d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:25:10.234567 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfaf0c-c723-4e9d-9028-1bd0a8161d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:25:10.244124 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfaf0c-c723-4e9d-9028-1bd0a8161d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:25:10.245593 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfaf0c-c723-4e9d-9028-1bd0a8161d14 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:25:10.256113 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 770/1533] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:25:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:25:14.112888 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec0c79-2764-428a-8fd9-20b7ec5fbae6 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:25:14.113709 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec0c79-2764-428a-8fd9-20b7ec5fbae6 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:25:14.113709 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec0c79-2764-428a-8fd9-20b7ec5fbae6 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:25:14.114706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 20:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:25:14.121389 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa219a0-c055-45d1-962b-589738b83bd5 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:25:14.122161 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa219a0-c055-45d1-962b-589738b83bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:25:14.122161 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa219a0-c055-45d1-962b-589738b83bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:25:14.143698 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-bfa219a0-c055-45d1-962b-589738b83bd5 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:25:14.144940 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-bfa219a0-c055-45d1-962b-589738b83bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:25:14.153375 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 20:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:25:14.465563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec0c79-2764-428a-8fd9-20b7ec5fbae6 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:25:14.467265 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-69ec0c79-2764-428a-8fd9-20b7ec5fbae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:25:14.561610 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec0c79-2764-428a-8fd9-20b7ec5fbae6 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:25:14.565287 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9a85e-ee87-4099-9796-05dfea7d1a2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:25:14.565960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9a85e-ee87-4099-9796-05dfea7d1a2e service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:25:14.566236 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9a85e-ee87-4099-9796-05dfea7d1a2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:25:14.566544 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9a85e-ee87-4099-9796-05dfea7d1a2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:25:14.577004 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9a85e-ee87-4099-9796-05dfea7d1a2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:25:14.578440 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9a85e-ee87-4099-9796-05dfea7d1a2e service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:25:14.588839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 765/1536] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:25:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:25:16.850619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58820f-5122-4868-9a0b-fd3e23881549 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:25:16.851164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58820f-5122-4868-9a0b-fd3e23881549 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:25:16.851164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58820f-5122-4868-9a0b-fd3e23881549 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:25:16.852541 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 20:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:25:16.859119 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95271a9-539b-4fcf-9fd6-88d6d1ee7763 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:25:16.859685 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95271a9-539b-4fcf-9fd6-88d6d1ee7763 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:25:16.859804 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95271a9-539b-4fcf-9fd6-88d6d1ee7763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:25:16.889405 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-f95271a9-539b-4fcf-9fd6-88d6d1ee7763 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:25:16.890641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f95271a9-539b-4fcf-9fd6-88d6d1ee7763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:25:16.898745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 20:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:25:17.253188 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58820f-5122-4868-9a0b-fd3e23881549 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:25:17.255848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-4c58820f-5122-4868-9a0b-fd3e23881549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:25:17.279248 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58820f-5122-4868-9a0b-fd3e23881549 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:25:17.285405 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c22e6-7b36-4e11-af57-9ae72a7f71dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:25:17.286454 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c22e6-7b36-4e11-af57-9ae72a7f71dd service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:25:17.286943 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c22e6-7b36-4e11-af57-9ae72a7f71dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:25:17.287468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c22e6-7b36-4e11-af57-9ae72a7f71dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:25:17.300632 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c22e6-7b36-4e11-af57-9ae72a7f71dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:25:17.303551 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c22e6-7b36-4e11-af57-9ae72a7f71dd service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:25:17.319922 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 773/1539] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:25:26.883184 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=88 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:25:27.313981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=33 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:48.777297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb33a8-fe82-455e-a903-66b60d9ac4ed None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:48.777966 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb33a8-fe82-455e-a903-66b60d9ac4ed None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:48.777966 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb33a8-fe82-455e-a903-66b60d9ac4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:48.784630 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e22502-89b7-454e-9bf4-a71c075d79b1 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:48.785657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e22502-89b7-454e-9bf4-a71c075d79b1 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:48.786151 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e22502-89b7-454e-9bf4-a71c075d79b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:48.815956 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-35e22502-89b7-454e-9bf4-a71c075d79b1 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:48.817202 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-35e22502-89b7-454e-9bf4-a71c075d79b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:48.817652 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-7bbb33a8-fe82-455e-a903-66b60d9ac4ed None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:48.821272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-7bbb33a8-fe82-455e-a903-66b60d9ac4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:48.838033 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 774/1540] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:48.839067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 767/1541] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:48.853578 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e91084-c17c-47c9-bd2d-5c28b619b947 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:48.853988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e91084-c17c-47c9-bd2d-5c28b619b947 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:48.854444 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e91084-c17c-47c9-bd2d-5c28b619b947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:48.856676 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfe108-0715-4d3d-899d-939d4c2880da None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:48.856957 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfe108-0715-4d3d-899d-939d4c2880da None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:48.857230 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfe108-0715-4d3d-899d-939d4c2880da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:48.895032 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-26e91084-c17c-47c9-bd2d-5c28b619b947 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:48.901136 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-26e91084-c17c-47c9-bd2d-5c28b619b947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:48.901286 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-fbdfe108-0715-4d3d-899d-939d4c2880da None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:48.901286 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-fbdfe108-0715-4d3d-899d-939d4c2880da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:48.914676 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 775/1542] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:48.915405 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 768/1543] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:26:48.923607 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e91084-c17c-47c9-bd2d-5c28b619b947 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:48.924637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfe108-0715-4d3d-899d-939d4c2880da None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:48.938326 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e91084-c17c-47c9-bd2d-5c28b619b947 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:48.941183 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfe108-0715-4d3d-899d-939d4c2880da None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:48.950626 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3991de-9876-4b2e-9864-1731ff4559b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:48.951263 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3991de-9876-4b2e-9864-1731ff4559b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:48.951568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3991de-9876-4b2e-9864-1731ff4559b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:48.951839 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3991de-9876-4b2e-9864-1731ff4559b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:48.952497 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3991de-9876-4b2e-9864-1731ff4559b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:26:48.952800 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3991de-9876-4b2e-9864-1731ff4559b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:48.954103 dv-cinder-847732-4-smb devstack@keystone.service[81846]: WARNING py.warnings [None req-de3991de-9876-4b2e-9864-1731ff4559b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 20:26:48.954103 dv-cinder-847732-4-smb devstack@keystone.service[81846]: warnings.warn(msg) Sep 06 20:26:48.954103 dv-cinder-847732-4-smb devstack@keystone.service[81846]: Sep 06 20:26:48.954485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32cb15-5f50-434c-9adf-7c74ad5af79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:48.955006 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3991de-9876-4b2e-9864-1731ff4559b9 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:48.955127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32cb15-5f50-434c-9adf-7c74ad5af79d admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:48.955337 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32cb15-5f50-434c-9adf-7c74ad5af79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:48.955632 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32cb15-5f50-434c-9adf-7c74ad5af79d admin admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:48.956283 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32cb15-5f50-434c-9adf-7c74ad5af79d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:26:48.956585 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32cb15-5f50-434c-9adf-7c74ad5af79d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:48.958464 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32cb15-5f50-434c-9adf-7c74ad5af79d admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:48.979590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 776/1544] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:26:48.982517 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 769/1545] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:26:48.995720 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3991de-9876-4b2e-9864-1731ff4559b9 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:48.998894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32cb15-5f50-434c-9adf-7c74ad5af79d admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:49.018039 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3991de-9876-4b2e-9864-1731ff4559b9 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:49.018404 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32cb15-5f50-434c-9adf-7c74ad5af79d admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:49.028522 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0cd9f-5f88-4095-b73f-4efe2f7de09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:49.029408 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0cd9f-5f88-4095-b73f-4efe2f7de09d admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:49.029720 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0cd9f-5f88-4095-b73f-4efe2f7de09d admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:49.030000 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0cd9f-5f88-4095-b73f-4efe2f7de09d admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:49.030668 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0cd9f-5f88-4095-b73f-4efe2f7de09d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:49.039723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1371073-f1b1-4e92-a596-16d1f20931ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:49.039989 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0cd9f-5f88-4095-b73f-4efe2f7de09d admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:49.040148 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1371073-f1b1-4e92-a596-16d1f20931ba admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:49.040148 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1371073-f1b1-4e92-a596-16d1f20931ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:49.040148 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1371073-f1b1-4e92-a596-16d1f20931ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:49.040148 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1371073-f1b1-4e92-a596-16d1f20931ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:49.040148 dv-cinder-847732-4-smb devstack@keystone.service[81847]: WARNING py.warnings [None req-a1371073-f1b1-4e92-a596-16d1f20931ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 20:26:49.040148 dv-cinder-847732-4-smb devstack@keystone.service[81847]: warnings.warn(msg) Sep 06 20:26:49.040148 dv-cinder-847732-4-smb devstack@keystone.service[81847]: Sep 06 20:26:49.040837 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1371073-f1b1-4e92-a596-16d1f20931ba admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:49.206007 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 777/1546] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:26:48 2022] POST /identity/v3/projects => generated 371 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:26:49.207597 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6175abd-3986-492d-9c73-286efffde93a None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:49.207884 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6175abd-3986-492d-9c73-286efffde93a None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:49.208179 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6175abd-3986-492d-9c73-286efffde93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:49.233783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-b6175abd-3986-492d-9c73-286efffde93a None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:49.238413 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-b6175abd-3986-492d-9c73-286efffde93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:49.272685 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 770/1547] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:26:48 2022] POST /identity/v3/projects => generated 403 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:26:49.273352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da752f-7aca-4408-a0c8-7046b9399cc8 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:49.273646 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da752f-7aca-4408-a0c8-7046b9399cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:49.274063 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da752f-7aca-4408-a0c8-7046b9399cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:49.296779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-a6da752f-7aca-4408-a0c8-7046b9399cc8 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:49.297985 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-a6da752f-7aca-4408-a0c8-7046b9399cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:49.306467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 778/1548] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:49.309549 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cc52f-06e1-4193-b12e-15224cb016e6 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:49.310124 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cc52f-06e1-4193-b12e-15224cb016e6 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:49.310788 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cc52f-06e1-4193-b12e-15224cb016e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:49.338579 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-b11cc52f-06e1-4193-b12e-15224cb016e6 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:49.339837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-b11cc52f-06e1-4193-b12e-15224cb016e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:49.366210 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 771/1549] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:49.367544 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9283b98-7fd8-4c97-aca2-52bcaa4f3cbe None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:49.368489 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9283b98-7fd8-4c97-aca2-52bcaa4f3cbe None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:49.368808 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9283b98-7fd8-4c97-aca2-52bcaa4f3cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:49.389963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-c9283b98-7fd8-4c97-aca2-52bcaa4f3cbe None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:49.391184 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c9283b98-7fd8-4c97-aca2-52bcaa4f3cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:49.399401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 772/1550] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:49.400236 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9283b98-7fd8-4c97-aca2-52bcaa4f3cbe None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:49.405957 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 779/1551] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:49.407235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4d31c-d3b7-4502-b73b-508ecef6783b None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:49.407708 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4d31c-d3b7-4502-b73b-508ecef6783b None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:49.407859 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4d31c-d3b7-4502-b73b-508ecef6783b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:49.412773 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9283b98-7fd8-4c97-aca2-52bcaa4f3cbe None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:49.418765 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d6e86-aba2-4979-ae50-dcc69e6690cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:49.419384 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d6e86-aba2-4979-ae50-dcc69e6690cd admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:49.419703 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d6e86-aba2-4979-ae50-dcc69e6690cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:49.419976 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d6e86-aba2-4979-ae50-dcc69e6690cd admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:49.420640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d6e86-aba2-4979-ae50-dcc69e6690cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:49.422565 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d6e86-aba2-4979-ae50-dcc69e6690cd admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:49.428673 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-10a4d31c-d3b7-4502-b73b-508ecef6783b None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:49.429883 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-10a4d31c-d3b7-4502-b73b-508ecef6783b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:49.438799 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 780/1552] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:49.440113 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d75b06-7a0c-49aa-95d2-19c776f328a2 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:49.440390 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d75b06-7a0c-49aa-95d2-19c776f328a2 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:49.440658 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d75b06-7a0c-49aa-95d2-19c776f328a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:49.460527 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-91d75b06-7a0c-49aa-95d2-19c776f328a2 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:49.462688 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-91d75b06-7a0c-49aa-95d2-19c776f328a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:49.470671 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 781/1553] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:49.471429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d75b06-7a0c-49aa-95d2-19c776f328a2 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:49.481650 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d75b06-7a0c-49aa-95d2-19c776f328a2 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:49.486823 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f5c1f-4d7c-4454-9684-463d68e7e912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:49.487415 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f5c1f-4d7c-4454-9684-463d68e7e912 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:49.487723 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f5c1f-4d7c-4454-9684-463d68e7e912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:49.487996 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f5c1f-4d7c-4454-9684-463d68e7e912 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:49.488617 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f5c1f-4d7c-4454-9684-463d68e7e912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:49.489630 dv-cinder-847732-4-smb devstack@keystone.service[81846]: WARNING py.warnings [None req-b41f5c1f-4d7c-4454-9684-463d68e7e912 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 20:26:49.489630 dv-cinder-847732-4-smb devstack@keystone.service[81846]: warnings.warn(msg) Sep 06 20:26:49.489630 dv-cinder-847732-4-smb devstack@keystone.service[81846]: Sep 06 20:26:49.491054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f5c1f-4d7c-4454-9684-463d68e7e912 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:49.505631 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 773/1554] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:26:49 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:26:49.506970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c9068-6b4e-49db-812e-0adedc7648de None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:49.507259 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c9068-6b4e-49db-812e-0adedc7648de None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:49.507547 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c9068-6b4e-49db-812e-0adedc7648de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:49.528866 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-cd3c9068-6b4e-49db-812e-0adedc7648de None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:49.530083 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-cd3c9068-6b4e-49db-812e-0adedc7648de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:49.538058 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 774/1555] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:49.539244 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265fb67-399b-483d-bd73-a7138042dd62 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:49.540290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265fb67-399b-483d-bd73-a7138042dd62 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:49.540540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265fb67-399b-483d-bd73-a7138042dd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:49.560236 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-1265fb67-399b-483d-bd73-a7138042dd62 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:49.561358 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-1265fb67-399b-483d-bd73-a7138042dd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:49.569358 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 775/1556] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:49.570625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fb466-f0b5-4078-9bf3-af5bb4d7ae79 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:49.570962 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fb466-f0b5-4078-9bf3-af5bb4d7ae79 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:49.571255 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fb466-f0b5-4078-9bf3-af5bb4d7ae79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:49.593369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-786fb466-f0b5-4078-9bf3-af5bb4d7ae79 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:49.609249 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-786fb466-f0b5-4078-9bf3-af5bb4d7ae79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:49.609249 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 776/1557] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:49.609249 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7095d1-c565-45e3-a36a-725f408328e1 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:49.609249 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7095d1-c565-45e3-a36a-725f408328e1 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:49.609249 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7095d1-c565-45e3-a36a-725f408328e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:49.624811 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-ab7095d1-c565-45e3-a36a-725f408328e1 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:49.626018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-ab7095d1-c565-45e3-a36a-725f408328e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:49.634207 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 777/1558] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:49.635492 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8b62b-4544-4bc7-a265-f7d7fa83e374 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:49.635783 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8b62b-4544-4bc7-a265-f7d7fa83e374 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:49.636063 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8b62b-4544-4bc7-a265-f7d7fa83e374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:49.640345 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 782/1559] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:26:49 2022] POST /identity/v3/users => generated 302 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:26:49.643101 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475cfc0-a8b7-46e6-92d7-66c18af6e8af None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:49.643101 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475cfc0-a8b7-46e6-92d7-66c18af6e8af None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:49.643101 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475cfc0-a8b7-46e6-92d7-66c18af6e8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:49.656950 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-efe8b62b-4544-4bc7-a265-f7d7fa83e374 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:49.658158 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-efe8b62b-4544-4bc7-a265-f7d7fa83e374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:49.661761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-f475cfc0-a8b7-46e6-92d7-66c18af6e8af None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:49.662930 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-f475cfc0-a8b7-46e6-92d7-66c18af6e8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:49.667312 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 778/1560] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:49.671275 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8b62b-4544-4bc7-a265-f7d7fa83e374 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:49.675732 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 783/1561] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:49.676787 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475cfc0-a8b7-46e6-92d7-66c18af6e8af None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:49.678353 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8b62b-4544-4bc7-a265-f7d7fa83e374 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:49.683668 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62694e-5ec5-410f-a138-b54a9b3ebeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:49.685197 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62694e-5ec5-410f-a138-b54a9b3ebeb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:49.685197 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62694e-5ec5-410f-a138-b54a9b3ebeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:49.685197 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62694e-5ec5-410f-a138-b54a9b3ebeb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:49.691386 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62694e-5ec5-410f-a138-b54a9b3ebeb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:49.691386 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62694e-5ec5-410f-a138-b54a9b3ebeb9 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:49.691575 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475cfc0-a8b7-46e6-92d7-66c18af6e8af None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:49.692987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fb9e0-2a07-4226-9ac7-8fd253ae176c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:49.693589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fb9e0-2a07-4226-9ac7-8fd253ae176c admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:49.693863 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fb9e0-2a07-4226-9ac7-8fd253ae176c admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:49.694129 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fb9e0-2a07-4226-9ac7-8fd253ae176c admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:49.694768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8fb9e0-2a07-4226-9ac7-8fd253ae176c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:26:49.695068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8fb9e0-2a07-4226-9ac7-8fd253ae176c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:49.696826 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8fb9e0-2a07-4226-9ac7-8fd253ae176c admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:49.698588 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 779/1562] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:26:49.698710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:49.699207 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62694e-5ec5-410f-a138-b54a9b3ebeb9 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:49.709132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62694e-5ec5-410f-a138-b54a9b3ebeb9 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:49.713849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 784/1563] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:26:49.714667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fb9e0-2a07-4226-9ac7-8fd253ae176c admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:49.716411 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32064b-1b67-4c85-b0b4-13e11c6ef2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:49.721482 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32064b-1b67-4c85-b0b4-13e11c6ef2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:49.721482 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32064b-1b67-4c85-b0b4-13e11c6ef2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:49.721482 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32064b-1b67-4c85-b0b4-13e11c6ef2a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:49.721482 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32064b-1b67-4c85-b0b4-13e11c6ef2a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:26:49.721482 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32064b-1b67-4c85-b0b4-13e11c6ef2a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:49.721482 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32064b-1b67-4c85-b0b4-13e11c6ef2a3 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:49.725502 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fb9e0-2a07-4226-9ac7-8fd253ae176c admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:49.732127 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4db647-58c5-4ff2-9950-842b415913fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:49.732754 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4db647-58c5-4ff2-9950-842b415913fe admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:49.733134 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4db647-58c5-4ff2-9950-842b415913fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:49.733419 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4db647-58c5-4ff2-9950-842b415913fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:49.733573 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 780/1564] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:26:49.737566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4db647-58c5-4ff2-9950-842b415913fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:26:49.737749 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32064b-1b67-4c85-b0b4-13e11c6ef2a3 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:49.737868 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4db647-58c5-4ff2-9950-842b415913fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:49.737868 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4db647-58c5-4ff2-9950-842b415913fe admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:49.750076 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 785/1565] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:26:49.750934 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4db647-58c5-4ff2-9950-842b415913fe admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:49.751075 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32064b-1b67-4c85-b0b4-13e11c6ef2a3 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:49.760010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb52da-2448-4190-94ae-6a36072da552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:49.761711 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb52da-2448-4190-94ae-6a36072da552 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:49.761711 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb52da-2448-4190-94ae-6a36072da552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:49.761711 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb52da-2448-4190-94ae-6a36072da552 admin admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:49.761983 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb52da-2448-4190-94ae-6a36072da552 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:26:49.762204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb52da-2448-4190-94ae-6a36072da552 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:49.763860 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb52da-2448-4190-94ae-6a36072da552 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:49.766134 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4db647-58c5-4ff2-9950-842b415913fe admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:49.770829 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccf163-4833-45e8-96f5-588e92aaf83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:49.771465 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccf163-4833-45e8-96f5-588e92aaf83b admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:49.771745 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccf163-4833-45e8-96f5-588e92aaf83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:49.772035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccf163-4833-45e8-96f5-588e92aaf83b admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:49.772659 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ccf163-4833-45e8-96f5-588e92aaf83b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:49.774845 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ccf163-4833-45e8-96f5-588e92aaf83b admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:49.777568 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 781/1566] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:26:49.778110 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb52da-2448-4190-94ae-6a36072da552 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:49.788192 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb52da-2448-4190-94ae-6a36072da552 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:49.793809 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 786/1567] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:26:49.798022 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccf163-4833-45e8-96f5-588e92aaf83b admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:49.804667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751ae61-9678-4e47-a4ec-b5a840b60d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:49.805343 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751ae61-9678-4e47-a4ec-b5a840b60d75 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:49.805620 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751ae61-9678-4e47-a4ec-b5a840b60d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:49.805892 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751ae61-9678-4e47-a4ec-b5a840b60d75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:49.806542 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751ae61-9678-4e47-a4ec-b5a840b60d75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:26:49.806845 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751ae61-9678-4e47-a4ec-b5a840b60d75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:49.808033 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccf163-4833-45e8-96f5-588e92aaf83b admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:49.808509 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751ae61-9678-4e47-a4ec-b5a840b60d75 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:49.813115 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa892dc-47b9-4eee-ae41-7d41ff3b7143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:49.813625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa892dc-47b9-4eee-ae41-7d41ff3b7143 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:49.817364 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa892dc-47b9-4eee-ae41-7d41ff3b7143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:49.817364 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa892dc-47b9-4eee-ae41-7d41ff3b7143 admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:49.817364 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa892dc-47b9-4eee-ae41-7d41ff3b7143 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:26:49.817364 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa892dc-47b9-4eee-ae41-7d41ff3b7143 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:49.817364 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa892dc-47b9-4eee-ae41-7d41ff3b7143 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:49.830713 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 782/1568] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:26:49.831923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751ae61-9678-4e47-a4ec-b5a840b60d75 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:49.841538 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:49.851543 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 787/1569] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:26:49.851543 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa892dc-47b9-4eee-ae41-7d41ff3b7143 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:49.853815 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751ae61-9678-4e47-a4ec-b5a840b60d75 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:49.859962 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa892dc-47b9-4eee-ae41-7d41ff3b7143 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:49.861217 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b88db5-afa1-4b4f-9012-9ee11fdb082f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:49.862505 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b88db5-afa1-4b4f-9012-9ee11fdb082f admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:49.863020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b88db5-afa1-4b4f-9012-9ee11fdb082f admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:49.863490 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b88db5-afa1-4b4f-9012-9ee11fdb082f admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:49.864656 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b88db5-afa1-4b4f-9012-9ee11fdb082f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:49.867685 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b88db5-afa1-4b4f-9012-9ee11fdb082f admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:49.868919 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a3d2d-e042-4b2f-a348-80b3365a14d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:49.869593 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a3d2d-e042-4b2f-a348-80b3365a14d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:49.869869 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a3d2d-e042-4b2f-a348-80b3365a14d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:49.870137 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a3d2d-e042-4b2f-a348-80b3365a14d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:49.870775 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a3d2d-e042-4b2f-a348-80b3365a14d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:49.872879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a3d2d-e042-4b2f-a348-80b3365a14d7 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:49.891378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 783/1570] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:26:49.892220 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b88db5-afa1-4b4f-9012-9ee11fdb082f admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:49.910129 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b88db5-afa1-4b4f-9012-9ee11fdb082f admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:49.914917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012fbf4-6d0a-4771-85a9-e1264e6e8845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:49.915558 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012fbf4-6d0a-4771-85a9-e1264e6e8845 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:49.915844 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012fbf4-6d0a-4771-85a9-e1264e6e8845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:49.916144 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012fbf4-6d0a-4771-85a9-e1264e6e8845 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:49.916781 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012fbf4-6d0a-4771-85a9-e1264e6e8845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:49.918699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012fbf4-6d0a-4771-85a9-e1264e6e8845 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:49.971566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 788/1571] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:26:49 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:26:49.972402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a3d2d-e042-4b2f-a348-80b3365a14d7 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:50.033548 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 784/1572] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:26:49 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:26:50.033548 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012fbf4-6d0a-4771-85a9-e1264e6e8845 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:50.038936 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a3d2d-e042-4b2f-a348-80b3365a14d7 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:50.101777 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ef4a5-0fdc-4a30-bf57-4037a605980f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:50.102517 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ef4a5-0fdc-4a30-bf57-4037a605980f admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:50.102814 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012fbf4-6d0a-4771-85a9-e1264e6e8845 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:50.102959 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ef4a5-0fdc-4a30-bf57-4037a605980f admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:50.103283 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ef4a5-0fdc-4a30-bf57-4037a605980f admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:50.104018 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ef4a5-0fdc-4a30-bf57-4037a605980f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:50.106072 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ef4a5-0fdc-4a30-bf57-4037a605980f admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:50.107800 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f3380-e1b2-4bd0-b68d-bb6c93c289bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:50.108426 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f3380-e1b2-4bd0-b68d-bb6c93c289bd admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:50.108709 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f3380-e1b2-4bd0-b68d-bb6c93c289bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:50.109069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f3380-e1b2-4bd0-b68d-bb6c93c289bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:50.111873 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f3380-e1b2-4bd0-b68d-bb6c93c289bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:50.111873 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f3380-e1b2-4bd0-b68d-bb6c93c289bd admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:50.219338 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 785/1573] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:26:50 2022] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:26:50.220452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f3380-e1b2-4bd0-b68d-bb6c93c289bd admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:50.256862 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 789/1574] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:26:49 2022] POST /identity/v3/projects => generated 381 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:26:50.256862 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ef4a5-0fdc-4a30-bf57-4037a605980f admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:50.290348 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:50.305779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f3380-e1b2-4bd0-b68d-bb6c93c289bd admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:50.326006 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ef4a5-0fdc-4a30-bf57-4037a605980f admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:50.330710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab3662-bff6-4b20-9041-1b0aeed7370a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:50.331326 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab3662-bff6-4b20-9041-1b0aeed7370a admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:50.331644 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab3662-bff6-4b20-9041-1b0aeed7370a admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:50.331929 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab3662-bff6-4b20-9041-1b0aeed7370a admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:50.332559 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab3662-bff6-4b20-9041-1b0aeed7370a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:50.334492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab3662-bff6-4b20-9041-1b0aeed7370a admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:50.367258 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085532e-ebff-4302-ae2d-8fa4fed7e754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:50.368650 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085532e-ebff-4302-ae2d-8fa4fed7e754 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:50.369147 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085532e-ebff-4302-ae2d-8fa4fed7e754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:50.369666 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085532e-ebff-4302-ae2d-8fa4fed7e754 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:50.370827 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085532e-ebff-4302-ae2d-8fa4fed7e754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:50.372976 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085532e-ebff-4302-ae2d-8fa4fed7e754 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:50.381065 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:50.389926 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 786/1575] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:26:50.391334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085532e-ebff-4302-ae2d-8fa4fed7e754 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:50.406584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085532e-ebff-4302-ae2d-8fa4fed7e754 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:50.411799 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258f64d-b2a5-4a8a-a078-79c44c22ddf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:50.412698 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258f64d-b2a5-4a8a-a078-79c44c22ddf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:50.413117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258f64d-b2a5-4a8a-a078-79c44c22ddf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:50.413525 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258f64d-b2a5-4a8a-a078-79c44c22ddf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:50.414528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258f64d-b2a5-4a8a-a078-79c44c22ddf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:50.417721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258f64d-b2a5-4a8a-a078-79c44c22ddf4 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:50.460108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 790/1576] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:26:50 2022] POST /identity/v3/projects => generated 405 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:26:50.461221 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab3662-bff6-4b20-9041-1b0aeed7370a admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:50.512436 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 787/1577] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:26:50 2022] POST /identity/v3/projects => generated 391 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:26:50.513275 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258f64d-b2a5-4a8a-a078-79c44c22ddf4 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:50.536115 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab3662-bff6-4b20-9041-1b0aeed7370a admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:50.584477 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258f64d-b2a5-4a8a-a078-79c44c22ddf4 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:50.591186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c2fac-ccbe-4254-a24e-f539e4376b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:50.592079 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c2fac-ccbe-4254-a24e-f539e4376b26 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:50.592359 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c2fac-ccbe-4254-a24e-f539e4376b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:50.592630 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c2fac-ccbe-4254-a24e-f539e4376b26 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:50.593286 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c2fac-ccbe-4254-a24e-f539e4376b26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:50.595192 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c2fac-ccbe-4254-a24e-f539e4376b26 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:50.599798 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07498981-db32-4e3b-96ba-9852dd4514f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:50.600570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07498981-db32-4e3b-96ba-9852dd4514f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:50.600814 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07498981-db32-4e3b-96ba-9852dd4514f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:50.601089 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07498981-db32-4e3b-96ba-9852dd4514f6 admin admin] PATH_INFO: `/v3/projects/cb68bc554b7f4508b16b82b5a001fe78/users/71f874ddc9354f5b953739bd5fa08747/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:50.621094 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07498981-db32-4e3b-96ba-9852dd4514f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb68bc554b7f4508b16b82b5a001fe78, user_id=71f874ddc9354f5b953739bd5fa08747, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:50.621539 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07498981-db32-4e3b-96ba-9852dd4514f6 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:50.710650 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 788/1578] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:26:50 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:26:50.712036 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c2fac-ccbe-4254-a24e-f539e4376b26 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:50.737541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c2fac-ccbe-4254-a24e-f539e4376b26 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:50.740027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 791/1579] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:26:50 2022] PUT /identity/v3/projects/cb68bc554b7f4508b16b82b5a001fe78/users/71f874ddc9354f5b953739bd5fa08747/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:26:50.740955 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07498981-db32-4e3b-96ba-9852dd4514f6 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:50.806247 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:50.820169 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2624e9-4d04-4b52-9b7b-0fed99300127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:50.823748 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2624e9-4d04-4b52-9b7b-0fed99300127 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:50.823748 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2624e9-4d04-4b52-9b7b-0fed99300127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:50.823748 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2624e9-4d04-4b52-9b7b-0fed99300127 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:50.823748 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2624e9-4d04-4b52-9b7b-0fed99300127 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:50.827644 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2624e9-4d04-4b52-9b7b-0fed99300127 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:50.829681 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07498981-db32-4e3b-96ba-9852dd4514f6 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:50.834532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f81a46-bc55-465b-816e-cab2f6c9a4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:50.835072 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f81a46-bc55-465b-816e-cab2f6c9a4fb admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:50.835373 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f81a46-bc55-465b-816e-cab2f6c9a4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:50.835685 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f81a46-bc55-465b-816e-cab2f6c9a4fb admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:50.836562 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f81a46-bc55-465b-816e-cab2f6c9a4fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:50.838493 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f81a46-bc55-465b-816e-cab2f6c9a4fb admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:50.952734 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 789/1580] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:26:50 2022] POST /identity/v3/users => generated 287 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:26:50.953567 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2624e9-4d04-4b52-9b7b-0fed99300127 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:50.965216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2624e9-4d04-4b52-9b7b-0fed99300127 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:50.972569 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 792/1581] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:26:50 2022] POST /identity/v3/users => generated 290 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:26:50.972569 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f81a46-bc55-465b-816e-cab2f6c9a4fb admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:50.972886 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f577086-c488-4a24-b4b2-f9839cfdb090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:50.972886 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f577086-c488-4a24-b4b2-f9839cfdb090 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:50.972886 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f577086-c488-4a24-b4b2-f9839cfdb090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:50.972886 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f577086-c488-4a24-b4b2-f9839cfdb090 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:50.973255 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f577086-c488-4a24-b4b2-f9839cfdb090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:50.974003 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f577086-c488-4a24-b4b2-f9839cfdb090 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:50.982505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f81a46-bc55-465b-816e-cab2f6c9a4fb admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:50.988547 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750951b-eedc-4ed1-82c7-e68c50cf4401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:50.989228 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750951b-eedc-4ed1-82c7-e68c50cf4401 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:50.989513 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750951b-eedc-4ed1-82c7-e68c50cf4401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:50.989823 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750951b-eedc-4ed1-82c7-e68c50cf4401 admin admin] PATH_INFO: `/v3/projects/2f5425e3f6c24925825d8cfcc9ff3a54/users/6e4cfd2fc39546358ccaaff19dcafceb/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:51.007083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750951b-eedc-4ed1-82c7-e68c50cf4401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f5425e3f6c24925825d8cfcc9ff3a54, user_id=6e4cfd2fc39546358ccaaff19dcafceb, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:51.010023 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750951b-eedc-4ed1-82c7-e68c50cf4401 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:51.085483 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 790/1582] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:26:50 2022] POST /identity/v3/users => generated 291 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:26:51.088013 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f577086-c488-4a24-b4b2-f9839cfdb090 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:51.100256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f577086-c488-4a24-b4b2-f9839cfdb090 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:51.108452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c1f70-afe3-4e9c-b967-3db3ef0cc577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:51.109557 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c1f70-afe3-4e9c-b967-3db3ef0cc577 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:51.110051 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c1f70-afe3-4e9c-b967-3db3ef0cc577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:51.110528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c1f70-afe3-4e9c-b967-3db3ef0cc577 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:51.111656 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c1f70-afe3-4e9c-b967-3db3ef0cc577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:51.113612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c1f70-afe3-4e9c-b967-3db3ef0cc577 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:51.154484 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 793/1583] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:26:50 2022] PUT /identity/v3/projects/2f5425e3f6c24925825d8cfcc9ff3a54/users/6e4cfd2fc39546358ccaaff19dcafceb/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:26:51.155335 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750951b-eedc-4ed1-82c7-e68c50cf4401 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:51.221522 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750951b-eedc-4ed1-82c7-e68c50cf4401 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:51.226784 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa268b10-d215-4782-9b85-bd16cb56cf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:51.228090 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa268b10-d215-4782-9b85-bd16cb56cf4d admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:51.228381 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa268b10-d215-4782-9b85-bd16cb56cf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:51.228649 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa268b10-d215-4782-9b85-bd16cb56cf4d admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:51.229295 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa268b10-d215-4782-9b85-bd16cb56cf4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:51.231230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa268b10-d215-4782-9b85-bd16cb56cf4d admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:51.242986 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 791/1584] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:26:51 2022] POST /identity/v3/users => generated 303 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:26:51.243955 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c1f70-afe3-4e9c-b967-3db3ef0cc577 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:51.255085 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c1f70-afe3-4e9c-b967-3db3ef0cc577 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:51.260637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a022d-62b7-4b09-adc5-5381e5fb4fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:51.261314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a022d-62b7-4b09-adc5-5381e5fb4fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:51.261591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a022d-62b7-4b09-adc5-5381e5fb4fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:51.261866 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a022d-62b7-4b09-adc5-5381e5fb4fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:51.262552 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a022d-62b7-4b09-adc5-5381e5fb4fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:51.264218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a022d-62b7-4b09-adc5-5381e5fb4fc3 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:51.276462 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 792/1585] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:26:51.278442 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315ecdf-d05e-4a06-8d73-51cf7b106137 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:51.278442 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315ecdf-d05e-4a06-8d73-51cf7b106137 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:51.278442 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315ecdf-d05e-4a06-8d73-51cf7b106137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:51.300955 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:51.309676 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-e315ecdf-d05e-4a06-8d73-51cf7b106137 None None] MFA Rules not processed for user `71f874ddc9354f5b953739bd5fa08747`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:51.311079 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-e315ecdf-d05e-4a06-8d73-51cf7b106137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:51.350498 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 794/1586] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:26:51 2022] POST /identity/v3/users => generated 296 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:26:51.354775 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa268b10-d215-4782-9b85-bd16cb56cf4d admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:51.365327 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa268b10-d215-4782-9b85-bd16cb56cf4d admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:51.370279 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64460229-0531-47c5-8e5f-c9533dbeca21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:51.371009 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64460229-0531-47c5-8e5f-c9533dbeca21 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:51.371172 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64460229-0531-47c5-8e5f-c9533dbeca21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:51.371522 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64460229-0531-47c5-8e5f-c9533dbeca21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:51.372124 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64460229-0531-47c5-8e5f-c9533dbeca21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:51.373824 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64460229-0531-47c5-8e5f-c9533dbeca21 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:51.386571 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 795/1587] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:26:51.386571 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64460229-0531-47c5-8e5f-c9533dbeca21 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:51.398213 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 793/1588] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:51.398213 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315ecdf-d05e-4a06-8d73-51cf7b106137 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:51.400026 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315ecdf-d05e-4a06-8d73-51cf7b106137 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:51.403492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64460229-0531-47c5-8e5f-c9533dbeca21 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:51.405695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856e555-dbcd-4c4c-8da2-4a85675eb973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:51.406324 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856e555-dbcd-4c4c-8da2-4a85675eb973 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:51.406617 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856e555-dbcd-4c4c-8da2-4a85675eb973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:51.406872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856e555-dbcd-4c4c-8da2-4a85675eb973 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:51.407557 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856e555-dbcd-4c4c-8da2-4a85675eb973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:51.408381 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca895c-e7c6-440f-a4a7-76c6b4f41af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:51.408995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca895c-e7c6-440f-a4a7-76c6b4f41af1 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:51.409189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856e555-dbcd-4c4c-8da2-4a85675eb973 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:51.409299 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca895c-e7c6-440f-a4a7-76c6b4f41af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:51.409537 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca895c-e7c6-440f-a4a7-76c6b4f41af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:51.410181 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca895c-e7c6-440f-a4a7-76c6b4f41af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:51.411815 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca895c-e7c6-440f-a4a7-76c6b4f41af1 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:51.423966 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 794/1589] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:26:51.425267 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19271ade-1f67-439a-83d3-68309c0516c4 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:51.425552 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19271ade-1f67-439a-83d3-68309c0516c4 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:51.425853 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19271ade-1f67-439a-83d3-68309c0516c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:51.431179 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 796/1590] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:26:51.432475 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca895c-e7c6-440f-a4a7-76c6b4f41af1 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:51.444697 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca895c-e7c6-440f-a4a7-76c6b4f41af1 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:51.450282 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba7dcc-6582-44bb-a662-dad32c77620e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:51.450736 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-19271ade-1f67-439a-83d3-68309c0516c4 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:51.451225 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba7dcc-6582-44bb-a662-dad32c77620e admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:51.451840 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba7dcc-6582-44bb-a662-dad32c77620e admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:51.451998 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-19271ade-1f67-439a-83d3-68309c0516c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:51.452265 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba7dcc-6582-44bb-a662-dad32c77620e admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:51.453006 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba7dcc-6582-44bb-a662-dad32c77620e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:51.455293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba7dcc-6582-44bb-a662-dad32c77620e admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:51.466380 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 795/1591] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:51.469749 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19271ade-1f67-439a-83d3-68309c0516c4 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:51.472244 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 797/1592] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:26:51.473660 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba7dcc-6582-44bb-a662-dad32c77620e admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:51.484174 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19271ade-1f67-439a-83d3-68309c0516c4 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:51.487130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba7dcc-6582-44bb-a662-dad32c77620e admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:51.489048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef9253-9a59-408d-81ea-7bd575790d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:51.489679 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef9253-9a59-408d-81ea-7bd575790d90 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:51.489956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef9253-9a59-408d-81ea-7bd575790d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:51.490226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef9253-9a59-408d-81ea-7bd575790d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:51.491009 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef9253-9a59-408d-81ea-7bd575790d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:51.492058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1dd878-f671-42c3-8bc9-0a2c8ec0ef38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:51.492593 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef9253-9a59-408d-81ea-7bd575790d90 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:51.492730 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1dd878-f671-42c3-8bc9-0a2c8ec0ef38 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:51.492983 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1dd878-f671-42c3-8bc9-0a2c8ec0ef38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:51.493252 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1dd878-f671-42c3-8bc9-0a2c8ec0ef38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:51.494028 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1dd878-f671-42c3-8bc9-0a2c8ec0ef38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:51.495603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1dd878-f671-42c3-8bc9-0a2c8ec0ef38 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:51.504334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 796/1593] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:26:51.505289 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef9253-9a59-408d-81ea-7bd575790d90 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:51.506694 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 798/1594] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:26:51.507826 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1dd878-f671-42c3-8bc9-0a2c8ec0ef38 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:51.518766 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1dd878-f671-42c3-8bc9-0a2c8ec0ef38 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:51.519086 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef9253-9a59-408d-81ea-7bd575790d90 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:51.523768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81747079-d126-47ae-b990-9095557775c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:51.524685 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33903f-5cbb-4681-a002-15ee543703e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:51.524987 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33903f-5cbb-4681-a002-15ee543703e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:51.525172 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81747079-d126-47ae-b990-9095557775c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:51.525383 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33903f-5cbb-4681-a002-15ee543703e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:51.525561 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81747079-d126-47ae-b990-9095557775c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:51.525768 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33903f-5cbb-4681-a002-15ee543703e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:51.525969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81747079-d126-47ae-b990-9095557775c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:51.526208 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33903f-5cbb-4681-a002-15ee543703e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:51.526360 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81747079-d126-47ae-b990-9095557775c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:51.527991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81747079-d126-47ae-b990-9095557775c3 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:51.528198 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33903f-5cbb-4681-a002-15ee543703e0 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:51.540028 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 799/1595] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:26:51.541375 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81747079-d126-47ae-b990-9095557775c3 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:51.551430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81747079-d126-47ae-b990-9095557775c3 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:51.556472 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00868b6f-e94b-41a4-974d-b18a7a98ed0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:51.568178 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00868b6f-e94b-41a4-974d-b18a7a98ed0c admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:51.568178 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00868b6f-e94b-41a4-974d-b18a7a98ed0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:51.568178 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00868b6f-e94b-41a4-974d-b18a7a98ed0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:51.568178 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00868b6f-e94b-41a4-974d-b18a7a98ed0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:51.568178 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00868b6f-e94b-41a4-974d-b18a7a98ed0c admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:51.571498 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 800/1596] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:26:51.572386 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00868b6f-e94b-41a4-974d-b18a7a98ed0c admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:51.583161 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00868b6f-e94b-41a4-974d-b18a7a98ed0c admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:51.588923 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691d6ef-6227-44ca-afb9-9d0d53917c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:51.589544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691d6ef-6227-44ca-afb9-9d0d53917c05 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:51.589821 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691d6ef-6227-44ca-afb9-9d0d53917c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:51.590088 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691d6ef-6227-44ca-afb9-9d0d53917c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:51.590862 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b691d6ef-6227-44ca-afb9-9d0d53917c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:51.592411 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b691d6ef-6227-44ca-afb9-9d0d53917c05 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:51.603939 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 801/1597] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:26:51.604840 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691d6ef-6227-44ca-afb9-9d0d53917c05 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:51.606676 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-b691d6ef-6227-44ca-afb9-9d0d53917c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:51.621127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 797/1598] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:26:51 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:26:51.622232 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33903f-5cbb-4681-a002-15ee543703e0 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:51.632707 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:51.673870 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691d6ef-6227-44ca-afb9-9d0d53917c05 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:51.711469 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33903f-5cbb-4681-a002-15ee543703e0 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:51.716921 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f974c91-e0e9-45af-99a3-1aa8a1d7552c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:51.717601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f974c91-e0e9-45af-99a3-1aa8a1d7552c admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:51.717934 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f974c91-e0e9-45af-99a3-1aa8a1d7552c admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:51.718163 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f974c91-e0e9-45af-99a3-1aa8a1d7552c admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:51.718812 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f974c91-e0e9-45af-99a3-1aa8a1d7552c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:51.720480 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f974c91-e0e9-45af-99a3-1aa8a1d7552c admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:51.728119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2005d4-c298-45e4-b101-4df2ec830b1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:51.728662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2005d4-c298-45e4-b101-4df2ec830b1f service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:51.728937 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2005d4-c298-45e4-b101-4df2ec830b1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:51.729208 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2005d4-c298-45e4-b101-4df2ec830b1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:51.731297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 798/1599] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:26:51.732391 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f974c91-e0e9-45af-99a3-1aa8a1d7552c admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:51.740744 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2005d4-c298-45e4-b101-4df2ec830b1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:51.743159 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f974c91-e0e9-45af-99a3-1aa8a1d7552c admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:51.743659 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2005d4-c298-45e4-b101-4df2ec830b1f service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:51.748326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f7770-016f-4eef-9817-33c2bb40b2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:51.748790 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f7770-016f-4eef-9817-33c2bb40b2f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:51.749063 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f7770-016f-4eef-9817-33c2bb40b2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:51.749331 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f7770-016f-4eef-9817-33c2bb40b2f3 admin admin] PATH_INFO: `/v3/projects/56e0c230fb944673be8abc0fbac17df9/users/779846f3313940b388340f1794450e17/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:51.755844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 802/1600] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:26:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:26:51.757440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2005d4-c298-45e4-b101-4df2ec830b1f service neutron] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:51.766388 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f7770-016f-4eef-9817-33c2bb40b2f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e0c230fb944673be8abc0fbac17df9, user_id=779846f3313940b388340f1794450e17, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:51.767475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: WARNING py.warnings [None req-672f7770-016f-4eef-9817-33c2bb40b2f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 20:26:51.767475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: warnings.warn(msg) Sep 06 20:26:51.767475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: Sep 06 20:26:51.768220 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2005d4-c298-45e4-b101-4df2ec830b1f service neutron] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:51.769707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f7770-016f-4eef-9817-33c2bb40b2f3 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:51.773801 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3910620-84e6-46d8-8399-7d810fb03e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:51.774665 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3910620-84e6-46d8-8399-7d810fb03e67 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:51.775031 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3910620-84e6-46d8-8399-7d810fb03e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:51.775406 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3910620-84e6-46d8-8399-7d810fb03e67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:51.776748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3910620-84e6-46d8-8399-7d810fb03e67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:51.777863 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3910620-84e6-46d8-8399-7d810fb03e67 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:51.788911 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 803/1601] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:26:51.789799 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3910620-84e6-46d8-8399-7d810fb03e67 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:51.800345 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3910620-84e6-46d8-8399-7d810fb03e67 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:51.805720 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804da8b-b95b-4fc1-8279-47021ee08d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:51.806412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804da8b-b95b-4fc1-8279-47021ee08d12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:51.807127 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804da8b-b95b-4fc1-8279-47021ee08d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:51.807127 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804da8b-b95b-4fc1-8279-47021ee08d12 admin admin] PATH_INFO: `/v3/projects/4e2138b2720b4818a60a6b189ffe6ab2/users/b41b531e9d7847039b37090d97aaf242/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:51.824552 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804da8b-b95b-4fc1-8279-47021ee08d12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e2138b2720b4818a60a6b189ffe6ab2, user_id=b41b531e9d7847039b37090d97aaf242, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:51.827318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804da8b-b95b-4fc1-8279-47021ee08d12 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:51.890589 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 799/1602] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:26:51 2022] PUT /identity/v3/projects/56e0c230fb944673be8abc0fbac17df9/users/779846f3313940b388340f1794450e17/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:26:51.891413 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f7770-016f-4eef-9817-33c2bb40b2f3 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:51.917712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:51.924622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 804/1603] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:26:51 2022] PUT /identity/v3/projects/4e2138b2720b4818a60a6b189ffe6ab2/users/b41b531e9d7847039b37090d97aaf242/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:26:51.924622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804da8b-b95b-4fc1-8279-47021ee08d12 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:51.967669 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f7770-016f-4eef-9817-33c2bb40b2f3 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:52.004865 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804da8b-b95b-4fc1-8279-47021ee08d12 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:52.010990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000bdec3-ab00-43e7-b24d-9e3b24d2cc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:52.012051 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bdec3-ab00-43e7-b24d-9e3b24d2cc97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:52.012531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bdec3-ab00-43e7-b24d-9e3b24d2cc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:52.012953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bdec3-ab00-43e7-b24d-9e3b24d2cc97 admin admin] PATH_INFO: `/v3/projects/96089e71564543458dedc2b3de7fe356/users/b4543538509341ca9f6428538861d990/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:52.034623 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000bdec3-ab00-43e7-b24d-9e3b24d2cc97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96089e71564543458dedc2b3de7fe356, user_id=b4543538509341ca9f6428538861d990, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:52.037937 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000bdec3-ab00-43e7-b24d-9e3b24d2cc97 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:52.049863 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b7758-b6d2-45ce-bd16-11b4f67b59df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:52.050396 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b7758-b6d2-45ce-bd16-11b4f67b59df admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:52.050606 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b7758-b6d2-45ce-bd16-11b4f67b59df admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:52.050877 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b7758-b6d2-45ce-bd16-11b4f67b59df admin admin] PATH_INFO: `/v3/projects/fd3ab16657274855a9061942ab064ab5/users/9928e2fc83c74816b3e0fdaab3a10976/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:52.067135 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b7758-b6d2-45ce-bd16-11b4f67b59df admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd3ab16657274855a9061942ab064ab5, user_id=9928e2fc83c74816b3e0fdaab3a10976, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:52.069906 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b7758-b6d2-45ce-bd16-11b4f67b59df admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:52.183241 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 800/1604] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:26:51 2022] PUT /identity/v3/projects/fd3ab16657274855a9061942ab064ab5/users/9928e2fc83c74816b3e0fdaab3a10976/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:26:52.183919 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b7758-b6d2-45ce-bd16-11b4f67b59df admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:52.202796 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 805/1605] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:26:51 2022] PUT /identity/v3/projects/96089e71564543458dedc2b3de7fe356/users/b4543538509341ca9f6428538861d990/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:26:52.202796 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000bdec3-ab00-43e7-b24d-9e3b24d2cc97 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:52.271572 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:52.272625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b7758-b6d2-45ce-bd16-11b4f67b59df admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:52.307532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000bdec3-ab00-43e7-b24d-9e3b24d2cc97 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:52.312715 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a582e6-bac1-4ebd-bdf2-a420aabbd7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:52.313809 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a582e6-bac1-4ebd-bdf2-a420aabbd7c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:52.313809 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a582e6-bac1-4ebd-bdf2-a420aabbd7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:52.314033 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a582e6-bac1-4ebd-bdf2-a420aabbd7c5 admin admin] PATH_INFO: `/v3/projects/357a1ba81fe243a9ae76411a5a928479/users/91c90cdd3ee148f0ad7e92f788ac9f69/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:52.329918 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a582e6-bac1-4ebd-bdf2-a420aabbd7c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=357a1ba81fe243a9ae76411a5a928479, user_id=91c90cdd3ee148f0ad7e92f788ac9f69, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:52.332725 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a582e6-bac1-4ebd-bdf2-a420aabbd7c5 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:52.340449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e169a97-c1eb-4958-8b99-cfc7c21cc783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:52.341068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e169a97-c1eb-4958-8b99-cfc7c21cc783 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:52.341346 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e169a97-c1eb-4958-8b99-cfc7c21cc783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:52.341618 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e169a97-c1eb-4958-8b99-cfc7c21cc783 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:52.342246 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e169a97-c1eb-4958-8b99-cfc7c21cc783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:52.344203 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e169a97-c1eb-4958-8b99-cfc7c21cc783 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:52.353328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:52.422463 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 806/1606] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:26:52 2022] PUT /identity/v3/projects/357a1ba81fe243a9ae76411a5a928479/users/91c90cdd3ee148f0ad7e92f788ac9f69/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:26:52.423396 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a582e6-bac1-4ebd-bdf2-a420aabbd7c5 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:52.483218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 801/1607] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:26:52 2022] POST /identity/v3/users => generated 293 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:26:52.485326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d62f09-fa21-4135-9761-b94205784aed None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:52.485612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d62f09-fa21-4135-9761-b94205784aed None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:52.485899 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d62f09-fa21-4135-9761-b94205784aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:52.505738 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a582e6-bac1-4ebd-bdf2-a420aabbd7c5 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:52.510542 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4ca3d-8500-4f4b-a0bd-4c392bfa0532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:52.511207 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4ca3d-8500-4f4b-a0bd-4c392bfa0532 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:52.511515 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4ca3d-8500-4f4b-a0bd-4c392bfa0532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:52.511789 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4ca3d-8500-4f4b-a0bd-4c392bfa0532 admin admin] PATH_INFO: `/v3/projects/604b4ccf32184d70b2b709a3ad22f25a/users/2e7cc9c938214193b922ab1bc8288a4b/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:52.522619 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-08d62f09-fa21-4135-9761-b94205784aed None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:52.524489 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-08d62f09-fa21-4135-9761-b94205784aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:52.536840 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 802/1608] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:52.538404 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec37dfd-c465-4190-80d0-e4c00645d3da None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:52.540370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec37dfd-c465-4190-80d0-e4c00645d3da None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:52.540370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec37dfd-c465-4190-80d0-e4c00645d3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:52.541453 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4ca3d-8500-4f4b-a0bd-4c392bfa0532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=604b4ccf32184d70b2b709a3ad22f25a, user_id=2e7cc9c938214193b922ab1bc8288a4b, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:52.546510 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4ca3d-8500-4f4b-a0bd-4c392bfa0532 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:52.578986 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-6ec37dfd-c465-4190-80d0-e4c00645d3da None None] MFA Rules not processed for user `b41b531e9d7847039b37090d97aaf242`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:52.580417 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6ec37dfd-c465-4190-80d0-e4c00645d3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:52.621191 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 807/1609] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:26:52 2022] PUT /identity/v3/projects/604b4ccf32184d70b2b709a3ad22f25a/users/2e7cc9c938214193b922ab1bc8288a4b/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:26:52.622650 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192689b7-383d-4cdf-b267-0396956cb5b8 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:52.623043 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192689b7-383d-4cdf-b267-0396956cb5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:52.623386 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192689b7-383d-4cdf-b267-0396956cb5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:52.653808 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 803/1610] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:52.653808 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd813f9-f98f-488d-be77-2c1d0ee27ffc None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:52.653808 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd813f9-f98f-488d-be77-2c1d0ee27ffc None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:52.656958 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd813f9-f98f-488d-be77-2c1d0ee27ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:52.657719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-192689b7-383d-4cdf-b267-0396956cb5b8 None None] MFA Rules not processed for user `9928e2fc83c74816b3e0fdaab3a10976`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:52.659104 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-192689b7-383d-4cdf-b267-0396956cb5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:52.677224 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-1bd813f9-f98f-488d-be77-2c1d0ee27ffc None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:52.678457 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-1bd813f9-f98f-488d-be77-2c1d0ee27ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:52.744201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 808/1611] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:52.745571 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f771277-bfe6-4089-a1c2-8b59f6665dd6 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:52.745908 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f771277-bfe6-4089-a1c2-8b59f6665dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:52.746140 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f771277-bfe6-4089-a1c2-8b59f6665dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:52.747749 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 804/1612] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:52.748592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd813f9-f98f-488d-be77-2c1d0ee27ffc None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:52.758930 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd813f9-f98f-488d-be77-2c1d0ee27ffc None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:52.764113 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be56b6-bdd0-46d2-863f-b7fba1da1b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:52.764753 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be56b6-bdd0-46d2-863f-b7fba1da1b4d admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:52.765038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be56b6-bdd0-46d2-863f-b7fba1da1b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:52.765308 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be56b6-bdd0-46d2-863f-b7fba1da1b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:52.766247 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be56b6-bdd0-46d2-863f-b7fba1da1b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:52.768967 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be56b6-bdd0-46d2-863f-b7fba1da1b4d admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:52.781495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-1f771277-bfe6-4089-a1c2-8b59f6665dd6 None None] MFA Rules not processed for user `91c90cdd3ee148f0ad7e92f788ac9f69`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:52.782755 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-1f771277-bfe6-4089-a1c2-8b59f6665dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:52.786528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 805/1613] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:26:52.788109 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be56b6-bdd0-46d2-863f-b7fba1da1b4d admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:52.798607 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:52.863164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 809/1614] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:52 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:52.864498 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5aa28-01df-4fab-adb2-2bcb1978cbed None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:52.864786 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5aa28-01df-4fab-adb2-2bcb1978cbed None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:52.865059 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5aa28-01df-4fab-adb2-2bcb1978cbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:52.872691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be56b6-bdd0-46d2-863f-b7fba1da1b4d admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:52.876693 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe909e5-c51f-4c32-8ca8-2763abfbc417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:52.877345 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe909e5-c51f-4c32-8ca8-2763abfbc417 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:52.877601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe909e5-c51f-4c32-8ca8-2763abfbc417 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:52.877879 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe909e5-c51f-4c32-8ca8-2763abfbc417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:52.885698 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-c9e5aa28-01df-4fab-adb2-2bcb1978cbed None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:52.887559 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-c9e5aa28-01df-4fab-adb2-2bcb1978cbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:52.889143 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe909e5-c51f-4c32-8ca8-2763abfbc417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:52.890183 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe909e5-c51f-4c32-8ca8-2763abfbc417 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:52.899654 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 810/1615] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:52.900760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5aa28-01df-4fab-adb2-2bcb1978cbed None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:52.901247 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 806/1616] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:26:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:26:52.901836 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe909e5-c51f-4c32-8ca8-2763abfbc417 service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:52.906912 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:52.910823 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe909e5-c51f-4c32-8ca8-2763abfbc417 service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:52.913445 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5aa28-01df-4fab-adb2-2bcb1978cbed None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:52.915572 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292c600-d176-4009-b126-e91ae6c02707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:52.916187 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292c600-d176-4009-b126-e91ae6c02707 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:52.916484 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292c600-d176-4009-b126-e91ae6c02707 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:52.916738 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292c600-d176-4009-b126-e91ae6c02707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:52.918666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8c950-8b03-4685-ad37-7c5626df6529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:52.919569 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8c950-8b03-4685-ad37-7c5626df6529 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:52.919924 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8c950-8b03-4685-ad37-7c5626df6529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:52.920270 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8c950-8b03-4685-ad37-7c5626df6529 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:52.920987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8c950-8b03-4685-ad37-7c5626df6529 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:52.923141 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8c950-8b03-4685-ad37-7c5626df6529 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:52.930648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292c600-d176-4009-b126-e91ae6c02707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:52.931132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292c600-d176-4009-b126-e91ae6c02707 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:52.942889 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 807/1617] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:26:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:26:52.944494 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92656a0-2bb5-4917-986d-d54c1f68d391 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:52.944873 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92656a0-2bb5-4917-986d-d54c1f68d391 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:52.945208 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92656a0-2bb5-4917-986d-d54c1f68d391 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:52.947277 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 808/1618] 10.222.0.77 () {54 vars in 962 bytes} [Tue Sep 6 20:26:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:26:52.948139 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92656a0-2bb5-4917-986d-d54c1f68d391 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:52.962309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92656a0-2bb5-4917-986d-d54c1f68d391 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:52.968824 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7fef6-da2b-44fa-b7fd-adfbc38b2875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:52.970510 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7fef6-da2b-44fa-b7fd-adfbc38b2875 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:52.971002 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7fef6-da2b-44fa-b7fd-adfbc38b2875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:52.971544 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7fef6-da2b-44fa-b7fd-adfbc38b2875 admin admin] PATH_INFO: `/v3/projects/33cc65ddf1aa432ea47b7b1d42829cb5/users/12bc0f5d79e2415b830ae1f1d6616bfb/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:52.987680 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7fef6-da2b-44fa-b7fd-adfbc38b2875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33cc65ddf1aa432ea47b7b1d42829cb5, user_id=12bc0f5d79e2415b830ae1f1d6616bfb, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:52.990598 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7fef6-da2b-44fa-b7fd-adfbc38b2875 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:53.034156 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 811/1619] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:26:52 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:26:53.035036 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8c950-8b03-4685-ad37-7c5626df6529 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:53.089244 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 809/1620] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:26:52 2022] PUT /identity/v3/projects/33cc65ddf1aa432ea47b7b1d42829cb5/users/12bc0f5d79e2415b830ae1f1d6616bfb/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:26:53.090139 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7fef6-da2b-44fa-b7fd-adfbc38b2875 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:53.112506 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8c950-8b03-4685-ad37-7c5626df6529 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:53.175798 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7fef6-da2b-44fa-b7fd-adfbc38b2875 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:53.182698 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f12550-0bd6-42f2-8928-b4452b31f042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:53.183338 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f12550-0bd6-42f2-8928-b4452b31f042 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:53.183674 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f12550-0bd6-42f2-8928-b4452b31f042 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:53.183977 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f12550-0bd6-42f2-8928-b4452b31f042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:53.187257 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efda39-564e-4848-9ade-1952feac46fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:53.188000 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efda39-564e-4848-9ade-1952feac46fd admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:53.188345 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efda39-564e-4848-9ade-1952feac46fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:53.188614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efda39-564e-4848-9ade-1952feac46fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:53.189423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36efda39-564e-4848-9ade-1952feac46fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:53.191344 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36efda39-564e-4848-9ade-1952feac46fd admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:53.194952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f12550-0bd6-42f2-8928-b4452b31f042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:53.197859 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f12550-0bd6-42f2-8928-b4452b31f042 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:53.208917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 810/1621] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:26:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:26:53.216785 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7b07f-5278-45ae-8000-af1f7f9d974d None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:53.217272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7b07f-5278-45ae-8000-af1f7f9d974d None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:53.217550 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7b07f-5278-45ae-8000-af1f7f9d974d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:53.258929 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-23f7b07f-5278-45ae-8000-af1f7f9d974d None None] MFA Rules not processed for user `b09ce16da49b4af38491ad4eb6287d70`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:53.260185 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-23f7b07f-5278-45ae-8000-af1f7f9d974d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:53.300616 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 812/1622] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:26:53 2022] POST /identity/v3/projects => generated 403 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:26:53.300616 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efda39-564e-4848-9ade-1952feac46fd admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:53.332015 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:53.412440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efda39-564e-4848-9ade-1952feac46fd admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:53.413893 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 811/1623] 10.222.0.77 () {58 vars in 1059 bytes} [Tue Sep 6 20:26:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:53.415024 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7b07f-5278-45ae-8000-af1f7f9d974d None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:53.433822 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65efbae-7f0b-4672-9fb6-e065b6afbff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:53.434511 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65efbae-7f0b-4672-9fb6-e065b6afbff4 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:53.434786 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65efbae-7f0b-4672-9fb6-e065b6afbff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:53.435083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65efbae-7f0b-4672-9fb6-e065b6afbff4 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:53.437451 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65efbae-7f0b-4672-9fb6-e065b6afbff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:53.437887 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7b07f-5278-45ae-8000-af1f7f9d974d None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:53.441956 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65efbae-7f0b-4672-9fb6-e065b6afbff4 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:53.443557 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025a5f5-e0ea-4f84-89f8-3b2069ac467c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:53.444191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025a5f5-e0ea-4f84-89f8-3b2069ac467c admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:53.444473 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025a5f5-e0ea-4f84-89f8-3b2069ac467c admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:53.444746 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025a5f5-e0ea-4f84-89f8-3b2069ac467c admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:53.445398 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025a5f5-e0ea-4f84-89f8-3b2069ac467c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:53.447773 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025a5f5-e0ea-4f84-89f8-3b2069ac467c admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:53.479143 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 812/1624] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:26:53.480333 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025a5f5-e0ea-4f84-89f8-3b2069ac467c admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:53.493920 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025a5f5-e0ea-4f84-89f8-3b2069ac467c admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:53.500162 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13ce2f-3cd8-4b50-9b2a-88ace88d6bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:53.500953 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13ce2f-3cd8-4b50-9b2a-88ace88d6bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:53.501349 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13ce2f-3cd8-4b50-9b2a-88ace88d6bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:53.501674 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13ce2f-3cd8-4b50-9b2a-88ace88d6bf7 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:53.502477 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13ce2f-3cd8-4b50-9b2a-88ace88d6bf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:53.505003 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13ce2f-3cd8-4b50-9b2a-88ace88d6bf7 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:53.553535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 813/1625] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:26:53 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:26:53.554843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d6530-3e9a-40de-8592-53c98e22bbf7 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:53.555663 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d6530-3e9a-40de-8592-53c98e22bbf7 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:53.556008 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d6530-3e9a-40de-8592-53c98e22bbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:53.592803 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-722d6530-3e9a-40de-8592-53c98e22bbf7 None None] MFA Rules not processed for user `6e4cfd2fc39546358ccaaff19dcafceb`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:53.594113 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-722d6530-3e9a-40de-8592-53c98e22bbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:53.664238 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 813/1626] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:26:53 2022] POST /identity/v3/users => generated 308 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:26:53.669905 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13ce2f-3cd8-4b50-9b2a-88ace88d6bf7 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:53.678796 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 814/1627] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:53 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:53.681634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d6530-3e9a-40de-8592-53c98e22bbf7 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:53.701922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:53.707065 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d6530-3e9a-40de-8592-53c98e22bbf7 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:53.723347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879999f-0b7d-4767-8939-11e635d08cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:53.733012 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879999f-0b7d-4767-8939-11e635d08cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:53.733867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879999f-0b7d-4767-8939-11e635d08cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:53.734235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879999f-0b7d-4767-8939-11e635d08cd4 admin admin] PATH_INFO: `/v3/projects/33cc65ddf1aa432ea47b7b1d42829cb5/users/12bc0f5d79e2415b830ae1f1d6616bfb/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:53.738380 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879999f-0b7d-4767-8939-11e635d08cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33cc65ddf1aa432ea47b7b1d42829cb5, user_id=12bc0f5d79e2415b830ae1f1d6616bfb, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:53.749242 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879999f-0b7d-4767-8939-11e635d08cd4 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:53.777529 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 815/1628] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:26:53 2022] PUT /identity/v3/projects/33cc65ddf1aa432ea47b7b1d42829cb5/users/12bc0f5d79e2415b830ae1f1d6616bfb/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:26:53.778460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879999f-0b7d-4767-8939-11e635d08cd4 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:53.792467 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13ce2f-3cd8-4b50-9b2a-88ace88d6bf7 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:53.913929 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879999f-0b7d-4767-8939-11e635d08cd4 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:53.921435 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad612fc-9647-440f-89be-ba068fb3c375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:53.921662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c24f1-9155-41f2-ad84-9040dd188d1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:53.922732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c24f1-9155-41f2-ad84-9040dd188d1c service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:53.922732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c24f1-9155-41f2-ad84-9040dd188d1c service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:53.922896 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad612fc-9647-440f-89be-ba068fb3c375 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:53.922974 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c24f1-9155-41f2-ad84-9040dd188d1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:53.923047 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad612fc-9647-440f-89be-ba068fb3c375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:53.923118 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad612fc-9647-440f-89be-ba068fb3c375 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:53.923972 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad612fc-9647-440f-89be-ba068fb3c375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:53.925838 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad612fc-9647-440f-89be-ba068fb3c375 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:53.945591 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 816/1629] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:26:53.945591 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad612fc-9647-440f-89be-ba068fb3c375 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:53.957414 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad612fc-9647-440f-89be-ba068fb3c375 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:53.963245 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdceca1-24a8-4acd-ac34-8fc2801d5907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:53.964071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdceca1-24a8-4acd-ac34-8fc2801d5907 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:53.964431 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdceca1-24a8-4acd-ac34-8fc2801d5907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:53.964885 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdceca1-24a8-4acd-ac34-8fc2801d5907 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:53.965662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdceca1-24a8-4acd-ac34-8fc2801d5907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:53.967662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdceca1-24a8-4acd-ac34-8fc2801d5907 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:53.988050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 817/1630] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:26:53.988050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdceca1-24a8-4acd-ac34-8fc2801d5907 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:53.997055 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdceca1-24a8-4acd-ac34-8fc2801d5907 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:54.003010 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d712a-0a4a-4454-84c6-3815b9761023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:54.003842 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d712a-0a4a-4454-84c6-3815b9761023 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:54.004195 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d712a-0a4a-4454-84c6-3815b9761023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:54.004952 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d712a-0a4a-4454-84c6-3815b9761023 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:54.005476 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d712a-0a4a-4454-84c6-3815b9761023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:54.007869 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d712a-0a4a-4454-84c6-3815b9761023 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:54.015778 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:54.033022 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c24f1-9155-41f2-ad84-9040dd188d1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:54.035127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c24f1-9155-41f2-ad84-9040dd188d1c service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:54.053521 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 814/1631] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:26:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:26:54.056167 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a418c99-f7b8-4792-886e-cfaca1de2037 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:54.056167 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a418c99-f7b8-4792-886e-cfaca1de2037 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:54.056658 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a418c99-f7b8-4792-886e-cfaca1de2037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:54.099127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-1a418c99-f7b8-4792-886e-cfaca1de2037 None None] MFA Rules not processed for user `12bc0f5d79e2415b830ae1f1d6616bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:54.100677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-1a418c99-f7b8-4792-886e-cfaca1de2037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:54.164174 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 818/1632] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:26:53 2022] POST /identity/v3/projects => generated 405 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:26:54.165561 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d712a-0a4a-4454-84c6-3815b9761023 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:54.227665 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 815/1633] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:54.230362 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a418c99-f7b8-4792-886e-cfaca1de2037 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:54.446719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a418c99-f7b8-4792-886e-cfaca1de2037 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:54.446719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:54.447890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d712a-0a4a-4454-84c6-3815b9761023 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:54.447890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff7b3e-e987-46b6-a081-1af1e78e0587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:54.447890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff7b3e-e987-46b6-a081-1af1e78e0587 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:54.447890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff7b3e-e987-46b6-a081-1af1e78e0587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:54.448201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff7b3e-e987-46b6-a081-1af1e78e0587 admin admin] PATH_INFO: `/v3/projects/f4dfae19376043c3bc6e0fc32edb26f0/users/8844717050e845abab4e2e6d5de9b674/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:54.448273 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8fc56-553a-4143-b16d-dc24b45a5f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:54.448273 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8fc56-553a-4143-b16d-dc24b45a5f70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:54.448273 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8fc56-553a-4143-b16d-dc24b45a5f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:54.448273 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8fc56-553a-4143-b16d-dc24b45a5f70 admin admin] PATH_INFO: `/v3/projects/4b25c590b86a4000b93f22807cafe257/users/10f89229c06446a2910f2eb81fdd9d49/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:54.448509 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff7b3e-e987-46b6-a081-1af1e78e0587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4dfae19376043c3bc6e0fc32edb26f0, user_id=8844717050e845abab4e2e6d5de9b674, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:54.448509 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff7b3e-e987-46b6-a081-1af1e78e0587 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:54.448659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8fc56-553a-4143-b16d-dc24b45a5f70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b25c590b86a4000b93f22807cafe257, user_id=10f89229c06446a2910f2eb81fdd9d49, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:54.448659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8fc56-553a-4143-b16d-dc24b45a5f70 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:54.636316 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 819/1634] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:26:54 2022] PUT /identity/v3/projects/f4dfae19376043c3bc6e0fc32edb26f0/users/8844717050e845abab4e2e6d5de9b674/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:26:54.637141 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff7b3e-e987-46b6-a081-1af1e78e0587 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:54.670035 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 816/1635] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:26:54 2022] PUT /identity/v3/projects/4b25c590b86a4000b93f22807cafe257/users/10f89229c06446a2910f2eb81fdd9d49/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:26:54.671789 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8fc56-553a-4143-b16d-dc24b45a5f70 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:54.714681 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff7b3e-e987-46b6-a081-1af1e78e0587 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:54.759020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8fc56-553a-4143-b16d-dc24b45a5f70 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:54.762827 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08967ec5-5fd9-4d8d-8ec2-ce894d06987e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:54.763672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08967ec5-5fd9-4d8d-8ec2-ce894d06987e service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:54.764206 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08967ec5-5fd9-4d8d-8ec2-ce894d06987e service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:54.764560 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08967ec5-5fd9-4d8d-8ec2-ce894d06987e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:54.824125 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740a740-364a-4d3f-8579-2ee2a6cfaaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:54.824958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740a740-364a-4d3f-8579-2ee2a6cfaaa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:54.825245 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740a740-364a-4d3f-8579-2ee2a6cfaaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:54.827492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740a740-364a-4d3f-8579-2ee2a6cfaaa7 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:54.827492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740a740-364a-4d3f-8579-2ee2a6cfaaa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:54.830969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740a740-364a-4d3f-8579-2ee2a6cfaaa7 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:54.866813 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08967ec5-5fd9-4d8d-8ec2-ce894d06987e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:54.868858 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08967ec5-5fd9-4d8d-8ec2-ce894d06987e service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:54.880377 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 817/1636] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:26:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:26:54.881964 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edcef0-fe92-4c92-b110-0a20fd42774a None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:54.882868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edcef0-fe92-4c92-b110-0a20fd42774a None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:54.882868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edcef0-fe92-4c92-b110-0a20fd42774a None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:54.891209 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 818/1637] 10.222.0.77 () {54 vars in 912 bytes} [Tue Sep 6 20:26:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:26:54.891209 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edcef0-fe92-4c92-b110-0a20fd42774a None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:54.909848 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edcef0-fe92-4c92-b110-0a20fd42774a None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:54.915407 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd04c59-70a2-40b0-9089-598ab4eea5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:54.916089 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd04c59-70a2-40b0-9089-598ab4eea5ca admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:54.916380 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd04c59-70a2-40b0-9089-598ab4eea5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:54.935789 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd04c59-70a2-40b0-9089-598ab4eea5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:54.935789 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd04c59-70a2-40b0-9089-598ab4eea5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:54.935789 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd04c59-70a2-40b0-9089-598ab4eea5ca admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:54.935789 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 819/1638] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:26:54.935789 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd04c59-70a2-40b0-9089-598ab4eea5ca admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:54.938628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:54.945144 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd04c59-70a2-40b0-9089-598ab4eea5ca admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:54.950688 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf1c94-1a6a-4484-be1a-a253fce80256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:54.951312 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf1c94-1a6a-4484-be1a-a253fce80256 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:54.951659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf1c94-1a6a-4484-be1a-a253fce80256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:54.951941 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf1c94-1a6a-4484-be1a-a253fce80256 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:54.952585 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf1c94-1a6a-4484-be1a-a253fce80256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:54.956178 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf1c94-1a6a-4484-be1a-a253fce80256 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:54.966514 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 820/1639] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:26:54 2022] POST /identity/v3/users => generated 309 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:26:54.968079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f01f2a-7190-4ca3-a221-659f5ec1da13 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:54.968366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f01f2a-7190-4ca3-a221-659f5ec1da13 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:54.968637 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f01f2a-7190-4ca3-a221-659f5ec1da13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:54.972969 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 820/1640] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:26:54.972969 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf1c94-1a6a-4484-be1a-a253fce80256 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:54.980550 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf1c94-1a6a-4484-be1a-a253fce80256 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:54.981195 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:54.985797 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540af679-557f-4fbc-85a1-b9c910e3e29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:54.986540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540af679-557f-4fbc-85a1-b9c910e3e29f admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:54.986753 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540af679-557f-4fbc-85a1-b9c910e3e29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:54.987182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540af679-557f-4fbc-85a1-b9c910e3e29f admin admin] PATH_INFO: `/v3/projects/f4dfae19376043c3bc6e0fc32edb26f0/users/8844717050e845abab4e2e6d5de9b674/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:54.989381 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540af679-557f-4fbc-85a1-b9c910e3e29f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4dfae19376043c3bc6e0fc32edb26f0, user_id=8844717050e845abab4e2e6d5de9b674, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:54.992972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540af679-557f-4fbc-85a1-b9c910e3e29f admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:55.011529 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 821/1641] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:26:54 2022] PUT /identity/v3/projects/f4dfae19376043c3bc6e0fc32edb26f0/users/8844717050e845abab4e2e6d5de9b674/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:26:55.011529 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540af679-557f-4fbc-85a1-b9c910e3e29f admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:55.022918 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-55f01f2a-7190-4ca3-a221-659f5ec1da13 None None] MFA Rules not processed for user `b09ce16da49b4af38491ad4eb6287d70`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:55.024692 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-55f01f2a-7190-4ca3-a221-659f5ec1da13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:55.167758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540af679-557f-4fbc-85a1-b9c910e3e29f admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:55.180955 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf411c1-1cd1-4eed-ae5b-055040855f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:55.181351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf411c1-1cd1-4eed-ae5b-055040855f06 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:55.181879 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf411c1-1cd1-4eed-ae5b-055040855f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:55.182325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf411c1-1cd1-4eed-ae5b-055040855f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:55.183075 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf411c1-1cd1-4eed-ae5b-055040855f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:55.184998 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf411c1-1cd1-4eed-ae5b-055040855f06 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:55.198297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 822/1642] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:26:55.200966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 821/1643] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Sep 6 20:26:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:55.203781 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf411c1-1cd1-4eed-ae5b-055040855f06 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:55.208150 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34766dff-7092-4db7-8f10-77c2ff7c7f86 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:55.208394 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34766dff-7092-4db7-8f10-77c2ff7c7f86 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:55.208674 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34766dff-7092-4db7-8f10-77c2ff7c7f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:55.235221 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf411c1-1cd1-4eed-ae5b-055040855f06 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:55.253805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e9697-e983-4b86-8edf-056f80b56a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:55.253948 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-34766dff-7092-4db7-8f10-77c2ff7c7f86 None None] MFA Rules not processed for user `8844717050e845abab4e2e6d5de9b674`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:55.259865 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-34766dff-7092-4db7-8f10-77c2ff7c7f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:55.260158 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e9697-e983-4b86-8edf-056f80b56a32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:55.260158 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e9697-e983-4b86-8edf-056f80b56a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:55.260158 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e9697-e983-4b86-8edf-056f80b56a32 admin admin] PATH_INFO: `/v3/projects/4b25c590b86a4000b93f22807cafe257/users/10f89229c06446a2910f2eb81fdd9d49/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:55.264651 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e9697-e983-4b86-8edf-056f80b56a32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b25c590b86a4000b93f22807cafe257, user_id=10f89229c06446a2910f2eb81fdd9d49, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:55.269132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e9697-e983-4b86-8edf-056f80b56a32 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:55.296546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 823/1644] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:26:55 2022] PUT /identity/v3/projects/4b25c590b86a4000b93f22807cafe257/users/10f89229c06446a2910f2eb81fdd9d49/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:26:55.299416 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e9697-e983-4b86-8edf-056f80b56a32 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:55.380987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 822/1645] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:55.382243 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34766dff-7092-4db7-8f10-77c2ff7c7f86 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:55.433243 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e9697-e983-4b86-8edf-056f80b56a32 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:55.442222 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0485d7-1aeb-41b7-8a65-fb3f6d49fdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:55.443024 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0485d7-1aeb-41b7-8a65-fb3f6d49fdfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:55.443376 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0485d7-1aeb-41b7-8a65-fb3f6d49fdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:55.443762 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0485d7-1aeb-41b7-8a65-fb3f6d49fdfb admin admin] PATH_INFO: `/v3/projects/d76d9cb70730465b9d7aab0b916457e4/users/d3c62da1106d4942916ec18be48410fe/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:55.480090 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0485d7-1aeb-41b7-8a65-fb3f6d49fdfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76d9cb70730465b9d7aab0b916457e4, user_id=d3c62da1106d4942916ec18be48410fe, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:55.483634 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0485d7-1aeb-41b7-8a65-fb3f6d49fdfb admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:55.485452 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34766dff-7092-4db7-8f10-77c2ff7c7f86 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:55.556787 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fed083-0d48-44ad-8a7d-81790b993636 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:55.557781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fed083-0d48-44ad-8a7d-81790b993636 service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:55.561588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fed083-0d48-44ad-8a7d-81790b993636 service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:55.562047 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fed083-0d48-44ad-8a7d-81790b993636 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:55.618256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 824/1646] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:26:55 2022] PUT /identity/v3/projects/d76d9cb70730465b9d7aab0b916457e4/users/d3c62da1106d4942916ec18be48410fe/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:26:55.620348 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d09ab7-fea4-4340-a8d1-3cdc6762b149 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:55.621288 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d09ab7-fea4-4340-a8d1-3cdc6762b149 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:55.621956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d09ab7-fea4-4340-a8d1-3cdc6762b149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:55.660418 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-69d09ab7-fea4-4340-a8d1-3cdc6762b149 None None] MFA Rules not processed for user `10f89229c06446a2910f2eb81fdd9d49`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:55.663054 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-69d09ab7-fea4-4340-a8d1-3cdc6762b149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:55.706910 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fed083-0d48-44ad-8a7d-81790b993636 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:55.713013 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fed083-0d48-44ad-8a7d-81790b993636 service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:55.752859 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 823/1647] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:26:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:26:55.754183 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fed083-0d48-44ad-8a7d-81790b993636 service cinder] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:55.771807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:55.776607 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fed083-0d48-44ad-8a7d-81790b993636 service cinder] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:55.782646 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 825/1648] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:55 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:55.783991 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d09ab7-fea4-4340-a8d1-3cdc6762b149 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:55.822582 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:55.874237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f8669-86ab-493c-84d3-2a023c3a9c33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:55.874918 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f8669-86ab-493c-84d3-2a023c3a9c33 service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:55.875204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f8669-86ab-493c-84d3-2a023c3a9c33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:55.875527 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f8669-86ab-493c-84d3-2a023c3a9c33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:55.939020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d09ab7-fea4-4340-a8d1-3cdc6762b149 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:55.951386 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0aff5-debc-4961-8c1f-664a2e117e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:55.952002 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0aff5-debc-4961-8c1f-664a2e117e01 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:55.952277 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0aff5-debc-4961-8c1f-664a2e117e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:55.952543 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0aff5-debc-4961-8c1f-664a2e117e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:55.953257 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0aff5-debc-4961-8c1f-664a2e117e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:55.954936 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0aff5-debc-4961-8c1f-664a2e117e01 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:55.960184 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f8669-86ab-493c-84d3-2a023c3a9c33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:55.962118 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f8669-86ab-493c-84d3-2a023c3a9c33 service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:55.986534 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 824/1649] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:26:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:26:55.989731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 826/1650] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:26:55.995032 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f8669-86ab-493c-84d3-2a023c3a9c33 service cinder] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:56.014851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f8669-86ab-493c-84d3-2a023c3a9c33 service cinder] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:56.032168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725297d-7baf-4dd6-ba0a-173f49ebe6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:56.032857 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725297d-7baf-4dd6-ba0a-173f49ebe6cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:56.033132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725297d-7baf-4dd6-ba0a-173f49ebe6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:56.033402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725297d-7baf-4dd6-ba0a-173f49ebe6cd admin admin] PATH_INFO: `/v3/projects/d76d9cb70730465b9d7aab0b916457e4/users/d3c62da1106d4942916ec18be48410fe/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:56.037148 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725297d-7baf-4dd6-ba0a-173f49ebe6cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76d9cb70730465b9d7aab0b916457e4, user_id=d3c62da1106d4942916ec18be48410fe, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:56.041310 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9725297d-7baf-4dd6-ba0a-173f49ebe6cd admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:56.059057 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 825/1651] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:26:55 2022] PUT /identity/v3/projects/d76d9cb70730465b9d7aab0b916457e4/users/d3c62da1106d4942916ec18be48410fe/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:26:56.195575 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0aff5-debc-4961-8c1f-664a2e117e01 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:56.218691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0aff5-debc-4961-8c1f-664a2e117e01 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:56.311767 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999c90c-3b0b-4f99-9f9e-0e7b88b9a6b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:56.312865 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999c90c-3b0b-4f99-9f9e-0e7b88b9a6b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:56.313992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999c90c-3b0b-4f99-9f9e-0e7b88b9a6b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:56.314528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999c90c-3b0b-4f99-9f9e-0e7b88b9a6b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:56.437999 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999c90c-3b0b-4f99-9f9e-0e7b88b9a6b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:56.440528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999c90c-3b0b-4f99-9f9e-0e7b88b9a6b0 service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:56.459802 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 827/1652] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:26:56 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:26:56.858243 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725297d-7baf-4dd6-ba0a-173f49ebe6cd admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:56.869120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725297d-7baf-4dd6-ba0a-173f49ebe6cd admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:56.873502 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e8f89-f417-4836-86d9-729afd301cb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:56.874142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e8f89-f417-4836-86d9-729afd301cb8 service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:56.874428 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e8f89-f417-4836-86d9-729afd301cb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:56.874706 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e8f89-f417-4836-86d9-729afd301cb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:56.905441 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:57.037081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e8f89-f417-4836-86d9-729afd301cb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:57.038680 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e8f89-f417-4836-86d9-729afd301cb8 service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:57.062412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 826/1653] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:26:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:26:57.444347 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999c90c-3b0b-4f99-9f9e-0e7b88b9a6b0 service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:57.485426 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:57.647308 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999c90c-3b0b-4f99-9f9e-0e7b88b9a6b0 service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:57.659831 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b09923-5a08-4839-84ef-03b019c18585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:57.661178 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b09923-5a08-4839-84ef-03b019c18585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:57.661466 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b09923-5a08-4839-84ef-03b019c18585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:57.661756 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b09923-5a08-4839-84ef-03b019c18585 admin admin] PATH_INFO: `/v3/users/91c90cdd3ee148f0ad7e92f788ac9f69` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:57.665738 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b09923-5a08-4839-84ef-03b019c18585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91c90cdd3ee148f0ad7e92f788ac9f69)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:57.666789 dv-cinder-847732-4-smb devstack@keystone.service[81847]: WARNING py.warnings [None req-82b09923-5a08-4839-84ef-03b019c18585 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 20:26:57.666789 dv-cinder-847732-4-smb devstack@keystone.service[81847]: warnings.warn(msg) Sep 06 20:26:57.666789 dv-cinder-847732-4-smb devstack@keystone.service[81847]: Sep 06 20:26:57.670846 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b09923-5a08-4839-84ef-03b019c18585 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:57.879019 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f36405-8909-4a0b-84bc-7c9fd79b9abb None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:57.880183 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f36405-8909-4a0b-84bc-7c9fd79b9abb None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:57.881910 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f36405-8909-4a0b-84bc-7c9fd79b9abb None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:57.888474 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 827/1654] 10.222.0.77 () {54 vars in 962 bytes} [Tue Sep 6 20:26:57 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:26:57.897168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0f133-550d-4dc2-af6d-378406974504 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:57.897693 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0f133-550d-4dc2-af6d-378406974504 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:57.898134 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0f133-550d-4dc2-af6d-378406974504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:57.928366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-59f0f133-550d-4dc2-af6d-378406974504 None None] MFA Rules not processed for user `b09ce16da49b4af38491ad4eb6287d70`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:57.930157 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-59f0f133-550d-4dc2-af6d-378406974504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:58.081121 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 828/1655] 10.222.0.77 () {58 vars in 1059 bytes} [Tue Sep 6 20:26:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:26:58.107295 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105ed16-804a-4e1a-a8f2-f0bd1c6a7d5c None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:58.108334 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105ed16-804a-4e1a-a8f2-f0bd1c6a7d5c None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:58.115150 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105ed16-804a-4e1a-a8f2-f0bd1c6a7d5c None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:58.124012 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 829/1656] 10.222.0.77 () {54 vars in 912 bytes} [Tue Sep 6 20:26:58 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:26:58.130072 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422de18-b1c0-42a9-8e7d-337847e06f41 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:58.130364 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422de18-b1c0-42a9-8e7d-337847e06f41 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:58.130664 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422de18-b1c0-42a9-8e7d-337847e06f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:58.164388 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-82b09923-5a08-4839-84ef-03b019c18585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91c90cdd3ee148f0ad7e92f788ac9f69'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:26:58.225583 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-e422de18-b1c0-42a9-8e7d-337847e06f41 None None] MFA Rules not processed for user `b09ce16da49b4af38491ad4eb6287d70`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:58.226882 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-e422de18-b1c0-42a9-8e7d-337847e06f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:58.262557 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 830/1657] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Sep 6 20:26:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:58.310205 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-82b09923-5a08-4839-84ef-03b019c18585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91c90cdd3ee148f0ad7e92f788ac9f69'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:26:58.311128 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-82b09923-5a08-4839-84ef-03b019c18585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91c90cdd3ee148f0ad7e92f788ac9f69'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:26:58.313838 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-82b09923-5a08-4839-84ef-03b019c18585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91c90cdd3ee148f0ad7e92f788ac9f69'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:26:58.367582 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-82b09923-5a08-4839-84ef-03b019c18585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91c90cdd3ee148f0ad7e92f788ac9f69'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:26:58.402037 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422de18-b1c0-42a9-8e7d-337847e06f41 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:58.456772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422de18-b1c0-42a9-8e7d-337847e06f41 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:58.473645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 828/1658] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:26:57 2022] DELETE /identity/v3/users/91c90cdd3ee148f0ad7e92f788ac9f69 => generated 0 bytes in 1030 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:26:58.475239 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b09923-5a08-4839-84ef-03b019c18585 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:58.477576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-82b09923-5a08-4839-84ef-03b019c18585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:58.487534 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6664d70-915b-4218-bbf9-57e08a32baf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:58.488543 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6664d70-915b-4218-bbf9-57e08a32baf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:58.488989 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6664d70-915b-4218-bbf9-57e08a32baf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:58.489463 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6664d70-915b-4218-bbf9-57e08a32baf9 admin admin] PATH_INFO: `/v3/users/71f874ddc9354f5b953739bd5fa08747` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:58.496725 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6664d70-915b-4218-bbf9-57e08a32baf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71f874ddc9354f5b953739bd5fa08747)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:58.500340 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6664d70-915b-4218-bbf9-57e08a32baf9 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:58.714912 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b09923-5a08-4839-84ef-03b019c18585 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:58.725026 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c67b4-d160-4971-9024-896fa6c9b471 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:58.725786 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c67b4-d160-4971-9024-896fa6c9b471 service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:58.728508 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c67b4-d160-4971-9024-896fa6c9b471 service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:58.728813 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c67b4-d160-4971-9024-896fa6c9b471 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:58.733233 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-e08c67b4-d160-4971-9024-896fa6c9b471 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:58.893155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c67b4-d160-4971-9024-896fa6c9b471 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:58.895224 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c67b4-d160-4971-9024-896fa6c9b471 service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:58.908614 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 829/1659] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:26:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:26:58.910307 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242345f-eaac-4dea-b1ea-4b291bf27c80 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:58.910594 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242345f-eaac-4dea-b1ea-4b291bf27c80 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:58.910865 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242345f-eaac-4dea-b1ea-4b291bf27c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:58.935473 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-9242345f-eaac-4dea-b1ea-4b291bf27c80 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:58.936742 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-9242345f-eaac-4dea-b1ea-4b291bf27c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:59.085160 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 830/1660] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:59.139708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242345f-eaac-4dea-b1ea-4b291bf27c80 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:59.141296 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-9242345f-eaac-4dea-b1ea-4b291bf27c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:59.190230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-b6664d70-915b-4218-bbf9-57e08a32baf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71f874ddc9354f5b953739bd5fa08747'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:26:59.242067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:59.294691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242345f-eaac-4dea-b1ea-4b291bf27c80 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:59.306843 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213078c-4dea-4114-8461-9d8a921d935a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:59.307889 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213078c-4dea-4114-8461-9d8a921d935a service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:59.307889 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213078c-4dea-4114-8461-9d8a921d935a service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:59.309602 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-b6664d70-915b-4218-bbf9-57e08a32baf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71f874ddc9354f5b953739bd5fa08747'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:26:59.309936 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213078c-4dea-4114-8461-9d8a921d935a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:59.310238 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-b6664d70-915b-4218-bbf9-57e08a32baf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71f874ddc9354f5b953739bd5fa08747'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:26:59.310909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-b6664d70-915b-4218-bbf9-57e08a32baf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71f874ddc9354f5b953739bd5fa08747'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:26:59.320337 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-b6664d70-915b-4218-bbf9-57e08a32baf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71f874ddc9354f5b953739bd5fa08747'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:26:59.324264 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-a213078c-4dea-4114-8461-9d8a921d935a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:59.369134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213078c-4dea-4114-8461-9d8a921d935a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:59.370678 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213078c-4dea-4114-8461-9d8a921d935a service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:59.391320 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 831/1661] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:26:58 2022] DELETE /identity/v3/users/71f874ddc9354f5b953739bd5fa08747 => generated 0 bytes in 985 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:26:59.391320 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c27649-fef2-4c36-93f1-4ae73a27406b None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:59.391320 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c27649-fef2-4c36-93f1-4ae73a27406b None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:59.391713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c27649-fef2-4c36-93f1-4ae73a27406b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:59.415291 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 831/1662] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:26:59.437136 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-92c27649-fef2-4c36-93f1-4ae73a27406b None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:26:59.438656 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-92c27649-fef2-4c36-93f1-4ae73a27406b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:59.500831 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:26:59.573376 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 832/1663] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:26:59.668671 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213078c-4dea-4114-8461-9d8a921d935a service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:26:59.670853 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-a213078c-4dea-4114-8461-9d8a921d935a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:26:59.697114 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213078c-4dea-4114-8461-9d8a921d935a service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:26:59.858120 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68996317-f2a1-41fe-8ff1-32ecbb9f4b30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:26:59.858774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68996317-f2a1-41fe-8ff1-32ecbb9f4b30 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:26:59.859059 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68996317-f2a1-41fe-8ff1-32ecbb9f4b30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:26:59.859390 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68996317-f2a1-41fe-8ff1-32ecbb9f4b30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:26:59.895250 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68996317-f2a1-41fe-8ff1-32ecbb9f4b30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:26:59.897959 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68996317-f2a1-41fe-8ff1-32ecbb9f4b30 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:26:59.927510 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 832/1664] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:00.941684 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c27649-fef2-4c36-93f1-4ae73a27406b None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:00.943226 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-92c27649-fef2-4c36-93f1-4ae73a27406b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:00.963504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c27649-fef2-4c36-93f1-4ae73a27406b None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:00.983200 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30979c8-ce5a-4072-b6f1-20396121ec6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:00.983901 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30979c8-ce5a-4072-b6f1-20396121ec6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:00.986402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30979c8-ce5a-4072-b6f1-20396121ec6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:00.986402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30979c8-ce5a-4072-b6f1-20396121ec6a admin admin] PATH_INFO: `/v3/projects/357a1ba81fe243a9ae76411a5a928479` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:00.986402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30979c8-ce5a-4072-b6f1-20396121ec6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=357a1ba81fe243a9ae76411a5a928479)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:00.988187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: WARNING py.warnings [None req-d30979c8-ce5a-4072-b6f1-20396121ec6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 20:27:00.988187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: warnings.warn(msg) Sep 06 20:27:00.988187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: Sep 06 20:27:00.990352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30979c8-ce5a-4072-b6f1-20396121ec6a admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:01.005200 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f3953-9cd2-4391-ad16-f9f8c1417ef6 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:01.006387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f3953-9cd2-4391-ad16-f9f8c1417ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:01.006935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f3953-9cd2-4391-ad16-f9f8c1417ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:01.106377 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-4d9f3953-9cd2-4391-ad16-f9f8c1417ef6 None None] MFA Rules not processed for user `d3c62da1106d4942916ec18be48410fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:01.107782 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-4d9f3953-9cd2-4391-ad16-f9f8c1417ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:01.292922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 833/1665] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:01 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:01.294472 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f3953-9cd2-4391-ad16-f9f8c1417ef6 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:01.300428 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-4d9f3953-9cd2-4391-ad16-f9f8c1417ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:01.311847 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d30979c8-ce5a-4072-b6f1-20396121ec6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '357a1ba81fe243a9ae76411a5a928479', 'request_id': 'req-d30979c8-ce5a-4072-b6f1-20396121ec6a'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:01.325336 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f3953-9cd2-4391-ad16-f9f8c1417ef6 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:01.413184 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d30979c8-ce5a-4072-b6f1-20396121ec6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '357a1ba81fe243a9ae76411a5a928479', 'request_id': 'req-d30979c8-ce5a-4072-b6f1-20396121ec6a'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:01.439746 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc053af0-f63d-4e7d-bc32-1a24406e5f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:01.441812 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc053af0-f63d-4e7d-bc32-1a24406e5f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:01.442376 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc053af0-f63d-4e7d-bc32-1a24406e5f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:01.442766 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc053af0-f63d-4e7d-bc32-1a24406e5f21 admin admin] PATH_INFO: `/v3/projects/cb68bc554b7f4508b16b82b5a001fe78` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:01.444331 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc053af0-f63d-4e7d-bc32-1a24406e5f21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb68bc554b7f4508b16b82b5a001fe78)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:01.448693 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc053af0-f63d-4e7d-bc32-1a24406e5f21 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:01.578575 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d30979c8-ce5a-4072-b6f1-20396121ec6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '357a1ba81fe243a9ae76411a5a928479', 'request_id': 'req-d30979c8-ce5a-4072-b6f1-20396121ec6a'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:01.600546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d30979c8-ce5a-4072-b6f1-20396121ec6a admin admin] The token cache is being invalidate because project 357a1ba81fe243a9ae76411a5a928479 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:27:01.600879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d30979c8-ce5a-4072-b6f1-20396121ec6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:01.604163 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d30979c8-ce5a-4072-b6f1-20396121ec6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:01.610062 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 833/1666] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:27:00 2022] DELETE /identity/v3/projects/357a1ba81fe243a9ae76411a5a928479 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:01.618932 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30979c8-ce5a-4072-b6f1-20396121ec6a admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:01.618932 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-d30979c8-ce5a-4072-b6f1-20396121ec6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:01.647884 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-cc053af0-f63d-4e7d-bc32-1a24406e5f21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb68bc554b7f4508b16b82b5a001fe78', 'request_id': 'req-cc053af0-f63d-4e7d-bc32-1a24406e5f21'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:01.651997 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30979c8-ce5a-4072-b6f1-20396121ec6a admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:01.684303 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-cc053af0-f63d-4e7d-bc32-1a24406e5f21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb68bc554b7f4508b16b82b5a001fe78', 'request_id': 'req-cc053af0-f63d-4e7d-bc32-1a24406e5f21'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:01.797414 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-cc053af0-f63d-4e7d-bc32-1a24406e5f21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb68bc554b7f4508b16b82b5a001fe78', 'request_id': 'req-cc053af0-f63d-4e7d-bc32-1a24406e5f21'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:01.819671 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-cc053af0-f63d-4e7d-bc32-1a24406e5f21 admin admin] The token cache is being invalidate because project cb68bc554b7f4508b16b82b5a001fe78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:27:01.822721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-cc053af0-f63d-4e7d-bc32-1a24406e5f21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:01.834340 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-cc053af0-f63d-4e7d-bc32-1a24406e5f21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:01.838689 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 834/1667] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:27:01 2022] DELETE /identity/v3/projects/cb68bc554b7f4508b16b82b5a001fe78 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:01.856038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc053af0-f63d-4e7d-bc32-1a24406e5f21 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:01.863851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76512b56-6eb4-4fa8-ba72-ec3449d4cd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:01.865153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76512b56-6eb4-4fa8-ba72-ec3449d4cd15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:01.878979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76512b56-6eb4-4fa8-ba72-ec3449d4cd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:01.879579 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76512b56-6eb4-4fa8-ba72-ec3449d4cd15 admin admin] PATH_INFO: `/v3/users/10f89229c06446a2910f2eb81fdd9d49` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:01.882166 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76512b56-6eb4-4fa8-ba72-ec3449d4cd15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10f89229c06446a2910f2eb81fdd9d49)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:01.884140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-cc053af0-f63d-4e7d-bc32-1a24406e5f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:01.885984 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76512b56-6eb4-4fa8-ba72-ec3449d4cd15 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:01.966568 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc053af0-f63d-4e7d-bc32-1a24406e5f21 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:01.988806 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51341aa4-36fe-499a-b0dd-b49fa07afeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:01.989634 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51341aa4-36fe-499a-b0dd-b49fa07afeea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:01.990910 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51341aa4-36fe-499a-b0dd-b49fa07afeea admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:01.991281 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51341aa4-36fe-499a-b0dd-b49fa07afeea admin admin] PATH_INFO: `/v3/users/12bc0f5d79e2415b830ae1f1d6616bfb` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:01.993629 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51341aa4-36fe-499a-b0dd-b49fa07afeea admin admin] RBAC: Authorizing `identity:delete_user(user_id=12bc0f5d79e2415b830ae1f1d6616bfb)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:01.996857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51341aa4-36fe-499a-b0dd-b49fa07afeea admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:02.165652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-76512b56-6eb4-4fa8-ba72-ec3449d4cd15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10f89229c06446a2910f2eb81fdd9d49'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:02.249868 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-76512b56-6eb4-4fa8-ba72-ec3449d4cd15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10f89229c06446a2910f2eb81fdd9d49'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:02.250893 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-76512b56-6eb4-4fa8-ba72-ec3449d4cd15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10f89229c06446a2910f2eb81fdd9d49'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:02.251712 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-76512b56-6eb4-4fa8-ba72-ec3449d4cd15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10f89229c06446a2910f2eb81fdd9d49'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:02.264149 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-76512b56-6eb4-4fa8-ba72-ec3449d4cd15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10f89229c06446a2910f2eb81fdd9d49'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:02.277766 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-51341aa4-36fe-499a-b0dd-b49fa07afeea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12bc0f5d79e2415b830ae1f1d6616bfb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:02.321341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 834/1668] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:27:01 2022] DELETE /identity/v3/users/10f89229c06446a2910f2eb81fdd9d49 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:02.373200 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-51341aa4-36fe-499a-b0dd-b49fa07afeea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12bc0f5d79e2415b830ae1f1d6616bfb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:02.374676 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-51341aa4-36fe-499a-b0dd-b49fa07afeea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12bc0f5d79e2415b830ae1f1d6616bfb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:02.376172 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-51341aa4-36fe-499a-b0dd-b49fa07afeea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12bc0f5d79e2415b830ae1f1d6616bfb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:02.389120 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-51341aa4-36fe-499a-b0dd-b49fa07afeea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12bc0f5d79e2415b830ae1f1d6616bfb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:02.447270 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 835/1669] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:27:01 2022] DELETE /identity/v3/users/12bc0f5d79e2415b830ae1f1d6616bfb => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:02.529409 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:02.809539 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:03.404744 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76512b56-6eb4-4fa8-ba72-ec3449d4cd15 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:03.406831 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-76512b56-6eb4-4fa8-ba72-ec3449d4cd15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:03.596546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:03.615533 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76512b56-6eb4-4fa8-ba72-ec3449d4cd15 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:03.690802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740d16a-c966-46da-9bb6-773faf2ffe9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:03.691737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740d16a-c966-46da-9bb6-773faf2ffe9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:03.692089 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740d16a-c966-46da-9bb6-773faf2ffe9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:03.692441 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740d16a-c966-46da-9bb6-773faf2ffe9e admin admin] PATH_INFO: `/v3/projects/4b25c590b86a4000b93f22807cafe257` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:03.693977 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740d16a-c966-46da-9bb6-773faf2ffe9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b25c590b86a4000b93f22807cafe257)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:03.696101 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740d16a-c966-46da-9bb6-773faf2ffe9e admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:03.953369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-a740d16a-c966-46da-9bb6-773faf2ffe9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b25c590b86a4000b93f22807cafe257', 'request_id': 'req-a740d16a-c966-46da-9bb6-773faf2ffe9e'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:03.974044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-a740d16a-c966-46da-9bb6-773faf2ffe9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b25c590b86a4000b93f22807cafe257', 'request_id': 'req-a740d16a-c966-46da-9bb6-773faf2ffe9e'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:04.096687 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-a740d16a-c966-46da-9bb6-773faf2ffe9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b25c590b86a4000b93f22807cafe257', 'request_id': 'req-a740d16a-c966-46da-9bb6-773faf2ffe9e'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:04.110967 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-a740d16a-c966-46da-9bb6-773faf2ffe9e admin admin] The token cache is being invalidate because project 4b25c590b86a4000b93f22807cafe257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:27:04.111259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-a740d16a-c966-46da-9bb6-773faf2ffe9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:04.114076 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-a740d16a-c966-46da-9bb6-773faf2ffe9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:04.119349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 835/1670] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:27:03 2022] DELETE /identity/v3/projects/4b25c590b86a4000b93f22807cafe257 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:04.125139 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e6c7c-e12c-46d7-8a76-32536ed3b366 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:04.125753 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e6c7c-e12c-46d7-8a76-32536ed3b366 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:04.126245 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e6c7c-e12c-46d7-8a76-32536ed3b366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:04.173072 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-f35e6c7c-e12c-46d7-8a76-32536ed3b366 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:04.174235 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f35e6c7c-e12c-46d7-8a76-32536ed3b366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:04.362568 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 836/1671] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:04.371960 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f20e13-0a4a-444b-9dcb-5cf3ab51fd13 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:04.373918 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f20e13-0a4a-444b-9dcb-5cf3ab51fd13 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:04.374557 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f20e13-0a4a-444b-9dcb-5cf3ab51fd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:04.427692 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-d4f20e13-0a4a-444b-9dcb-5cf3ab51fd13 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:04.430110 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-d4f20e13-0a4a-444b-9dcb-5cf3ab51fd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:04.453149 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 836/1672] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:04.457859 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e6c7c-e12c-46d7-8a76-32536ed3b366 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:04.469090 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e6c7c-e12c-46d7-8a76-32536ed3b366 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:04.480616 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfb9ed-d2c3-472b-93ef-617e07c3572b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:04.482589 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfb9ed-d2c3-472b-93ef-617e07c3572b admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:04.482589 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfb9ed-d2c3-472b-93ef-617e07c3572b admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:04.482589 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfb9ed-d2c3-472b-93ef-617e07c3572b admin admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:04.483817 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfb9ed-d2c3-472b-93ef-617e07c3572b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:27:04.487681 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfb9ed-d2c3-472b-93ef-617e07c3572b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:04.490096 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfb9ed-d2c3-472b-93ef-617e07c3572b admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:04.526119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f20e13-0a4a-444b-9dcb-5cf3ab51fd13 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:04.526315 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 837/1673] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:27:04.537004 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f20e13-0a4a-444b-9dcb-5cf3ab51fd13 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:04.544716 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e85f0f-8273-4358-9b4b-6dd15cb5e14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:04.545649 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e85f0f-8273-4358-9b4b-6dd15cb5e14f admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:04.546134 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e85f0f-8273-4358-9b4b-6dd15cb5e14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:04.546610 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e85f0f-8273-4358-9b4b-6dd15cb5e14f admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:04.547520 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e85f0f-8273-4358-9b4b-6dd15cb5e14f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:04.550429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e85f0f-8273-4358-9b4b-6dd15cb5e14f admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:04.707760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 837/1674] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:04 2022] POST /identity/v3/projects => generated 365 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:27:04.712406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfb9ed-d2c3-472b-93ef-617e07c3572b admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:04.729171 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfb9ed-d2c3-472b-93ef-617e07c3572b admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:04.849682 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edea169-297c-4928-98e1-2a400246c90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:04.853366 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edea169-297c-4928-98e1-2a400246c90f admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:04.853689 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edea169-297c-4928-98e1-2a400246c90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:04.853936 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edea169-297c-4928-98e1-2a400246c90f admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:04.855820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edea169-297c-4928-98e1-2a400246c90f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:04.872943 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edea169-297c-4928-98e1-2a400246c90f admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:04.889562 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e29fd-aa86-4598-9edb-522f05c346ac None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:04.890232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e29fd-aa86-4598-9edb-522f05c346ac None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:04.891057 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e29fd-aa86-4598-9edb-522f05c346ac None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:04.894466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 838/1675] 10.222.0.77 () {54 vars in 921 bytes} [Tue Sep 6 20:27:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:27:04.899998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f15db0-cebd-43da-8e32-e5405cc72494 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:04.901498 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f15db0-cebd-43da-8e32-e5405cc72494 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:04.902059 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f15db0-cebd-43da-8e32-e5405cc72494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:04.939536 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-36f15db0-cebd-43da-8e32-e5405cc72494 None None] MFA Rules not processed for user `2a486663ec144db0bbde6bf3deb35a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:04.943620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-36f15db0-cebd-43da-8e32-e5405cc72494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:05.047153 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 838/1676] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:04 2022] POST /identity/v3/users => generated 283 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:05.048033 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edea169-297c-4928-98e1-2a400246c90f admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:05.079389 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edea169-297c-4928-98e1-2a400246c90f admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:05.090265 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c9a6d-8a62-482e-a80b-9c75251300f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:05.090896 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c9a6d-8a62-482e-a80b-9c75251300f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:05.091221 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c9a6d-8a62-482e-a80b-9c75251300f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:05.091520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c9a6d-8a62-482e-a80b-9c75251300f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:05.092629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 839/1677] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Sep 6 20:27:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:27:05.093198 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c9a6d-8a62-482e-a80b-9c75251300f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:05.096658 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c9a6d-8a62-482e-a80b-9c75251300f7 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:05.110496 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 839/1678] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:05.115355 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f15db0-cebd-43da-8e32-e5405cc72494 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:05.137432 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f15db0-cebd-43da-8e32-e5405cc72494 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:05.163103 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7556ef6-c617-4938-9bb5-b835f3fd5de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:05.163845 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7556ef6-c617-4938-9bb5-b835f3fd5de7 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:05.164661 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7556ef6-c617-4938-9bb5-b835f3fd5de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:05.165375 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7556ef6-c617-4938-9bb5-b835f3fd5de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:05.166644 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7556ef6-c617-4938-9bb5-b835f3fd5de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:05.171291 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7556ef6-c617-4938-9bb5-b835f3fd5de7 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:05.181846 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c9a6d-8a62-482e-a80b-9c75251300f7 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:05.185104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-d93c9a6d-8a62-482e-a80b-9c75251300f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:05.215402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 840/1679] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:05.216875 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7556ef6-c617-4938-9bb5-b835f3fd5de7 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:05.221711 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c9a6d-8a62-482e-a80b-9c75251300f7 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:05.245589 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5da981-aacd-4aa4-9917-0191b7aa2aea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a486663ec144db0bbde6bf3deb35a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:05.246334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5da981-aacd-4aa4-9917-0191b7aa2aea service placement] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:05.246552 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5da981-aacd-4aa4-9917-0191b7aa2aea service placement] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:05.246991 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5da981-aacd-4aa4-9917-0191b7aa2aea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:05.271751 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5da981-aacd-4aa4-9917-0191b7aa2aea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:05.274642 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7556ef6-c617-4938-9bb5-b835f3fd5de7 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:05.279633 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5da981-aacd-4aa4-9917-0191b7aa2aea service placement] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:05.291794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357e397-6890-4411-955c-2c8b74bbef88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:05.292765 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357e397-6890-4411-955c-2c8b74bbef88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:05.295851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357e397-6890-4411-955c-2c8b74bbef88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:05.296428 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357e397-6890-4411-955c-2c8b74bbef88 admin admin] PATH_INFO: `/v3/projects/31d2f1ec63364b14a0b3b01bc7f4072f/users/351949b713174401925198d551813b21/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:05.316099 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 840/1680] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:05.342372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357e397-6890-4411-955c-2c8b74bbef88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d2f1ec63364b14a0b3b01bc7f4072f, user_id=351949b713174401925198d551813b21, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:05.345193 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357e397-6890-4411-955c-2c8b74bbef88 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:05.438266 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 841/1681] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:05 2022] PUT /identity/v3/projects/31d2f1ec63364b14a0b3b01bc7f4072f/users/351949b713174401925198d551813b21/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:05.449208 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d22057-3882-4a66-9c70-8cac2d29d49f None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:05.449666 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d22057-3882-4a66-9c70-8cac2d29d49f None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:05.449942 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d22057-3882-4a66-9c70-8cac2d29d49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:05.538226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-63d22057-3882-4a66-9c70-8cac2d29d49f None None] MFA Rules not processed for user `351949b713174401925198d551813b21`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:05.546435 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-63d22057-3882-4a66-9c70-8cac2d29d49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:05.795197 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 841/1682] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:05.800040 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357e397-6890-4411-955c-2c8b74bbef88 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:05.827067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d22057-3882-4a66-9c70-8cac2d29d49f None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:05.832254 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-63d22057-3882-4a66-9c70-8cac2d29d49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:06.019216 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357e397-6890-4411-955c-2c8b74bbef88 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:06.028205 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243f59d-fe1e-435f-8de5-25476ae36ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:06.031152 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243f59d-fe1e-435f-8de5-25476ae36ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:06.031686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243f59d-fe1e-435f-8de5-25476ae36ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:06.032712 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243f59d-fe1e-435f-8de5-25476ae36ba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:06.035841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243f59d-fe1e-435f-8de5-25476ae36ba3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:06.041224 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243f59d-fe1e-435f-8de5-25476ae36ba3 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:06.105472 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d22057-3882-4a66-9c70-8cac2d29d49f None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:06.125110 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d28d5-2c94-4ab9-9037-27def7b10213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:06.125902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d28d5-2c94-4ab9-9037-27def7b10213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:06.126182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d28d5-2c94-4ab9-9037-27def7b10213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:06.126463 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d28d5-2c94-4ab9-9037-27def7b10213 admin admin] PATH_INFO: `/v3/users/9928e2fc83c74816b3e0fdaab3a10976` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:06.128721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d28d5-2c94-4ab9-9037-27def7b10213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9928e2fc83c74816b3e0fdaab3a10976)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:06.132539 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d28d5-2c94-4ab9-9037-27def7b10213 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:06.276323 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:06.295118 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 842/1683] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:05 2022] POST /identity/v3/projects => generated 363 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:06.296797 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a366d-f230-4a69-be13-c7c611910656 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:06.297298 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a366d-f230-4a69-be13-c7c611910656 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:06.297739 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a366d-f230-4a69-be13-c7c611910656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:06.383722 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-4c7a366d-f230-4a69-be13-c7c611910656 None None] MFA Rules not processed for user `779846f3313940b388340f1794450e17`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:06.387471 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-4c7a366d-f230-4a69-be13-c7c611910656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:06.523509 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-510d28d5-2c94-4ab9-9037-27def7b10213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9928e2fc83c74816b3e0fdaab3a10976'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:06.583486 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 843/1684] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:06.583486 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a366d-f230-4a69-be13-c7c611910656 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:06.661260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-510d28d5-2c94-4ab9-9037-27def7b10213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9928e2fc83c74816b3e0fdaab3a10976'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:06.662423 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-510d28d5-2c94-4ab9-9037-27def7b10213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9928e2fc83c74816b3e0fdaab3a10976'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:06.664684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-510d28d5-2c94-4ab9-9037-27def7b10213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9928e2fc83c74816b3e0fdaab3a10976'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:06.693166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-510d28d5-2c94-4ab9-9037-27def7b10213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9928e2fc83c74816b3e0fdaab3a10976'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:06.721366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a366d-f230-4a69-be13-c7c611910656 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:06.735785 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e5925-3a1f-490a-ad0b-38bf828d8049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:06.736424 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e5925-3a1f-490a-ad0b-38bf828d8049 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:06.736705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e5925-3a1f-490a-ad0b-38bf828d8049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:06.736984 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e5925-3a1f-490a-ad0b-38bf828d8049 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:06.737628 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e5925-3a1f-490a-ad0b-38bf828d8049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:06.739785 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e5925-3a1f-490a-ad0b-38bf828d8049 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:06.748207 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 842/1685] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:27:05 2022] DELETE /identity/v3/users/9928e2fc83c74816b3e0fdaab3a10976 => generated 0 bytes in 922 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:06.752484 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d28d5-2c94-4ab9-9037-27def7b10213 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:06.755808 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-510d28d5-2c94-4ab9-9037-27def7b10213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:06.854065 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 844/1686] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:06 2022] POST /identity/v3/users => generated 288 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:06.854065 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e5925-3a1f-490a-ad0b-38bf828d8049 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:06.855214 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-253e5925-3a1f-490a-ad0b-38bf828d8049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:06.956631 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d28d5-2c94-4ab9-9037-27def7b10213 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:06.964688 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:06.975114 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78c513-4d3b-463d-b42c-4559d9719dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:06.975844 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78c513-4d3b-463d-b42c-4559d9719dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:06.979556 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78c513-4d3b-463d-b42c-4559d9719dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:06.979556 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78c513-4d3b-463d-b42c-4559d9719dbb admin admin] PATH_INFO: `/v3/projects/33cc65ddf1aa432ea47b7b1d42829cb5` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:06.979556 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78c513-4d3b-463d-b42c-4559d9719dbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=33cc65ddf1aa432ea47b7b1d42829cb5)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:06.980930 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78c513-4d3b-463d-b42c-4559d9719dbb admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:07.056555 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e5925-3a1f-490a-ad0b-38bf828d8049 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:07.144037 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9a78c513-4d3b-463d-b42c-4559d9719dbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33cc65ddf1aa432ea47b7b1d42829cb5', 'request_id': 'req-9a78c513-4d3b-463d-b42c-4559d9719dbb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:07.153925 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9a78c513-4d3b-463d-b42c-4559d9719dbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33cc65ddf1aa432ea47b7b1d42829cb5', 'request_id': 'req-9a78c513-4d3b-463d-b42c-4559d9719dbb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:07.219899 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9981a-0129-4d2f-84ae-4a9eec293c3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:07.220460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9981a-0129-4d2f-84ae-4a9eec293c3f service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:07.220786 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9981a-0129-4d2f-84ae-4a9eec293c3f service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:07.221057 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9981a-0129-4d2f-84ae-4a9eec293c3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:07.223221 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-14d9981a-0129-4d2f-84ae-4a9eec293c3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:07.246519 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9a78c513-4d3b-463d-b42c-4559d9719dbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33cc65ddf1aa432ea47b7b1d42829cb5', 'request_id': 'req-9a78c513-4d3b-463d-b42c-4559d9719dbb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:07.266755 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9a78c513-4d3b-463d-b42c-4559d9719dbb admin admin] The token cache is being invalidate because project 33cc65ddf1aa432ea47b7b1d42829cb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:27:07.267069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9a78c513-4d3b-463d-b42c-4559d9719dbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:07.271755 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9a78c513-4d3b-463d-b42c-4559d9719dbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:07.286805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 843/1687] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:27:06 2022] DELETE /identity/v3/projects/33cc65ddf1aa432ea47b7b1d42829cb5 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:07.286805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66de7f-7b7e-4eca-9d55-939d17e544cd None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:07.286805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66de7f-7b7e-4eca-9d55-939d17e544cd None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:07.286805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66de7f-7b7e-4eca-9d55-939d17e544cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:07.337861 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-ba66de7f-7b7e-4eca-9d55-939d17e544cd None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:07.339974 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-ba66de7f-7b7e-4eca-9d55-939d17e544cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:07.387313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9981a-0129-4d2f-84ae-4a9eec293c3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:07.395055 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9981a-0129-4d2f-84ae-4a9eec293c3f service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:07.427328 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 845/1688] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:07.436247 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 844/1689] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:07.439582 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66de7f-7b7e-4eca-9d55-939d17e544cd None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:07.441236 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-ba66de7f-7b7e-4eca-9d55-939d17e544cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:07.442431 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8324a0-081d-46f5-bcf8-c8bc53000ada None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:07.447564 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8324a0-081d-46f5-bcf8-c8bc53000ada None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:07.448419 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8324a0-081d-46f5-bcf8-c8bc53000ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:07.455890 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66de7f-7b7e-4eca-9d55-939d17e544cd None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:07.473751 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f01434-5f08-45e5-8c8e-9460a607ca00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:07.474892 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f01434-5f08-45e5-8c8e-9460a607ca00 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:07.475330 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f01434-5f08-45e5-8c8e-9460a607ca00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:07.475815 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f01434-5f08-45e5-8c8e-9460a607ca00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:07.476875 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f01434-5f08-45e5-8c8e-9460a607ca00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:07.478933 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f01434-5f08-45e5-8c8e-9460a607ca00 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:07.498894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 845/1690] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:07.502011 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8632d92-52e3-4950-91fe-80eec7b0902c None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:07.502011 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8632d92-52e3-4950-91fe-80eec7b0902c None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:07.502011 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8632d92-52e3-4950-91fe-80eec7b0902c None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:07.503387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 846/1691] 10.222.0.77 () {54 vars in 921 bytes} [Tue Sep 6 20:27:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:27:07.504384 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8632d92-52e3-4950-91fe-80eec7b0902c None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:07.519547 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-8f8324a0-081d-46f5-bcf8-c8bc53000ada None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:07.521099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-8f8324a0-081d-46f5-bcf8-c8bc53000ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:07.537607 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 846/1692] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:07.544006 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8324a0-081d-46f5-bcf8-c8bc53000ada None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:07.547411 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-8f8324a0-081d-46f5-bcf8-c8bc53000ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:07.547662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8632d92-52e3-4950-91fe-80eec7b0902c None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:07.557253 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb184d3-58ab-4a0b-937c-389e1cea82a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:07.558236 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb184d3-58ab-4a0b-937c-389e1cea82a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:07.558697 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb184d3-58ab-4a0b-937c-389e1cea82a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:07.559135 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb184d3-58ab-4a0b-937c-389e1cea82a9 admin admin] PATH_INFO: `/v3/projects/f479dbd2c5864982a45e9b57ec86b436/users/a739db51bc154f32a8611d6d987afbd6/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:07.596555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb184d3-58ab-4a0b-937c-389e1cea82a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f479dbd2c5864982a45e9b57ec86b436, user_id=a739db51bc154f32a8611d6d987afbd6, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:07.604325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb184d3-58ab-4a0b-937c-389e1cea82a9 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:07.713260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 847/1693] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:07 2022] PUT /identity/v3/projects/f479dbd2c5864982a45e9b57ec86b436/users/a739db51bc154f32a8611d6d987afbd6/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:07.714912 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6ebb4-9c33-41fe-8868-1eb8cee369d2 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:07.715208 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6ebb4-9c33-41fe-8868-1eb8cee369d2 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:07.715508 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6ebb4-9c33-41fe-8868-1eb8cee369d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:07.736427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8324a0-081d-46f5-bcf8-c8bc53000ada None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:07.775623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-43f6ebb4-9c33-41fe-8868-1eb8cee369d2 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:07.780095 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-43f6ebb4-9c33-41fe-8868-1eb8cee369d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:07.847567 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290b929-a49a-4670-9a24-dd063c841230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:07.848561 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290b929-a49a-4670-9a24-dd063c841230 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:07.848831 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290b929-a49a-4670-9a24-dd063c841230 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:07.849151 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290b929-a49a-4670-9a24-dd063c841230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:07.956884 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290b929-a49a-4670-9a24-dd063c841230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:07.959240 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290b929-a49a-4670-9a24-dd063c841230 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:08.000039 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 847/1694] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:08.000039 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6d672-06ec-4281-a683-b8a50f117e6a None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:08.000039 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6d672-06ec-4281-a683-b8a50f117e6a None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:08.000039 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6d672-06ec-4281-a683-b8a50f117e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:08.010585 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 848/1695] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:08.010585 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6ebb4-9c33-41fe-8868-1eb8cee369d2 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:08.045440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-45b6d672-06ec-4281-a683-b8a50f117e6a None None] MFA Rules not processed for user `2a486663ec144db0bbde6bf3deb35a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:08.046676 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-45b6d672-06ec-4281-a683-b8a50f117e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:08.048859 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6ebb4-9c33-41fe-8868-1eb8cee369d2 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:08.054716 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b380804-fd63-4eea-9c58-4ceeab4b277c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:08.078551 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b380804-fd63-4eea-9c58-4ceeab4b277c admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:08.080226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b380804-fd63-4eea-9c58-4ceeab4b277c admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:08.082244 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b380804-fd63-4eea-9c58-4ceeab4b277c admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:08.088189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b380804-fd63-4eea-9c58-4ceeab4b277c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:08.093211 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b380804-fd63-4eea-9c58-4ceeab4b277c admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:08.156208 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 849/1696] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:08.159849 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b380804-fd63-4eea-9c58-4ceeab4b277c admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:08.164792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-8b380804-fd63-4eea-9c58-4ceeab4b277c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:08.224186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b380804-fd63-4eea-9c58-4ceeab4b277c admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:08.240259 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651ec2b-9727-40c3-962a-dfaddefdd573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:08.241056 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651ec2b-9727-40c3-962a-dfaddefdd573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:08.241416 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651ec2b-9727-40c3-962a-dfaddefdd573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:08.241817 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651ec2b-9727-40c3-962a-dfaddefdd573 admin admin] PATH_INFO: `/v3/users/6e4cfd2fc39546358ccaaff19dcafceb` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:08.248238 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651ec2b-9727-40c3-962a-dfaddefdd573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e4cfd2fc39546358ccaaff19dcafceb)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:08.251746 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651ec2b-9727-40c3-962a-dfaddefdd573 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:08.298525 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 848/1697] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Sep 6 20:27:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:08.302730 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503c242-bc28-47bd-a488-ef008f47ab91 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:08.305473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503c242-bc28-47bd-a488-ef008f47ab91 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:08.307184 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503c242-bc28-47bd-a488-ef008f47ab91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:08.411801 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-4503c242-bc28-47bd-a488-ef008f47ab91 None None] MFA Rules not processed for user `b4543538509341ca9f6428538861d990`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:08.414157 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-4503c242-bc28-47bd-a488-ef008f47ab91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:08.580818 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c651ec2b-9727-40c3-962a-dfaddefdd573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e4cfd2fc39546358ccaaff19dcafceb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:08.623538 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 849/1698] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:08.624535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503c242-bc28-47bd-a488-ef008f47ab91 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:08.659974 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503c242-bc28-47bd-a488-ef008f47ab91 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:08.677661 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ca970-f196-4cf5-93f2-ce508cb8be0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:08.678323 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ca970-f196-4cf5-93f2-ce508cb8be0d admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:08.678608 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ca970-f196-4cf5-93f2-ce508cb8be0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:08.680591 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ca970-f196-4cf5-93f2-ce508cb8be0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:08.681365 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ca970-f196-4cf5-93f2-ce508cb8be0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:27:08.681683 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ca970-f196-4cf5-93f2-ce508cb8be0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:08.685995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ca970-f196-4cf5-93f2-ce508cb8be0d admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:08.715606 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 850/1699] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:27:08.720018 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ca970-f196-4cf5-93f2-ce508cb8be0d admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:08.734766 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c651ec2b-9727-40c3-962a-dfaddefdd573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e4cfd2fc39546358ccaaff19dcafceb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:08.735592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c651ec2b-9727-40c3-962a-dfaddefdd573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e4cfd2fc39546358ccaaff19dcafceb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:08.737508 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c651ec2b-9727-40c3-962a-dfaddefdd573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e4cfd2fc39546358ccaaff19dcafceb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:08.748317 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ca970-f196-4cf5-93f2-ce508cb8be0d admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:08.751638 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c651ec2b-9727-40c3-962a-dfaddefdd573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e4cfd2fc39546358ccaaff19dcafceb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:08.764747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3aafb-2d77-4d55-8f9a-b31ff727f32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:08.766896 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3aafb-2d77-4d55-8f9a-b31ff727f32b admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:08.767377 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3aafb-2d77-4d55-8f9a-b31ff727f32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:08.767701 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3aafb-2d77-4d55-8f9a-b31ff727f32b admin admin] PATH_INFO: `/v3/projects/f479dbd2c5864982a45e9b57ec86b436/users/a739db51bc154f32a8611d6d987afbd6/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:08.774007 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3aafb-2d77-4d55-8f9a-b31ff727f32b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f479dbd2c5864982a45e9b57ec86b436, user_id=a739db51bc154f32a8611d6d987afbd6, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:08.778031 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3aafb-2d77-4d55-8f9a-b31ff727f32b admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:08.799011 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 851/1700] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:08 2022] PUT /identity/v3/projects/f479dbd2c5864982a45e9b57ec86b436/users/a739db51bc154f32a8611d6d987afbd6/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:08.800384 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3aafb-2d77-4d55-8f9a-b31ff727f32b admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:08.800573 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 850/1701] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:27:08 2022] DELETE /identity/v3/users/6e4cfd2fc39546358ccaaff19dcafceb => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:08.802716 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-68f3aafb-2d77-4d55-8f9a-b31ff727f32b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:08.802979 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98a923-e1f0-4d31-b690-4d4dbdbe6abb None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:08.803392 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98a923-e1f0-4d31-b690-4d4dbdbe6abb None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:08.803886 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98a923-e1f0-4d31-b690-4d4dbdbe6abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:08.846619 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-cf98a923-e1f0-4d31-b690-4d4dbdbe6abb None None] MFA Rules not processed for user `b4543538509341ca9f6428538861d990`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:08.855114 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-cf98a923-e1f0-4d31-b690-4d4dbdbe6abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:08.966916 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3aafb-2d77-4d55-8f9a-b31ff727f32b admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:08.994112 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 851/1702] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:08.996482 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98a923-e1f0-4d31-b690-4d4dbdbe6abb None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:09.017091 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-cf98a923-e1f0-4d31-b690-4d4dbdbe6abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:09.173633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77ebcc-04bd-4a97-894b-7f03eace43e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a486663ec144db0bbde6bf3deb35a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:09.174585 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77ebcc-04bd-4a97-894b-7f03eace43e6 service placement] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:09.175015 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77ebcc-04bd-4a97-894b-7f03eace43e6 service placement] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:09.175519 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77ebcc-04bd-4a97-894b-7f03eace43e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:09.180117 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-0f77ebcc-04bd-4a97-894b-7f03eace43e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:09.201832 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98a923-e1f0-4d31-b690-4d4dbdbe6abb None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:09.207037 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:09.209655 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385b87f-c0fa-4c81-9d21-dbb4bd3d5018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:09.211678 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385b87f-c0fa-4c81-9d21-dbb4bd3d5018 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:09.212129 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385b87f-c0fa-4c81-9d21-dbb4bd3d5018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:09.212598 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385b87f-c0fa-4c81-9d21-dbb4bd3d5018 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:09.213306 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385b87f-c0fa-4c81-9d21-dbb4bd3d5018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:09.217474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385b87f-c0fa-4c81-9d21-dbb4bd3d5018 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:09.227376 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77ebcc-04bd-4a97-894b-7f03eace43e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:09.234349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77ebcc-04bd-4a97-894b-7f03eace43e6 service placement] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:09.263520 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 852/1703] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:09.268632 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531bb07-9537-4065-b8f9-54761c58120e None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:09.271831 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531bb07-9537-4065-b8f9-54761c58120e None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:09.272565 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531bb07-9537-4065-b8f9-54761c58120e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:09.340477 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-a531bb07-9537-4065-b8f9-54761c58120e None None] MFA Rules not processed for user `a739db51bc154f32a8611d6d987afbd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:09.341920 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-a531bb07-9537-4065-b8f9-54761c58120e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:09.450964 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 853/1704] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:09.450964 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531bb07-9537-4065-b8f9-54761c58120e None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:09.457433 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-a531bb07-9537-4065-b8f9-54761c58120e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:09.504613 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 852/1705] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:08 2022] POST /identity/v3/projects => generated 369 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:09.505787 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385b87f-c0fa-4c81-9d21-dbb4bd3d5018 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:09.511835 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c385b87f-c0fa-4c81-9d21-dbb4bd3d5018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:09.564510 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531bb07-9537-4065-b8f9-54761c58120e None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:09.584465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:09.687353 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385b87f-c0fa-4c81-9d21-dbb4bd3d5018 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:09.694740 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d25fb-768c-48e4-9d48-6a5ebebd183c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:09.697385 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d25fb-768c-48e4-9d48-6a5ebebd183c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:09.697385 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d25fb-768c-48e4-9d48-6a5ebebd183c admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:09.697385 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d25fb-768c-48e4-9d48-6a5ebebd183c admin admin] PATH_INFO: `/v3/projects/fd3ab16657274855a9061942ab064ab5` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:09.701050 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d25fb-768c-48e4-9d48-6a5ebebd183c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd3ab16657274855a9061942ab064ab5)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:09.703723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d25fb-768c-48e4-9d48-6a5ebebd183c admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:09.725170 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1a116-49cd-46a0-a7b7-cdfb3faa1c30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:09.731984 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1a116-49cd-46a0-a7b7-cdfb3faa1c30 service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:09.731984 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1a116-49cd-46a0-a7b7-cdfb3faa1c30 service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:09.731984 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1a116-49cd-46a0-a7b7-cdfb3faa1c30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:09.731984 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-20a1a116-49cd-46a0-a7b7-cdfb3faa1c30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:09.845360 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1a116-49cd-46a0-a7b7-cdfb3faa1c30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:09.847524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1a116-49cd-46a0-a7b7-cdfb3faa1c30 service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:09.859909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 854/1706] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:09.860688 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1a116-49cd-46a0-a7b7-cdfb3faa1c30 service nova] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:09.862228 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-20a1a116-49cd-46a0-a7b7-cdfb3faa1c30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:09.919599 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-834d25fb-768c-48e4-9d48-6a5ebebd183c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd3ab16657274855a9061942ab064ab5', 'request_id': 'req-834d25fb-768c-48e4-9d48-6a5ebebd183c'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:09.939227 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-834d25fb-768c-48e4-9d48-6a5ebebd183c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd3ab16657274855a9061942ab064ab5', 'request_id': 'req-834d25fb-768c-48e4-9d48-6a5ebebd183c'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:09.962170 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1a116-49cd-46a0-a7b7-cdfb3faa1c30 service nova] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:10.099290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a8386-1c50-4df4-8fe7-cde4298f2d2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:10.101106 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a8386-1c50-4df4-8fe7-cde4298f2d2c service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:10.101106 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a8386-1c50-4df4-8fe7-cde4298f2d2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:10.101989 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a8386-1c50-4df4-8fe7-cde4298f2d2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:10.112350 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-834d25fb-768c-48e4-9d48-6a5ebebd183c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd3ab16657274855a9061942ab064ab5', 'request_id': 'req-834d25fb-768c-48e4-9d48-6a5ebebd183c'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:10.136370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-834d25fb-768c-48e4-9d48-6a5ebebd183c admin admin] The token cache is being invalidate because project fd3ab16657274855a9061942ab064ab5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:27:10.137072 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-834d25fb-768c-48e4-9d48-6a5ebebd183c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:10.140717 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-834d25fb-768c-48e4-9d48-6a5ebebd183c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:10.144652 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 853/1707] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:27:09 2022] DELETE /identity/v3/projects/fd3ab16657274855a9061942ab064ab5 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:10.145638 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d25fb-768c-48e4-9d48-6a5ebebd183c admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:10.158226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-834d25fb-768c-48e4-9d48-6a5ebebd183c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:10.317852 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a8386-1c50-4df4-8fe7-cde4298f2d2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:10.317852 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a8386-1c50-4df4-8fe7-cde4298f2d2c service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:10.345636 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 855/1708] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:10.346519 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a8386-1c50-4df4-8fe7-cde4298f2d2c service cinder] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:10.349670 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ed4a8386-1c50-4df4-8fe7-cde4298f2d2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:10.359764 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d25fb-768c-48e4-9d48-6a5ebebd183c admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:10.374527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db23406-a625-487b-8861-796019587765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:10.375164 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db23406-a625-487b-8861-796019587765 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:10.375473 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db23406-a625-487b-8861-796019587765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:10.375763 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db23406-a625-487b-8861-796019587765 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:10.376880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db23406-a625-487b-8861-796019587765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:10.380328 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a8386-1c50-4df4-8fe7-cde4298f2d2c service cinder] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:10.381237 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db23406-a625-487b-8861-796019587765 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:10.394911 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9646be-77f0-432f-b0f6-1de55f00239e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:10.403385 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9646be-77f0-432f-b0f6-1de55f00239e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:10.403797 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9646be-77f0-432f-b0f6-1de55f00239e admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:10.404194 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9646be-77f0-432f-b0f6-1de55f00239e admin admin] PATH_INFO: `/v3/projects/2f5425e3f6c24925825d8cfcc9ff3a54` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:10.407299 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9646be-77f0-432f-b0f6-1de55f00239e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f5425e3f6c24925825d8cfcc9ff3a54)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:10.412573 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9646be-77f0-432f-b0f6-1de55f00239e admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:10.540256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 854/1709] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:10 2022] POST /identity/v3/users => generated 285 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:10.541560 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934beaf-b42d-4ac8-b6d7-b89b1fb7ceca None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:10.542027 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934beaf-b42d-4ac8-b6d7-b89b1fb7ceca None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:10.542295 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934beaf-b42d-4ac8-b6d7-b89b1fb7ceca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:10.615639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-a934beaf-b42d-4ac8-b6d7-b89b1fb7ceca None None] MFA Rules not processed for user `2e7cc9c938214193b922ab1bc8288a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:10.625923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-a934beaf-b42d-4ac8-b6d7-b89b1fb7ceca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:10.654049 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-eb9646be-77f0-432f-b0f6-1de55f00239e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f5425e3f6c24925825d8cfcc9ff3a54', 'request_id': 'req-eb9646be-77f0-432f-b0f6-1de55f00239e'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:10.669902 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-eb9646be-77f0-432f-b0f6-1de55f00239e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f5425e3f6c24925825d8cfcc9ff3a54', 'request_id': 'req-eb9646be-77f0-432f-b0f6-1de55f00239e'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:10.770537 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 855/1710] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:10.772388 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e053e3a-4821-4677-a7b5-79fdb5d7648b None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:10.772858 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e053e3a-4821-4677-a7b5-79fdb5d7648b None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:10.773311 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e053e3a-4821-4677-a7b5-79fdb5d7648b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:10.801072 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-8e053e3a-4821-4677-a7b5-79fdb5d7648b None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:10.802800 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-8e053e3a-4821-4677-a7b5-79fdb5d7648b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:10.835108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-eb9646be-77f0-432f-b0f6-1de55f00239e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f5425e3f6c24925825d8cfcc9ff3a54', 'request_id': 'req-eb9646be-77f0-432f-b0f6-1de55f00239e'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:10.878673 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-eb9646be-77f0-432f-b0f6-1de55f00239e admin admin] The token cache is being invalidate because project 2f5425e3f6c24925825d8cfcc9ff3a54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:27:10.879298 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-eb9646be-77f0-432f-b0f6-1de55f00239e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:10.881484 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-eb9646be-77f0-432f-b0f6-1de55f00239e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:10.887834 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 856/1711] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:27:10 2022] DELETE /identity/v3/projects/2f5425e3f6c24925825d8cfcc9ff3a54 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:10.889017 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9646be-77f0-432f-b0f6-1de55f00239e admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:10.898860 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-eb9646be-77f0-432f-b0f6-1de55f00239e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:10.966932 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 856/1712] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:10.979722 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e053e3a-4821-4677-a7b5-79fdb5d7648b None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:10.985120 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-8e053e3a-4821-4677-a7b5-79fdb5d7648b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:11.036347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9646be-77f0-432f-b0f6-1de55f00239e admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:11.044198 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8399db-8f5d-435c-aaef-64795f1a8cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:11.046476 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8399db-8f5d-435c-aaef-64795f1a8cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:11.046476 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8399db-8f5d-435c-aaef-64795f1a8cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:11.046476 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8399db-8f5d-435c-aaef-64795f1a8cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:11.046476 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8399db-8f5d-435c-aaef-64795f1a8cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:11.051763 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8399db-8f5d-435c-aaef-64795f1a8cc8 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:11.080318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 857/1713] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:11.082332 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65d87a-77c3-4b50-bb4e-7efd3b7e9a8e None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:11.082893 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65d87a-77c3-4b50-bb4e-7efd3b7e9a8e None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:11.083516 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65d87a-77c3-4b50-bb4e-7efd3b7e9a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:11.112617 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-bc65d87a-77c3-4b50-bb4e-7efd3b7e9a8e None None] MFA Rules not processed for user `2e7cc9c938214193b922ab1bc8288a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:11.115276 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-bc65d87a-77c3-4b50-bb4e-7efd3b7e9a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:11.133017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e053e3a-4821-4677-a7b5-79fdb5d7648b None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:11.136346 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 858/1714] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:11.138751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e7cf8-af39-4dc4-9f1e-a24bb8e31720 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:11.139207 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e7cf8-af39-4dc4-9f1e-a24bb8e31720 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:11.141282 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e7cf8-af39-4dc4-9f1e-a24bb8e31720 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:11.143978 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62297ae6-1612-45da-b5b0-6bda5f114ca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:11.145808 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62297ae6-1612-45da-b5b0-6bda5f114ca4 service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:11.146325 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 859/1715] 10.222.0.77 () {54 vars in 912 bytes} [Tue Sep 6 20:27:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:27:11.147906 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62297ae6-1612-45da-b5b0-6bda5f114ca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:11.148686 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62297ae6-1612-45da-b5b0-6bda5f114ca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:11.151653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-62297ae6-1612-45da-b5b0-6bda5f114ca4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:11.153974 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e7cf8-af39-4dc4-9f1e-a24bb8e31720 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:11.157425 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-e80e7cf8-af39-4dc4-9f1e-a24bb8e31720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:11.183229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e7cf8-af39-4dc4-9f1e-a24bb8e31720 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:11.195122 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c89b4b-1897-4219-ab32-11d05b504b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:11.197164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c89b4b-1897-4219-ab32-11d05b504b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:11.198535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c89b4b-1897-4219-ab32-11d05b504b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:11.199572 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c89b4b-1897-4219-ab32-11d05b504b8a admin admin] PATH_INFO: `/v3/users/d3c62da1106d4942916ec18be48410fe` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:11.203333 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c89b4b-1897-4219-ab32-11d05b504b8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3c62da1106d4942916ec18be48410fe)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:11.209810 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c89b4b-1897-4219-ab32-11d05b504b8a admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:11.259359 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62297ae6-1612-45da-b5b0-6bda5f114ca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:11.267969 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62297ae6-1612-45da-b5b0-6bda5f114ca4 service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:11.311875 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 857/1716] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:11.311875 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb26644-2188-444b-aa5c-8de523fac8ab None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:11.311875 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb26644-2188-444b-aa5c-8de523fac8ab None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:11.311875 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb26644-2188-444b-aa5c-8de523fac8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:11.387583 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-4eb26644-2188-444b-aa5c-8de523fac8ab None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:11.391216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-4eb26644-2188-444b-aa5c-8de523fac8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:11.406703 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 858/1717] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:11.412376 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb26644-2188-444b-aa5c-8de523fac8ab None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:11.443196 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb26644-2188-444b-aa5c-8de523fac8ab None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:11.454411 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2196f5-18d3-44be-b78f-27ee41ab7aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:11.455611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2196f5-18d3-44be-b78f-27ee41ab7aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:11.456466 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2196f5-18d3-44be-b78f-27ee41ab7aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:11.456613 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2196f5-18d3-44be-b78f-27ee41ab7aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:11.457841 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2196f5-18d3-44be-b78f-27ee41ab7aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:11.464611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2196f5-18d3-44be-b78f-27ee41ab7aa1 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:11.502592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 859/1718] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:11 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:11.502592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2196f5-18d3-44be-b78f-27ee41ab7aa1 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:11.508961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-bd2196f5-18d3-44be-b78f-27ee41ab7aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:11.520092 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-e2c89b4b-1897-4219-ab32-11d05b504b8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3c62da1106d4942916ec18be48410fe'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:11.627748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-e2c89b4b-1897-4219-ab32-11d05b504b8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3c62da1106d4942916ec18be48410fe'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:11.628889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-e2c89b4b-1897-4219-ab32-11d05b504b8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3c62da1106d4942916ec18be48410fe'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:11.629531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-e2c89b4b-1897-4219-ab32-11d05b504b8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3c62da1106d4942916ec18be48410fe'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:11.635755 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2196f5-18d3-44be-b78f-27ee41ab7aa1 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:11.646693 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-e2c89b4b-1897-4219-ab32-11d05b504b8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3c62da1106d4942916ec18be48410fe'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:11.649652 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e47f5-f7d7-4974-9b1b-684511bcd71d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:11.650698 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e47f5-f7d7-4974-9b1b-684511bcd71d service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:11.653876 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e47f5-f7d7-4974-9b1b-684511bcd71d service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:11.654524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e47f5-f7d7-4974-9b1b-684511bcd71d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:11.659308 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-0f7e47f5-f7d7-4974-9b1b-684511bcd71d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:11.691370 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 860/1719] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:27:11 2022] DELETE /identity/v3/users/d3c62da1106d4942916ec18be48410fe => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:11.691595 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e47f5-f7d7-4974-9b1b-684511bcd71d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:11.692477 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9514b6c-d488-4920-99a5-8de2d8092f76 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:11.694005 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e47f5-f7d7-4974-9b1b-684511bcd71d service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:11.694434 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9514b6c-d488-4920-99a5-8de2d8092f76 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:11.694862 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9514b6c-d488-4920-99a5-8de2d8092f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:11.720401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 860/1720] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:11 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:11.723847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e47f5-f7d7-4974-9b1b-684511bcd71d service nova] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:11.727098 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-0f7e47f5-f7d7-4974-9b1b-684511bcd71d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:11.752184 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e47f5-f7d7-4974-9b1b-684511bcd71d service nova] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:11.768754 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-a9514b6c-d488-4920-99a5-8de2d8092f76 None None] MFA Rules not processed for user `5a876d70d9634bf59af5f138e856f75f`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:11.770025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-a9514b6c-d488-4920-99a5-8de2d8092f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:11.864150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003fd22-213c-46c6-ba9d-3f653c2ed69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:11.864923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003fd22-213c-46c6-ba9d-3f653c2ed69f admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:11.865419 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003fd22-213c-46c6-ba9d-3f653c2ed69f admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:11.865915 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003fd22-213c-46c6-ba9d-3f653c2ed69f admin admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:11.866683 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003fd22-213c-46c6-ba9d-3f653c2ed69f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:27:11.867965 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003fd22-213c-46c6-ba9d-3f653c2ed69f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:11.871559 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003fd22-213c-46c6-ba9d-3f653c2ed69f admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:11.904478 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 861/1721] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:27:11.904478 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003fd22-213c-46c6-ba9d-3f653c2ed69f admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:11.904478 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-b003fd22-213c-46c6-ba9d-3f653c2ed69f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:11.922354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003fd22-213c-46c6-ba9d-3f653c2ed69f admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:11.934648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6b671-2c98-49bd-9093-3c26407b9f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:11.940560 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6b671-2c98-49bd-9093-3c26407b9f26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:11.940858 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6b671-2c98-49bd-9093-3c26407b9f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:11.941150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6b671-2c98-49bd-9093-3c26407b9f26 admin admin] PATH_INFO: `/v3/projects/5c1a4423c3054d22b260baef13434c4e/users/d80e0987324c42ad8cd8ff4631d721cc/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:11.959572 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 861/1722] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Sep 6 20:27:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:11.960934 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9514b6c-d488-4920-99a5-8de2d8092f76 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:11.990858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9514b6c-d488-4920-99a5-8de2d8092f76 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:11.991666 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6b671-2c98-49bd-9093-3c26407b9f26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c1a4423c3054d22b260baef13434c4e, user_id=d80e0987324c42ad8cd8ff4631d721cc, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:12.001158 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6b671-2c98-49bd-9093-3c26407b9f26 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:12.002966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56601516-2e81-4fc0-97b9-9e86c3121451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:12.003739 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56601516-2e81-4fc0-97b9-9e86c3121451 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:12.006892 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56601516-2e81-4fc0-97b9-9e86c3121451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:12.007478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56601516-2e81-4fc0-97b9-9e86c3121451 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:12.009256 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56601516-2e81-4fc0-97b9-9e86c3121451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:12.017899 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56601516-2e81-4fc0-97b9-9e86c3121451 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:12.154643 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 862/1723] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:11 2022] PUT /identity/v3/projects/5c1a4423c3054d22b260baef13434c4e/users/d80e0987324c42ad8cd8ff4631d721cc/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:12.159989 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6b671-2c98-49bd-9093-3c26407b9f26 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:12.167549 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-e7d6b671-2c98-49bd-9093-3c26407b9f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:12.217619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 862/1724] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:11 2022] POST /identity/v3/projects => generated 377 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:12.219407 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56601516-2e81-4fc0-97b9-9e86c3121451 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:12.222233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-56601516-2e81-4fc0-97b9-9e86c3121451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:12.400416 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6b671-2c98-49bd-9093-3c26407b9f26 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:12.412653 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56601516-2e81-4fc0-97b9-9e86c3121451 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:12.428181 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724cd8c-b4a7-4874-9bd0-55668d49d87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:12.428944 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724cd8c-b4a7-4874-9bd0-55668d49d87c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:12.429942 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724cd8c-b4a7-4874-9bd0-55668d49d87c admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:12.430308 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724cd8c-b4a7-4874-9bd0-55668d49d87c admin admin] PATH_INFO: `/v3/projects/d76d9cb70730465b9d7aab0b916457e4` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:12.444796 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724cd8c-b4a7-4874-9bd0-55668d49d87c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d76d9cb70730465b9d7aab0b916457e4)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:12.446873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724cd8c-b4a7-4874-9bd0-55668d49d87c admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:12.538126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf13b5-05a3-4e55-81bd-7880efe58275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:12.539988 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf13b5-05a3-4e55-81bd-7880efe58275 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:12.541742 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf13b5-05a3-4e55-81bd-7880efe58275 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:12.542175 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf13b5-05a3-4e55-81bd-7880efe58275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:12.563684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf13b5-05a3-4e55-81bd-7880efe58275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:12.566007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf13b5-05a3-4e55-81bd-7880efe58275 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:12.599594 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1724cd8c-b4a7-4874-9bd0-55668d49d87c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd76d9cb70730465b9d7aab0b916457e4', 'request_id': 'req-1724cd8c-b4a7-4874-9bd0-55668d49d87c'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:12.605185 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 863/1725] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:12.611187 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a973d-795a-4924-8c69-fc3546526b9a None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:12.611398 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:12.611729 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a973d-795a-4924-8c69-fc3546526b9a None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:12.612156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a973d-795a-4924-8c69-fc3546526b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:12.612630 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1724cd8c-b4a7-4874-9bd0-55668d49d87c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd76d9cb70730465b9d7aab0b916457e4', 'request_id': 'req-1724cd8c-b4a7-4874-9bd0-55668d49d87c'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:12.672526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-e48a973d-795a-4924-8c69-fc3546526b9a None None] MFA Rules not processed for user `d80e0987324c42ad8cd8ff4631d721cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:12.676637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-e48a973d-795a-4924-8c69-fc3546526b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:12.732158 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1724cd8c-b4a7-4874-9bd0-55668d49d87c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd76d9cb70730465b9d7aab0b916457e4', 'request_id': 'req-1724cd8c-b4a7-4874-9bd0-55668d49d87c'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:12.759715 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1724cd8c-b4a7-4874-9bd0-55668d49d87c admin admin] The token cache is being invalidate because project d76d9cb70730465b9d7aab0b916457e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:27:12.762570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1724cd8c-b4a7-4874-9bd0-55668d49d87c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:12.762570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1724cd8c-b4a7-4874-9bd0-55668d49d87c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:12.766164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 863/1726] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:27:12 2022] DELETE /identity/v3/projects/d76d9cb70730465b9d7aab0b916457e4 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:12.768764 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724cd8c-b4a7-4874-9bd0-55668d49d87c admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:12.771528 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-1724cd8c-b4a7-4874-9bd0-55668d49d87c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:12.859061 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 864/1727] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:12.861450 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac2bda-22bd-42e7-bf9e-78713f9bed56 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:12.862559 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac2bda-22bd-42e7-bf9e-78713f9bed56 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:12.863283 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac2bda-22bd-42e7-bf9e-78713f9bed56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:12.952248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-23ac2bda-22bd-42e7-bf9e-78713f9bed56 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:12.957150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-23ac2bda-22bd-42e7-bf9e-78713f9bed56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:12.977269 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724cd8c-b4a7-4874-9bd0-55668d49d87c admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:12.991305 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462e8f8-c535-40e4-ab9a-d24e9ad27c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:12.992006 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 865/1728] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:12.993545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac2bda-22bd-42e7-bf9e-78713f9bed56 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:12.994213 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462e8f8-c535-40e4-ab9a-d24e9ad27c81 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:12.994702 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462e8f8-c535-40e4-ab9a-d24e9ad27c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:12.995151 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462e8f8-c535-40e4-ab9a-d24e9ad27c81 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:12.997883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-23ac2bda-22bd-42e7-bf9e-78713f9bed56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:12.998306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462e8f8-c535-40e4-ab9a-d24e9ad27c81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:13.005304 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462e8f8-c535-40e4-ab9a-d24e9ad27c81 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:13.037071 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac2bda-22bd-42e7-bf9e-78713f9bed56 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:13.045149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91902335-524c-4f03-a1ca-0226c8ce4f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:13.046294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91902335-524c-4f03-a1ca-0226c8ce4f00 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:13.046792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91902335-524c-4f03-a1ca-0226c8ce4f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:13.047299 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91902335-524c-4f03-a1ca-0226c8ce4f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:13.048222 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91902335-524c-4f03-a1ca-0226c8ce4f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:13.050625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91902335-524c-4f03-a1ca-0226c8ce4f00 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:13.118291 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:13.161840 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 864/1729] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:12 2022] POST /identity/v3/users => generated 289 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:13.167740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fc6fd-a71b-4638-a117-3fd091dc25ab None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:13.168225 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fc6fd-a71b-4638-a117-3fd091dc25ab None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:13.169773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fc6fd-a71b-4638-a117-3fd091dc25ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:13.194817 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 866/1730] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:12 2022] POST /identity/v3/projects => generated 369 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:13.196999 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5328b4c-ca0b-4cf2-94ca-3961d5185536 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:13.201967 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5328b4c-ca0b-4cf2-94ca-3961d5185536 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:13.214568 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5328b4c-ca0b-4cf2-94ca-3961d5185536 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:13.221731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 867/1731] 10.222.0.77 () {54 vars in 912 bytes} [Tue Sep 6 20:27:13 2022] GET /identity => generated 270 bytes in 26 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:27:13.222914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5328b4c-ca0b-4cf2-94ca-3961d5185536 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:13.245100 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-2f4fc6fd-a71b-4638-a117-3fd091dc25ab None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:13.250347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-2f4fc6fd-a71b-4638-a117-3fd091dc25ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:13.415466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 865/1732] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:13.419121 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fc6fd-a71b-4638-a117-3fd091dc25ab None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:13.424902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5328b4c-ca0b-4cf2-94ca-3961d5185536 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:13.439545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3596d-141a-4f2a-ba7e-d5e4017ad01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:13.441458 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3596d-141a-4f2a-ba7e-d5e4017ad01c admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:13.446290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3596d-141a-4f2a-ba7e-d5e4017ad01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:13.446290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3596d-141a-4f2a-ba7e-d5e4017ad01c admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:13.446290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3596d-141a-4f2a-ba7e-d5e4017ad01c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:13.446623 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fc6fd-a71b-4638-a117-3fd091dc25ab None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:13.447528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3596d-141a-4f2a-ba7e-d5e4017ad01c admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:13.461767 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981e5e4-1a46-46d9-8f9b-bca23667ffc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:13.465314 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981e5e4-1a46-46d9-8f9b-bca23667ffc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:13.465502 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 868/1733] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:13.465596 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981e5e4-1a46-46d9-8f9b-bca23667ffc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:13.465596 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981e5e4-1a46-46d9-8f9b-bca23667ffc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:13.466605 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981e5e4-1a46-46d9-8f9b-bca23667ffc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:13.475920 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10683a90-1081-4754-be34-124e7a056b1c None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:13.476499 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10683a90-1081-4754-be34-124e7a056b1c None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:13.476886 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10683a90-1081-4754-be34-124e7a056b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:13.488828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981e5e4-1a46-46d9-8f9b-bca23667ffc6 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:13.517499 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-10683a90-1081-4754-be34-124e7a056b1c None None] MFA Rules not processed for user `5a876d70d9634bf59af5f138e856f75f`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:13.519141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-10683a90-1081-4754-be34-124e7a056b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:13.628066 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 866/1734] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:13 2022] POST /identity/v3/users => generated 291 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:13.629179 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981e5e4-1a46-46d9-8f9b-bca23667ffc6 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:13.645418 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981e5e4-1a46-46d9-8f9b-bca23667ffc6 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:13.650788 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 869/1735] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Sep 6 20:27:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:13.651775 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10683a90-1081-4754-be34-124e7a056b1c None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:13.657794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8782d7-b9bc-4d43-a918-0716ed6fd545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:13.658552 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8782d7-b9bc-4d43-a918-0716ed6fd545 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:13.658827 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8782d7-b9bc-4d43-a918-0716ed6fd545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:13.659105 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8782d7-b9bc-4d43-a918-0716ed6fd545 admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:13.659968 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8782d7-b9bc-4d43-a918-0716ed6fd545 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:27:13.660273 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8782d7-b9bc-4d43-a918-0716ed6fd545 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:13.662205 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8782d7-b9bc-4d43-a918-0716ed6fd545 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:13.670128 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10683a90-1081-4754-be34-124e7a056b1c None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:13.675225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d6458-3a0c-49f4-8b9c-1b59607fc84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:13.676038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d6458-3a0c-49f4-8b9c-1b59607fc84a admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:13.676322 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d6458-3a0c-49f4-8b9c-1b59607fc84a admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:13.676600 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d6458-3a0c-49f4-8b9c-1b59607fc84a admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:13.677308 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d6458-3a0c-49f4-8b9c-1b59607fc84a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:13.682941 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 867/1736] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:27:13.683373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d6458-3a0c-49f4-8b9c-1b59607fc84a admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:13.683540 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb1241-27b5-4202-afb9-ca7bd1cef5d1 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:13.683540 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb1241-27b5-4202-afb9-ca7bd1cef5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:13.683540 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb1241-27b5-4202-afb9-ca7bd1cef5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:13.704185 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 870/1737] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:13.706535 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d6458-3a0c-49f4-8b9c-1b59607fc84a admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:13.709489 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-11fb1241-27b5-4202-afb9-ca7bd1cef5d1 None None] MFA Rules not processed for user `779846f3313940b388340f1794450e17`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:13.711309 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-11fb1241-27b5-4202-afb9-ca7bd1cef5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:13.720404 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d6458-3a0c-49f4-8b9c-1b59607fc84a admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:13.726527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381f155-9615-40bc-98de-f6d9b147cd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:13.727300 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381f155-9615-40bc-98de-f6d9b147cd43 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:13.731996 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381f155-9615-40bc-98de-f6d9b147cd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:13.731996 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381f155-9615-40bc-98de-f6d9b147cd43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:13.737881 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381f155-9615-40bc-98de-f6d9b147cd43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:13.742842 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381f155-9615-40bc-98de-f6d9b147cd43 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:13.762317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 871/1738] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:13.763362 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381f155-9615-40bc-98de-f6d9b147cd43 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:13.765546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-7381f155-9615-40bc-98de-f6d9b147cd43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:13.781424 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381f155-9615-40bc-98de-f6d9b147cd43 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:13.794021 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61af2e-3249-4714-b5ea-2c6d1bb25270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:13.794021 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61af2e-3249-4714-b5ea-2c6d1bb25270 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:13.794021 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61af2e-3249-4714-b5ea-2c6d1bb25270 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:13.794021 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61af2e-3249-4714-b5ea-2c6d1bb25270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:13.801211 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61af2e-3249-4714-b5ea-2c6d1bb25270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:13.802738 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61af2e-3249-4714-b5ea-2c6d1bb25270 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:13.815092 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 872/1739] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:13.816173 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61af2e-3249-4714-b5ea-2c6d1bb25270 service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:13.835908 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 868/1740] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:13.836072 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61af2e-3249-4714-b5ea-2c6d1bb25270 service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:13.843465 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb1241-27b5-4202-afb9-ca7bd1cef5d1 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:13.858175 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57ddda-38bd-4181-a0dc-ad8ea2ff1c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:13.859403 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb1241-27b5-4202-afb9-ca7bd1cef5d1 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:13.860517 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57ddda-38bd-4181-a0dc-ad8ea2ff1c9d admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:13.860838 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57ddda-38bd-4181-a0dc-ad8ea2ff1c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:13.861122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57ddda-38bd-4181-a0dc-ad8ea2ff1c9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:13.861847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57ddda-38bd-4181-a0dc-ad8ea2ff1c9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:13.864080 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57ddda-38bd-4181-a0dc-ad8ea2ff1c9d admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:13.881875 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e48576-8a4f-48e5-9d0a-c02a21a8ae5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:13.885005 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e48576-8a4f-48e5-9d0a-c02a21a8ae5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:13.886537 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e48576-8a4f-48e5-9d0a-c02a21a8ae5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:13.886946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e48576-8a4f-48e5-9d0a-c02a21a8ae5e admin admin] PATH_INFO: `/v3/projects/1f7aedc595304239a0df5a158498008a/users/14ebc5a4efb5403596dbf8a34b15c57d/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:13.921316 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e48576-8a4f-48e5-9d0a-c02a21a8ae5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f7aedc595304239a0df5a158498008a, user_id=14ebc5a4efb5403596dbf8a34b15c57d, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:13.940916 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e48576-8a4f-48e5-9d0a-c02a21a8ae5e admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:14.043673 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 873/1741] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:13 2022] POST /identity/v3/projects => generated 385 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:14.044639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57ddda-38bd-4181-a0dc-ad8ea2ff1c9d admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:14.095153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 869/1742] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:13 2022] PUT /identity/v3/projects/1f7aedc595304239a0df5a158498008a/users/14ebc5a4efb5403596dbf8a34b15c57d/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:14.097850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e48576-8a4f-48e5-9d0a-c02a21a8ae5e admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:14.240303 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57ddda-38bd-4181-a0dc-ad8ea2ff1c9d admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:14.368312 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e48576-8a4f-48e5-9d0a-c02a21a8ae5e admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:14.380765 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b1447-98d2-4e17-8462-25b33a62b81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:14.381257 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b1447-98d2-4e17-8462-25b33a62b81b admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:14.381642 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b1447-98d2-4e17-8462-25b33a62b81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:14.381928 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b1447-98d2-4e17-8462-25b33a62b81b admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:14.382987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b1447-98d2-4e17-8462-25b33a62b81b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:14.385004 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b1447-98d2-4e17-8462-25b33a62b81b admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:14.411345 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29af733-7581-49c4-945a-5799e0fc91b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:14.412330 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29af733-7581-49c4-945a-5799e0fc91b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:14.412983 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29af733-7581-49c4-945a-5799e0fc91b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:14.413449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29af733-7581-49c4-945a-5799e0fc91b6 admin admin] PATH_INFO: `/v3/projects/d1add75105d147cc8edd08cdf8c6b4f8/users/df61106fcf3a498ba7ea2af34273ba07/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:14.467907 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29af733-7581-49c4-945a-5799e0fc91b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1add75105d147cc8edd08cdf8c6b4f8, user_id=df61106fcf3a498ba7ea2af34273ba07, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:14.477932 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29af733-7581-49c4-945a-5799e0fc91b6 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:14.598025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 870/1743] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:14 2022] POST /identity/v3/users => generated 293 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:14.600948 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ee0c1-7716-4176-90e8-7a27a5c42dc4 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:14.601537 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ee0c1-7716-4176-90e8-7a27a5c42dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:14.601958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ee0c1-7716-4176-90e8-7a27a5c42dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:14.654312 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 874/1744] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:14 2022] PUT /identity/v3/projects/d1add75105d147cc8edd08cdf8c6b4f8/users/df61106fcf3a498ba7ea2af34273ba07/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:14.656419 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29af733-7581-49c4-945a-5799e0fc91b6 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:14.665015 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-5c7ee0c1-7716-4176-90e8-7a27a5c42dc4 None None] MFA Rules not processed for user `14ebc5a4efb5403596dbf8a34b15c57d`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:14.665758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-e29af733-7581-49c4-945a-5799e0fc91b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:14.683717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-5c7ee0c1-7716-4176-90e8-7a27a5c42dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:14.896888 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29af733-7581-49c4-945a-5799e0fc91b6 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:14.917753 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25007a2-f1ef-403f-8551-70d8ce225a91 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a486663ec144db0bbde6bf3deb35a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:14.918562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25007a2-f1ef-403f-8551-70d8ce225a91 service placement] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:14.918851 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25007a2-f1ef-403f-8551-70d8ce225a91 service placement] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:14.919133 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25007a2-f1ef-403f-8551-70d8ce225a91 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:14.922186 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 871/1745] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:14.924080 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ee0c1-7716-4176-90e8-7a27a5c42dc4 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:14.933538 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-e25007a2-f1ef-403f-8551-70d8ce225a91 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:14.940967 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:14.959167 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25007a2-f1ef-403f-8551-70d8ce225a91 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:14.961746 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25007a2-f1ef-403f-8551-70d8ce225a91 service placement] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:14.985046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 875/1746] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:14.985666 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25007a2-f1ef-403f-8551-70d8ce225a91 service placement] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:15.091799 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ee0c1-7716-4176-90e8-7a27a5c42dc4 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:15.112402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2983d-c5db-4f34-8f43-f351f6a48e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:15.113115 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2983d-c5db-4f34-8f43-f351f6a48e2b admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:15.113431 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2983d-c5db-4f34-8f43-f351f6a48e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:15.113603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2983d-c5db-4f34-8f43-f351f6a48e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:15.114222 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2983d-c5db-4f34-8f43-f351f6a48e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:15.115941 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2983d-c5db-4f34-8f43-f351f6a48e2b admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:15.148924 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 872/1747] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:15.150112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2983d-c5db-4f34-8f43-f351f6a48e2b admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:15.179286 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2983d-c5db-4f34-8f43-f351f6a48e2b admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:15.184898 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25007a2-f1ef-403f-8551-70d8ce225a91 service placement] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:15.200389 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486838df-7354-406c-ac21-d7f76fe53844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:15.201617 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486838df-7354-406c-ac21-d7f76fe53844 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:15.202211 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486838df-7354-406c-ac21-d7f76fe53844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:15.203244 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486838df-7354-406c-ac21-d7f76fe53844 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:15.206596 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486838df-7354-406c-ac21-d7f76fe53844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:15.214020 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486838df-7354-406c-ac21-d7f76fe53844 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:15.216466 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66eed30-1972-4ccc-ba9c-0f25d877087d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:15.217122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66eed30-1972-4ccc-ba9c-0f25d877087d admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:15.217397 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66eed30-1972-4ccc-ba9c-0f25d877087d admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:15.217669 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66eed30-1972-4ccc-ba9c-0f25d877087d admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:15.218550 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66eed30-1972-4ccc-ba9c-0f25d877087d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:15.220455 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66eed30-1972-4ccc-ba9c-0f25d877087d admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:15.268770 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 876/1748] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:15.271093 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66eed30-1972-4ccc-ba9c-0f25d877087d admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:15.288216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66eed30-1972-4ccc-ba9c-0f25d877087d admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:15.302866 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58622715-592e-4e36-8c96-52eeb34945b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:15.302866 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58622715-592e-4e36-8c96-52eeb34945b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:15.303585 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58622715-592e-4e36-8c96-52eeb34945b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:15.304309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58622715-592e-4e36-8c96-52eeb34945b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:15.305607 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58622715-592e-4e36-8c96-52eeb34945b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:15.307824 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58622715-592e-4e36-8c96-52eeb34945b7 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:15.327370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 877/1749] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:15.339652 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58622715-592e-4e36-8c96-52eeb34945b7 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:15.352172 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58622715-592e-4e36-8c96-52eeb34945b7 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:15.392377 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71af52c-2041-409b-aec9-70ef9ce9b342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:15.403167 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71af52c-2041-409b-aec9-70ef9ce9b342 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:15.403167 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71af52c-2041-409b-aec9-70ef9ce9b342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:15.403167 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71af52c-2041-409b-aec9-70ef9ce9b342 admin admin] PATH_INFO: `/v3/projects/d1add75105d147cc8edd08cdf8c6b4f8/users/df61106fcf3a498ba7ea2af34273ba07/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:15.403167 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71af52c-2041-409b-aec9-70ef9ce9b342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1add75105d147cc8edd08cdf8c6b4f8, user_id=df61106fcf3a498ba7ea2af34273ba07, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:15.421165 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71af52c-2041-409b-aec9-70ef9ce9b342 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:15.464308 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 878/1750] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:15 2022] PUT /identity/v3/projects/d1add75105d147cc8edd08cdf8c6b4f8/users/df61106fcf3a498ba7ea2af34273ba07/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:15.466445 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71af52c-2041-409b-aec9-70ef9ce9b342 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:15.500820 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 873/1751] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:15 2022] POST /identity/v3/projects => generated 375 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:15.506758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9060a-fa98-4325-832f-de92830e4951 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:15.512691 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9060a-fa98-4325-832f-de92830e4951 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:15.513236 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9060a-fa98-4325-832f-de92830e4951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:15.683846 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-b5d9060a-fa98-4325-832f-de92830e4951 None None] MFA Rules not processed for user `df61106fcf3a498ba7ea2af34273ba07`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:15.685927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-b5d9060a-fa98-4325-832f-de92830e4951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:15.754925 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71af52c-2041-409b-aec9-70ef9ce9b342 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:15.932101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c8872-8677-4b06-a58c-054092aaad47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:15.936703 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c8872-8677-4b06-a58c-054092aaad47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:15.937744 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c8872-8677-4b06-a58c-054092aaad47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:15.938555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c8872-8677-4b06-a58c-054092aaad47 admin admin] PATH_INFO: `/v3/projects/60e7773268db4bfea17c89a1564c8d24/users/66c4fc2a10ab414f9bb32fdaff067046/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:15.983551 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c8872-8677-4b06-a58c-054092aaad47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60e7773268db4bfea17c89a1564c8d24, user_id=66c4fc2a10ab414f9bb32fdaff067046, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:15.986369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c8872-8677-4b06-a58c-054092aaad47 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:16.049203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 874/1752] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 550 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:16.049621 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9060a-fa98-4325-832f-de92830e4951 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:16.074927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9060a-fa98-4325-832f-de92830e4951 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:16.085093 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac04e0-b4ec-421f-b3f2-a1d7496a3c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:16.086359 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac04e0-b4ec-421f-b3f2-a1d7496a3c34 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:16.086857 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac04e0-b4ec-421f-b3f2-a1d7496a3c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:16.087140 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac04e0-b4ec-421f-b3f2-a1d7496a3c34 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:16.093420 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac04e0-b4ec-421f-b3f2-a1d7496a3c34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:16.093591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 879/1753] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:15 2022] PUT /identity/v3/projects/60e7773268db4bfea17c89a1564c8d24/users/66c4fc2a10ab414f9bb32fdaff067046/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:16.093730 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac04e0-b4ec-421f-b3f2-a1d7496a3c34 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:16.093861 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2d97a-41c3-4ec1-a45a-63b1b58f7a00 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:16.093861 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2d97a-41c3-4ec1-a45a-63b1b58f7a00 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:16.093861 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2d97a-41c3-4ec1-a45a-63b1b58f7a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:16.119260 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:16.130987 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-3fc2d97a-41c3-4ec1-a45a-63b1b58f7a00 None None] MFA Rules not processed for user `2e7cc9c938214193b922ab1bc8288a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:16.132575 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-3fc2d97a-41c3-4ec1-a45a-63b1b58f7a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:16.217642 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 880/1754] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:16.219282 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2d97a-41c3-4ec1-a45a-63b1b58f7a00 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:16.224935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-3fc2d97a-41c3-4ec1-a45a-63b1b58f7a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:16.251719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 875/1755] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:16 2022] POST /identity/v3/users => generated 294 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:16.253141 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d523e2-081f-4db9-b292-9c8a62b4b0ca None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:16.255286 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d523e2-081f-4db9-b292-9c8a62b4b0ca None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:16.255286 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d523e2-081f-4db9-b292-9c8a62b4b0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:16.314480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-12d523e2-081f-4db9-b292-9c8a62b4b0ca None None] MFA Rules not processed for user `66c4fc2a10ab414f9bb32fdaff067046`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:16.316184 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-12d523e2-081f-4db9-b292-9c8a62b4b0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:16.368146 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2d97a-41c3-4ec1-a45a-63b1b58f7a00 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:16.377339 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738987c7-03fb-4926-822c-093b23d4d69c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:16.379656 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738987c7-03fb-4926-822c-093b23d4d69c service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:16.381486 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738987c7-03fb-4926-822c-093b23d4d69c service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:16.381866 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738987c7-03fb-4926-822c-093b23d4d69c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:16.465926 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:16.477533 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 876/1756] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:16.479950 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d523e2-081f-4db9-b292-9c8a62b4b0ca None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:16.495539 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738987c7-03fb-4926-822c-093b23d4d69c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:16.520647 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738987c7-03fb-4926-822c-093b23d4d69c service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:16.551656 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 881/1757] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:16.552760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738987c7-03fb-4926-822c-093b23d4d69c service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:16.817282 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d523e2-081f-4db9-b292-9c8a62b4b0ca None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:16.840434 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158219d-a2e6-4697-a2c3-400b178c1881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:16.841232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158219d-a2e6-4697-a2c3-400b178c1881 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:16.841623 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158219d-a2e6-4697-a2c3-400b178c1881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:16.842000 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158219d-a2e6-4697-a2c3-400b178c1881 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:16.842892 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158219d-a2e6-4697-a2c3-400b178c1881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:16.851124 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158219d-a2e6-4697-a2c3-400b178c1881 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:16.866250 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 877/1758] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:16.871909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158219d-a2e6-4697-a2c3-400b178c1881 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:16.895754 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738987c7-03fb-4926-822c-093b23d4d69c service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:16.903965 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89685180-27fc-4113-9470-edbdc4157d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:16.904608 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89685180-27fc-4113-9470-edbdc4157d9b admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:16.904890 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89685180-27fc-4113-9470-edbdc4157d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:16.905167 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89685180-27fc-4113-9470-edbdc4157d9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:16.905819 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89685180-27fc-4113-9470-edbdc4157d9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:16.907826 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89685180-27fc-4113-9470-edbdc4157d9b admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:16.919770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158219d-a2e6-4697-a2c3-400b178c1881 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:16.940015 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e7ad7-f58a-41ba-bb0e-bbcb700d8a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:16.940941 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e7ad7-f58a-41ba-bb0e-bbcb700d8a39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:16.941322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e7ad7-f58a-41ba-bb0e-bbcb700d8a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:16.941697 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e7ad7-f58a-41ba-bb0e-bbcb700d8a39 admin admin] PATH_INFO: `/v3/projects/562dacceb0324feeade8d799e62d296d/users/cf95ab3a43084ef8be8520b2ae5976fc/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:16.970332 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e7ad7-f58a-41ba-bb0e-bbcb700d8a39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=562dacceb0324feeade8d799e62d296d, user_id=cf95ab3a43084ef8be8520b2ae5976fc, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:16.973862 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e7ad7-f58a-41ba-bb0e-bbcb700d8a39 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:17.077193 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 882/1759] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:16 2022] POST /identity/v3/projects => generated 383 bytes in 525 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:17.078513 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89685180-27fc-4113-9470-edbdc4157d9b admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:17.083507 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 878/1760] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:16 2022] PUT /identity/v3/projects/562dacceb0324feeade8d799e62d296d/users/cf95ab3a43084ef8be8520b2ae5976fc/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:17.084297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e7ad7-f58a-41ba-bb0e-bbcb700d8a39 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:17.276626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89685180-27fc-4113-9470-edbdc4157d9b admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:17.285386 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7d7b8-550c-4f5c-a845-553643c0bd0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:17.286815 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7d7b8-550c-4f5c-a845-553643c0bd0a service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:17.287152 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7d7b8-550c-4f5c-a845-553643c0bd0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:17.298787 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7d7b8-550c-4f5c-a845-553643c0bd0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:17.388587 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e7ad7-f58a-41ba-bb0e-bbcb700d8a39 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:17.451257 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7d7b8-550c-4f5c-a845-553643c0bd0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:17.454087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7d7b8-550c-4f5c-a845-553643c0bd0a service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:17.481418 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 883/1761] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:17.483202 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7d7b8-550c-4f5c-a845-553643c0bd0a service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:17.568527 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac026e4b-cadd-4c6e-8583-f6b21fb9f281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:17.573447 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac026e4b-cadd-4c6e-8583-f6b21fb9f281 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:17.574055 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac026e4b-cadd-4c6e-8583-f6b21fb9f281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:17.574864 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac026e4b-cadd-4c6e-8583-f6b21fb9f281 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:17.575976 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac026e4b-cadd-4c6e-8583-f6b21fb9f281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:17.580941 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac026e4b-cadd-4c6e-8583-f6b21fb9f281 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:17.684956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7d7b8-550c-4f5c-a845-553643c0bd0a service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:17.711294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284329da-0215-41ed-bf1d-f4d72557baf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:17.711974 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284329da-0215-41ed-bf1d-f4d72557baf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:17.712255 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284329da-0215-41ed-bf1d-f4d72557baf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:17.712527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284329da-0215-41ed-bf1d-f4d72557baf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:17.713185 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284329da-0215-41ed-bf1d-f4d72557baf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:17.714945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284329da-0215-41ed-bf1d-f4d72557baf6 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:17.734987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 879/1762] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:17 2022] POST /identity/v3/users => generated 298 bytes in 650 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:17.737723 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac026e4b-cadd-4c6e-8583-f6b21fb9f281 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:17.751810 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac026e4b-cadd-4c6e-8583-f6b21fb9f281 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:17.755382 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 884/1763] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:17.760600 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284329da-0215-41ed-bf1d-f4d72557baf6 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:17.763084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5a824-e7a7-48c4-80d4-ff6ad01f6b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:17.768824 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5a824-e7a7-48c4-80d4-ff6ad01f6b19 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:17.768824 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5a824-e7a7-48c4-80d4-ff6ad01f6b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:17.768824 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5a824-e7a7-48c4-80d4-ff6ad01f6b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:17.768824 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5a824-e7a7-48c4-80d4-ff6ad01f6b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:17.769759 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5a824-e7a7-48c4-80d4-ff6ad01f6b19 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:17.788110 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 880/1764] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:27:17.789907 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5a824-e7a7-48c4-80d4-ff6ad01f6b19 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:17.795643 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284329da-0215-41ed-bf1d-f4d72557baf6 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:17.802224 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5a824-e7a7-48c4-80d4-ff6ad01f6b19 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:17.812504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a81d98-d4c1-405d-8e80-f22de07a66f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:17.813503 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5433bfb-ad10-4f7a-8a2a-ee70c3631809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:17.814168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a81d98-d4c1-405d-8e80-f22de07a66f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:17.814281 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5433bfb-ad10-4f7a-8a2a-ee70c3631809 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:17.814595 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5433bfb-ad10-4f7a-8a2a-ee70c3631809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:17.814918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5433bfb-ad10-4f7a-8a2a-ee70c3631809 admin admin] PATH_INFO: `/v3/projects/562dacceb0324feeade8d799e62d296d/users/cf95ab3a43084ef8be8520b2ae5976fc/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:17.815293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a81d98-d4c1-405d-8e80-f22de07a66f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:17.815798 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a81d98-d4c1-405d-8e80-f22de07a66f9 admin admin] PATH_INFO: `/v3/projects/1cd5e2cf18994a5a8b07965020907058/users/b7f4fae461b041959eaf3aef2643abe5/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:17.825783 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5433bfb-ad10-4f7a-8a2a-ee70c3631809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=562dacceb0324feeade8d799e62d296d, user_id=cf95ab3a43084ef8be8520b2ae5976fc, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:17.830047 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5433bfb-ad10-4f7a-8a2a-ee70c3631809 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:17.842166 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a81d98-d4c1-405d-8e80-f22de07a66f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cd5e2cf18994a5a8b07965020907058, user_id=b7f4fae461b041959eaf3aef2643abe5, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:17.845999 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a81d98-d4c1-405d-8e80-f22de07a66f9 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:17.866138 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 885/1765] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:17 2022] PUT /identity/v3/projects/562dacceb0324feeade8d799e62d296d/users/cf95ab3a43084ef8be8520b2ae5976fc/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:17.879056 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ba5ca-c8b2-45dc-9bce-5cddf5647ec2 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:17.879827 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ba5ca-c8b2-45dc-9bce-5cddf5647ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:17.880298 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ba5ca-c8b2-45dc-9bce-5cddf5647ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:17.919077 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-2d4ba5ca-c8b2-45dc-9bce-5cddf5647ec2 None None] MFA Rules not processed for user `cf95ab3a43084ef8be8520b2ae5976fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:17.920441 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-2d4ba5ca-c8b2-45dc-9bce-5cddf5647ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:18.019424 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 886/1766] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:27:18.022924 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 881/1767] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:17 2022] PUT /identity/v3/projects/1cd5e2cf18994a5a8b07965020907058/users/b7f4fae461b041959eaf3aef2643abe5/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:18.028161 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ba5ca-c8b2-45dc-9bce-5cddf5647ec2 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:18.125164 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ba5ca-c8b2-45dc-9bce-5cddf5647ec2 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:18.223899 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807a837-4571-49a5-ba56-afde4e16c3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:18.225302 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807a837-4571-49a5-ba56-afde4e16c3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:18.226861 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807a837-4571-49a5-ba56-afde4e16c3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:18.227433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807a837-4571-49a5-ba56-afde4e16c3a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:18.229362 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807a837-4571-49a5-ba56-afde4e16c3a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:18.232514 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807a837-4571-49a5-ba56-afde4e16c3a6 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:18.262628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 887/1768] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:27:18.271709 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a81d98-d4c1-405d-8e80-f22de07a66f9 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:18.276727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a81d98-d4c1-405d-8e80-f22de07a66f9 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:18.284217 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a60dc9-55ae-4003-9d73-e45ad7d6820c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:18.284912 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a60dc9-55ae-4003-9d73-e45ad7d6820c admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:18.285195 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a60dc9-55ae-4003-9d73-e45ad7d6820c admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:18.285473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a60dc9-55ae-4003-9d73-e45ad7d6820c admin admin] PATH_INFO: `/v3/projects/1cd5e2cf18994a5a8b07965020907058/users/b7f4fae461b041959eaf3aef2643abe5/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:18.287632 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a60dc9-55ae-4003-9d73-e45ad7d6820c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cd5e2cf18994a5a8b07965020907058, user_id=b7f4fae461b041959eaf3aef2643abe5, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:18.291539 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a60dc9-55ae-4003-9d73-e45ad7d6820c admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:18.308550 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 882/1769] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:18 2022] PUT /identity/v3/projects/1cd5e2cf18994a5a8b07965020907058/users/b7f4fae461b041959eaf3aef2643abe5/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:18.319285 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd942d-498b-4c28-8ed8-225fde051b29 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:18.319637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd942d-498b-4c28-8ed8-225fde051b29 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:18.320555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd942d-498b-4c28-8ed8-225fde051b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:18.375268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-fdbd942d-498b-4c28-8ed8-225fde051b29 None None] MFA Rules not processed for user `b7f4fae461b041959eaf3aef2643abe5`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:18.376553 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-fdbd942d-498b-4c28-8ed8-225fde051b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:18.487507 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 888/1770] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:18.516866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:19.021647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a60dc9-55ae-4003-9d73-e45ad7d6820c admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:19.028064 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-a1a60dc9-55ae-4003-9d73-e45ad7d6820c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:19.046843 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd942d-498b-4c28-8ed8-225fde051b29 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:19.167428 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd942d-498b-4c28-8ed8-225fde051b29 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:19.172823 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efe67f-8785-4cdd-9524-7ff78b149e6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:19.173462 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efe67f-8785-4cdd-9524-7ff78b149e6e service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:19.173742 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efe67f-8785-4cdd-9524-7ff78b149e6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:19.174078 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efe67f-8785-4cdd-9524-7ff78b149e6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:19.200744 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efe67f-8785-4cdd-9524-7ff78b149e6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:19.205810 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efe67f-8785-4cdd-9524-7ff78b149e6e service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:19.215683 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a60dc9-55ae-4003-9d73-e45ad7d6820c admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:19.228084 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 889/1771] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:27:19.229325 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465a012-1b81-4110-af59-c8388b752a4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:19.230276 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465a012-1b81-4110-af59-c8388b752a4b service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:19.230765 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465a012-1b81-4110-af59-c8388b752a4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:19.231244 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465a012-1b81-4110-af59-c8388b752a4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:19.267132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efe67f-8785-4cdd-9524-7ff78b149e6e service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:19.372241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465a012-1b81-4110-af59-c8388b752a4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:19.374041 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465a012-1b81-4110-af59-c8388b752a4b service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:19.385320 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 883/1772] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:19.409155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efe67f-8785-4cdd-9524-7ff78b149e6e service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:19.417912 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d42e6-d8b5-4ce9-bc22-d3fc44b4dae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:19.419953 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d42e6-d8b5-4ce9-bc22-d3fc44b4dae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:19.420440 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d42e6-d8b5-4ce9-bc22-d3fc44b4dae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:19.420725 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d42e6-d8b5-4ce9-bc22-d3fc44b4dae4 admin admin] PATH_INFO: `/v3/users/66c4fc2a10ab414f9bb32fdaff067046` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:19.422038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d42e6-d8b5-4ce9-bc22-d3fc44b4dae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66c4fc2a10ab414f9bb32fdaff067046)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:19.429932 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d42e6-d8b5-4ce9-bc22-d3fc44b4dae4 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:19.573197 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:19.694929 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-992d42e6-d8b5-4ce9-bc22-d3fc44b4dae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66c4fc2a10ab414f9bb32fdaff067046'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:19.700980 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:19.774270 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-992d42e6-d8b5-4ce9-bc22-d3fc44b4dae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66c4fc2a10ab414f9bb32fdaff067046'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:19.776468 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-992d42e6-d8b5-4ce9-bc22-d3fc44b4dae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66c4fc2a10ab414f9bb32fdaff067046'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:19.777680 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-992d42e6-d8b5-4ce9-bc22-d3fc44b4dae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66c4fc2a10ab414f9bb32fdaff067046'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:19.788128 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-992d42e6-d8b5-4ce9-bc22-d3fc44b4dae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66c4fc2a10ab414f9bb32fdaff067046'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:19.823704 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 890/1773] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:27:19 2022] DELETE /identity/v3/users/66c4fc2a10ab414f9bb32fdaff067046 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:27:19.834052 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ff849-1800-4470-af9a-fdebb5a40f76 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:19.834339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ff849-1800-4470-af9a-fdebb5a40f76 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:19.834715 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ff849-1800-4470-af9a-fdebb5a40f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:19.856541 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-0e5ff849-1800-4470-af9a-fdebb5a40f76 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:19.857796 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-0e5ff849-1800-4470-af9a-fdebb5a40f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:19.920728 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 884/1774] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:19.930673 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d42e6-d8b5-4ce9-bc22-d3fc44b4dae4 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:19.932162 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-992d42e6-d8b5-4ce9-bc22-d3fc44b4dae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:20.005972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d42e6-d8b5-4ce9-bc22-d3fc44b4dae4 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:20.012965 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdc1d3-4e3b-4ea2-b525-76d7b0a36f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:20.013715 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdc1d3-4e3b-4ea2-b525-76d7b0a36f06 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:20.014053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdc1d3-4e3b-4ea2-b525-76d7b0a36f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:20.014460 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdc1d3-4e3b-4ea2-b525-76d7b0a36f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:20.028367 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffdc1d3-4e3b-4ea2-b525-76d7b0a36f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:20.029842 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffdc1d3-4e3b-4ea2-b525-76d7b0a36f06 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:20.040544 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 891/1775] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:20.332909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:20.887959 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ff849-1800-4470-af9a-fdebb5a40f76 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:20.890484 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-0e5ff849-1800-4470-af9a-fdebb5a40f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:20.912646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ff849-1800-4470-af9a-fdebb5a40f76 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:20.918368 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b39812-ecf9-4fe2-a225-1080854e2bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:20.919343 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b39812-ecf9-4fe2-a225-1080854e2bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:20.919741 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b39812-ecf9-4fe2-a225-1080854e2bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:20.920019 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b39812-ecf9-4fe2-a225-1080854e2bf3 admin admin] PATH_INFO: `/v3/projects/60e7773268db4bfea17c89a1564c8d24` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:20.921365 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b39812-ecf9-4fe2-a225-1080854e2bf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60e7773268db4bfea17c89a1564c8d24)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:20.923973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b39812-ecf9-4fe2-a225-1080854e2bf3 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:21.082611 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-77b39812-ecf9-4fe2-a225-1080854e2bf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60e7773268db4bfea17c89a1564c8d24', 'request_id': 'req-77b39812-ecf9-4fe2-a225-1080854e2bf3'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:21.090962 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-77b39812-ecf9-4fe2-a225-1080854e2bf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60e7773268db4bfea17c89a1564c8d24', 'request_id': 'req-77b39812-ecf9-4fe2-a225-1080854e2bf3'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:21.198073 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-77b39812-ecf9-4fe2-a225-1080854e2bf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60e7773268db4bfea17c89a1564c8d24', 'request_id': 'req-77b39812-ecf9-4fe2-a225-1080854e2bf3'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:21.220016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-77b39812-ecf9-4fe2-a225-1080854e2bf3 admin admin] The token cache is being invalidate because project 60e7773268db4bfea17c89a1564c8d24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:27:21.220288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-77b39812-ecf9-4fe2-a225-1080854e2bf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:21.220968 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-77b39812-ecf9-4fe2-a225-1080854e2bf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:21.222569 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 885/1776] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:27:20 2022] DELETE /identity/v3/projects/60e7773268db4bfea17c89a1564c8d24 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:21.233028 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdc1d3-4e3b-4ea2-b525-76d7b0a36f06 service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:21.243940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdc1d3-4e3b-4ea2-b525-76d7b0a36f06 service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:21.329315 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b43471-1bf9-4814-b7c4-6bf895290dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:21.330036 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b43471-1bf9-4814-b7c4-6bf895290dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:21.331010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b43471-1bf9-4814-b7c4-6bf895290dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:21.331010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b43471-1bf9-4814-b7c4-6bf895290dfa admin admin] PATH_INFO: `/v3/users/b7f4fae461b041959eaf3aef2643abe5` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:21.331892 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b43471-1bf9-4814-b7c4-6bf895290dfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7f4fae461b041959eaf3aef2643abe5)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:21.334231 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b43471-1bf9-4814-b7c4-6bf895290dfa admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:21.652666 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-64b43471-1bf9-4814-b7c4-6bf895290dfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7f4fae461b041959eaf3aef2643abe5'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:21.808489 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-64b43471-1bf9-4814-b7c4-6bf895290dfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7f4fae461b041959eaf3aef2643abe5'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:21.812862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-64b43471-1bf9-4814-b7c4-6bf895290dfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7f4fae461b041959eaf3aef2643abe5'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:21.812862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-64b43471-1bf9-4814-b7c4-6bf895290dfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7f4fae461b041959eaf3aef2643abe5'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:21.837316 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-64b43471-1bf9-4814-b7c4-6bf895290dfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7f4fae461b041959eaf3aef2643abe5'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:21.865069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 892/1777] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:27:21 2022] DELETE /identity/v3/users/b7f4fae461b041959eaf3aef2643abe5 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:21.921177 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877ae9a-909f-46fd-9217-61b237251dfa None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:21.921177 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877ae9a-909f-46fd-9217-61b237251dfa None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:21.922310 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877ae9a-909f-46fd-9217-61b237251dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:21.989069 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-7877ae9a-909f-46fd-9217-61b237251dfa None None] MFA Rules not processed for user `c314372147b2491cb4481d538056472c`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:21.990597 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-7877ae9a-909f-46fd-9217-61b237251dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:22.100999 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 886/1778] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Sep 6 20:27:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:22.479433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b43471-1bf9-4814-b7c4-6bf895290dfa admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:22.481698 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-64b43471-1bf9-4814-b7c4-6bf895290dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:22.651410 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b43471-1bf9-4814-b7c4-6bf895290dfa admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:22.658345 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89107794-1e6e-4380-8854-c0626e63944c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6c4f91a59548fd979e7232a2afd6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:22.659355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89107794-1e6e-4380-8854-c0626e63944c service swift] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:22.659843 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89107794-1e6e-4380-8854-c0626e63944c service swift] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:22.660575 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89107794-1e6e-4380-8854-c0626e63944c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:22.693946 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89107794-1e6e-4380-8854-c0626e63944c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:22.698300 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89107794-1e6e-4380-8854-c0626e63944c service swift] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:22.709890 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 893/1779] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Sep 6 20:27:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 20:27:22.744625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a90d6-f6b7-485a-bf11-14b34a1db1e1 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:22.744625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a90d6-f6b7-485a-bf11-14b34a1db1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:22.744625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a90d6-f6b7-485a-bf11-14b34a1db1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:22.790349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-905a90d6-f6b7-485a-bf11-14b34a1db1e1 None None] MFA Rules not processed for user `5a876d70d9634bf59af5f138e856f75f`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:22.796955 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-905a90d6-f6b7-485a-bf11-14b34a1db1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:22.897437 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89107794-1e6e-4380-8854-c0626e63944c service swift] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:22.899031 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-89107794-1e6e-4380-8854-c0626e63944c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:23.070943 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 887/1780] 10.222.0.67 () {58 vars in 1015 bytes} [Tue Sep 6 20:27:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:23.083922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:23.196146 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89107794-1e6e-4380-8854-c0626e63944c service swift] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:23.203366 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399fa960-0b79-4c83-bf48-4e933a1a5fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:23.204395 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399fa960-0b79-4c83-bf48-4e933a1a5fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:23.204884 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399fa960-0b79-4c83-bf48-4e933a1a5fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:23.205413 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399fa960-0b79-4c83-bf48-4e933a1a5fc3 admin admin] PATH_INFO: `/v3/projects/1cd5e2cf18994a5a8b07965020907058` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:23.206837 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399fa960-0b79-4c83-bf48-4e933a1a5fc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cd5e2cf18994a5a8b07965020907058)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:23.209285 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399fa960-0b79-4c83-bf48-4e933a1a5fc3 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:23.339905 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a90d6-f6b7-485a-bf11-14b34a1db1e1 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:23.341511 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-905a90d6-f6b7-485a-bf11-14b34a1db1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:23.364244 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-399fa960-0b79-4c83-bf48-4e933a1a5fc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cd5e2cf18994a5a8b07965020907058', 'request_id': 'req-399fa960-0b79-4c83-bf48-4e933a1a5fc3'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:23.388399 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a90d6-f6b7-485a-bf11-14b34a1db1e1 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:23.396627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-399fa960-0b79-4c83-bf48-4e933a1a5fc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cd5e2cf18994a5a8b07965020907058', 'request_id': 'req-399fa960-0b79-4c83-bf48-4e933a1a5fc3'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:23.495709 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-399fa960-0b79-4c83-bf48-4e933a1a5fc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cd5e2cf18994a5a8b07965020907058', 'request_id': 'req-399fa960-0b79-4c83-bf48-4e933a1a5fc3'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:23.526467 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-399fa960-0b79-4c83-bf48-4e933a1a5fc3 admin admin] The token cache is being invalidate because project 1cd5e2cf18994a5a8b07965020907058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:27:23.526862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-399fa960-0b79-4c83-bf48-4e933a1a5fc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:23.537234 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-399fa960-0b79-4c83-bf48-4e933a1a5fc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:23.547519 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 894/1781] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:27:22 2022] DELETE /identity/v3/projects/1cd5e2cf18994a5a8b07965020907058 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:23.553052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399fa960-0b79-4c83-bf48-4e933a1a5fc3 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:23.558223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-399fa960-0b79-4c83-bf48-4e933a1a5fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:23.572067 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7ea41-e5bb-45d7-b568-95ded99720f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:23.573933 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7ea41-e5bb-45d7-b568-95ded99720f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:23.576786 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7ea41-e5bb-45d7-b568-95ded99720f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:23.580001 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7ea41-e5bb-45d7-b568-95ded99720f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:23.589994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-5ac7ea41-e5bb-45d7-b568-95ded99720f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:23.620977 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7ea41-e5bb-45d7-b568-95ded99720f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:23.623794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7ea41-e5bb-45d7-b568-95ded99720f4 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:23.651641 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 888/1782] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:27:23.653698 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c82d1-67c6-47af-93a7-943061d1e996 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:23.654130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c82d1-67c6-47af-93a7-943061d1e996 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:23.654713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c82d1-67c6-47af-93a7-943061d1e996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:23.691615 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-406c82d1-67c6-47af-93a7-943061d1e996 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:23.693330 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-406c82d1-67c6-47af-93a7-943061d1e996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:23.718862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399fa960-0b79-4c83-bf48-4e933a1a5fc3 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:23.733504 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a8c6e-0051-47f6-af67-ab2a54eee5b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:23.734141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a8c6e-0051-47f6-af67-ab2a54eee5b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:23.734474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a8c6e-0051-47f6-af67-ab2a54eee5b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:23.734804 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a8c6e-0051-47f6-af67-ab2a54eee5b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:23.738233 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-525a8c6e-0051-47f6-af67-ab2a54eee5b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:23.803399 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:23.825757 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 889/1783] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:23.829681 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f84c1-218c-4d84-b366-b4184685cd46 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:23.830132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f84c1-218c-4d84-b366-b4184685cd46 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:23.830414 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f84c1-218c-4d84-b366-b4184685cd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:23.892635 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-4f3f84c1-218c-4d84-b366-b4184685cd46 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:23.894184 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-4f3f84c1-218c-4d84-b366-b4184685cd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:23.916313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 890/1784] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:23.921431 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f84c1-218c-4d84-b366-b4184685cd46 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:23.944228 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f84c1-218c-4d84-b366-b4184685cd46 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:23.950404 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65ecaf-5b5f-4c70-89d1-5d9f5fbec762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:23.951860 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65ecaf-5b5f-4c70-89d1-5d9f5fbec762 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:23.952270 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65ecaf-5b5f-4c70-89d1-5d9f5fbec762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:23.952604 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65ecaf-5b5f-4c70-89d1-5d9f5fbec762 admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:23.953617 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65ecaf-5b5f-4c70-89d1-5d9f5fbec762 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:27:23.953992 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65ecaf-5b5f-4c70-89d1-5d9f5fbec762 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:23.956144 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65ecaf-5b5f-4c70-89d1-5d9f5fbec762 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:23.963649 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a8c6e-0051-47f6-af67-ab2a54eee5b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:23.967921 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a8c6e-0051-47f6-af67-ab2a54eee5b2 service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:23.988355 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 891/1785] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:27:23.996180 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65ecaf-5b5f-4c70-89d1-5d9f5fbec762 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:24.010247 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 895/1786] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:24.018011 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65ecaf-5b5f-4c70-89d1-5d9f5fbec762 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:24.028934 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a1c5e-7924-4f16-8cb0-f75512a5cac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:24.029956 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a1c5e-7924-4f16-8cb0-f75512a5cac5 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:24.030252 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a1c5e-7924-4f16-8cb0-f75512a5cac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:24.030531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a1c5e-7924-4f16-8cb0-f75512a5cac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:24.031377 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a1c5e-7924-4f16-8cb0-f75512a5cac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:24.038172 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a1c5e-7924-4f16-8cb0-f75512a5cac5 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:24.198885 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 892/1787] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:23 2022] POST /identity/v3/projects => generated 387 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:24.204584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a8c6e-0051-47f6-af67-ab2a54eee5b2 service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:24.225091 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a8c6e-0051-47f6-af67-ab2a54eee5b2 service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:24.375949 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e51712-9892-446e-9b2f-42c3307e6ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:24.376749 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e51712-9892-446e-9b2f-42c3307e6ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:24.377142 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e51712-9892-446e-9b2f-42c3307e6ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:24.377525 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e51712-9892-446e-9b2f-42c3307e6ea5 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:24.378372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e51712-9892-446e-9b2f-42c3307e6ea5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:24.380962 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e51712-9892-446e-9b2f-42c3307e6ea5 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:24.602372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 896/1788] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:24 2022] POST /identity/v3/users => generated 294 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:27:24.603781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a1c5e-7924-4f16-8cb0-f75512a5cac5 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:24.622982 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a1c5e-7924-4f16-8cb0-f75512a5cac5 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:24.641347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707b095-a964-4524-a533-544cf0c04417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:24.643826 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707b095-a964-4524-a533-544cf0c04417 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:24.644268 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707b095-a964-4524-a533-544cf0c04417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:24.646512 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707b095-a964-4524-a533-544cf0c04417 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:24.647367 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707b095-a964-4524-a533-544cf0c04417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:24.654175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707b095-a964-4524-a533-544cf0c04417 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:24.683565 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 893/1789] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:24.687825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e51712-9892-446e-9b2f-42c3307e6ea5 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:24.710996 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e51712-9892-446e-9b2f-42c3307e6ea5 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:24.732910 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f3257-8bf0-4442-9bca-4cab9cdb8357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:24.735615 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f3257-8bf0-4442-9bca-4cab9cdb8357 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:24.736217 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f3257-8bf0-4442-9bca-4cab9cdb8357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:24.736959 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f3257-8bf0-4442-9bca-4cab9cdb8357 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:24.737947 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f3257-8bf0-4442-9bca-4cab9cdb8357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:24.742858 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f3257-8bf0-4442-9bca-4cab9cdb8357 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:24.793914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 897/1790] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:24.805732 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707b095-a964-4524-a533-544cf0c04417 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:24.998204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707b095-a964-4524-a533-544cf0c04417 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:24.998204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595b9b0-3932-41b1-bb93-359b62c9789a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:24.998204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595b9b0-3932-41b1-bb93-359b62c9789a admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:24.998204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595b9b0-3932-41b1-bb93-359b62c9789a admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:24.998834 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595b9b0-3932-41b1-bb93-359b62c9789a admin admin] PATH_INFO: `/v3/projects/6f18e01ffd17431087af22fb41741631/users/29ef8e6c419e40c0845cfb7afed8b375/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:24.998834 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595b9b0-3932-41b1-bb93-359b62c9789a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f18e01ffd17431087af22fb41741631, user_id=29ef8e6c419e40c0845cfb7afed8b375, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:24.998834 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595b9b0-3932-41b1-bb93-359b62c9789a admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:25.606009 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 894/1791] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:24 2022] PUT /identity/v3/projects/6f18e01ffd17431087af22fb41741631/users/29ef8e6c419e40c0845cfb7afed8b375/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 801 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:25.617746 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cd1e2-7496-43e1-91cd-8e2ca5cb7b22 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:25.618436 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cd1e2-7496-43e1-91cd-8e2ca5cb7b22 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:25.618436 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cd1e2-7496-43e1-91cd-8e2ca5cb7b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:25.665064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-979cd1e2-7496-43e1-91cd-8e2ca5cb7b22 None None] MFA Rules not processed for user `29ef8e6c419e40c0845cfb7afed8b375`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:25.666517 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-979cd1e2-7496-43e1-91cd-8e2ca5cb7b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:25.779324 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 898/1792] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:25.784057 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595b9b0-3932-41b1-bb93-359b62c9789a admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:25.895763 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:25.996224 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595b9b0-3932-41b1-bb93-359b62c9789a admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:26.024259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd489a9-9091-4561-89c1-eade13f16a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:26.024904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd489a9-9091-4561-89c1-eade13f16a1b admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:26.025185 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd489a9-9091-4561-89c1-eade13f16a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:26.025481 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd489a9-9091-4561-89c1-eade13f16a1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:26.026129 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd489a9-9091-4561-89c1-eade13f16a1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:26.031711 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd489a9-9091-4561-89c1-eade13f16a1b admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:26.144422 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 895/1793] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:25 2022] POST /identity/v3/projects => generated 387 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:26.149034 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cd1e2-7496-43e1-91cd-8e2ca5cb7b22 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:26.187091 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cd1e2-7496-43e1-91cd-8e2ca5cb7b22 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:26.387160 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c14459-70b2-4d06-9ffa-71d78eaf365c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:26.392226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c14459-70b2-4d06-9ffa-71d78eaf365c admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:26.392226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c14459-70b2-4d06-9ffa-71d78eaf365c admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:26.392226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c14459-70b2-4d06-9ffa-71d78eaf365c admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:26.392226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c14459-70b2-4d06-9ffa-71d78eaf365c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:26.392226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c14459-70b2-4d06-9ffa-71d78eaf365c admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:26.483980 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 899/1794] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:26 2022] POST /identity/v3/users => generated 300 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:26.487989 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd489a9-9091-4561-89c1-eade13f16a1b admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:26.508198 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd489a9-9091-4561-89c1-eade13f16a1b admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:26.515372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624685f-76c1-4d90-82ec-afa088b534f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:26.517164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624685f-76c1-4d90-82ec-afa088b534f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:26.517879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624685f-76c1-4d90-82ec-afa088b534f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:26.517879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624685f-76c1-4d90-82ec-afa088b534f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:26.518585 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624685f-76c1-4d90-82ec-afa088b534f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:26.521055 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624685f-76c1-4d90-82ec-afa088b534f9 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:26.570687 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 896/1795] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:26.573082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c14459-70b2-4d06-9ffa-71d78eaf365c admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:26.609056 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c14459-70b2-4d06-9ffa-71d78eaf365c admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:26.631230 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1af762-8bce-4632-97e1-7e5279b2b5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:26.633778 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1af762-8bce-4632-97e1-7e5279b2b5bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:26.633990 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1af762-8bce-4632-97e1-7e5279b2b5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:26.635103 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1af762-8bce-4632-97e1-7e5279b2b5bb admin admin] PATH_INFO: `/v3/projects/c7a8b9c5d2bd4d04afb3abb2227aafc7/users/1c18e83fbf474ee5a6ad4f68765224aa/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:26.666526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1af762-8bce-4632-97e1-7e5279b2b5bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7a8b9c5d2bd4d04afb3abb2227aafc7, user_id=1c18e83fbf474ee5a6ad4f68765224aa, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:26.676557 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1af762-8bce-4632-97e1-7e5279b2b5bb admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:26.771510 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 900/1796] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:26 2022] PUT /identity/v3/projects/c7a8b9c5d2bd4d04afb3abb2227aafc7/users/1c18e83fbf474ee5a6ad4f68765224aa/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:26.771717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624685f-76c1-4d90-82ec-afa088b534f9 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:26.789012 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624685f-76c1-4d90-82ec-afa088b534f9 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:26.865470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:26.910677 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e51ad-f01a-4233-aab7-b08ffe153563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:26.911704 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e51ad-f01a-4233-aab7-b08ffe153563 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:26.912768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e51ad-f01a-4233-aab7-b08ffe153563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:26.914189 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e51ad-f01a-4233-aab7-b08ffe153563 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:26.918955 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e51ad-f01a-4233-aab7-b08ffe153563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:26.921221 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e51ad-f01a-4233-aab7-b08ffe153563 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:26.930304 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e6452-f5bf-4e4b-91e2-459a3e772b6d None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:26.938248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e6452-f5bf-4e4b-91e2-459a3e772b6d None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:26.938248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e6452-f5bf-4e4b-91e2-459a3e772b6d None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:26.938248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 901/1797] 10.222.0.77 () {54 vars in 921 bytes} [Tue Sep 6 20:27:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:27:26.947484 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e6452-f5bf-4e4b-91e2-459a3e772b6d None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:26.948187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 897/1798] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:26.958432 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e51ad-f01a-4233-aab7-b08ffe153563 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:26.970766 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-334e51ad-f01a-4233-aab7-b08ffe153563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:26.976398 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e6452-f5bf-4e4b-91e2-459a3e772b6d None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:26.997800 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b07c20-25c5-4ddb-9e32-b525f011517a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:26.999527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b07c20-25c5-4ddb-9e32-b525f011517a admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:26.999668 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e51ad-f01a-4233-aab7-b08ffe153563 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:27.001691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b07c20-25c5-4ddb-9e32-b525f011517a admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:27.008100 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b07c20-25c5-4ddb-9e32-b525f011517a admin admin] PATH_INFO: `/v3/projects/c7a8b9c5d2bd4d04afb3abb2227aafc7/users/1c18e83fbf474ee5a6ad4f68765224aa/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:27.012678 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613970ee-3818-4e94-9301-b6adebe2d1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:27.013433 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613970ee-3818-4e94-9301-b6adebe2d1df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:27.013700 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613970ee-3818-4e94-9301-b6adebe2d1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:27.013975 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613970ee-3818-4e94-9301-b6adebe2d1df admin admin] PATH_INFO: `/v3/users/351949b713174401925198d551813b21` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:27.015185 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613970ee-3818-4e94-9301-b6adebe2d1df admin admin] RBAC: Authorizing `identity:delete_user(user_id=351949b713174401925198d551813b21)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:27.017233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613970ee-3818-4e94-9301-b6adebe2d1df admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:27.019117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b07c20-25c5-4ddb-9e32-b525f011517a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7a8b9c5d2bd4d04afb3abb2227aafc7, user_id=1c18e83fbf474ee5a6ad4f68765224aa, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:27.029038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b07c20-25c5-4ddb-9e32-b525f011517a admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:27.079402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 902/1799] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:26 2022] PUT /identity/v3/projects/c7a8b9c5d2bd4d04afb3abb2227aafc7/users/1c18e83fbf474ee5a6ad4f68765224aa/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:27.104957 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b20ca-2003-4449-aece-8229f1356761 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:27.122296 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b20ca-2003-4449-aece-8229f1356761 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:27.122296 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b20ca-2003-4449-aece-8229f1356761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:27.222000 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-c05b20ca-2003-4449-aece-8229f1356761 None None] MFA Rules not processed for user `1c18e83fbf474ee5a6ad4f68765224aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:27.228839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c05b20ca-2003-4449-aece-8229f1356761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:27.315854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-613970ee-3818-4e94-9301-b6adebe2d1df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '351949b713174401925198d551813b21'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:27.430321 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-613970ee-3818-4e94-9301-b6adebe2d1df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '351949b713174401925198d551813b21'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:27.431666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-613970ee-3818-4e94-9301-b6adebe2d1df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '351949b713174401925198d551813b21'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:27.432571 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-613970ee-3818-4e94-9301-b6adebe2d1df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '351949b713174401925198d551813b21'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:27.446478 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 903/1800] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:27 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:27.452397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-613970ee-3818-4e94-9301-b6adebe2d1df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '351949b713174401925198d551813b21'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:27.452510 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1683206-4d76-4f8c-9a1c-44b3f9c15691 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:27.452510 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1683206-4d76-4f8c-9a1c-44b3f9c15691 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:27.452510 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1683206-4d76-4f8c-9a1c-44b3f9c15691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:27.459654 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:27.510714 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 898/1801] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:27:26 2022] DELETE /identity/v3/users/351949b713174401925198d551813b21 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:27.521107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa979464-31a7-476e-9b5f-0e2ece3e5dcf None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:27.522355 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa979464-31a7-476e-9b5f-0e2ece3e5dcf None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:27.523621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-c1683206-4d76-4f8c-9a1c-44b3f9c15691 None None] MFA Rules not processed for user `b09ce16da49b4af38491ad4eb6287d70`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:27.524013 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa979464-31a7-476e-9b5f-0e2ece3e5dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:27.526160 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c1683206-4d76-4f8c-9a1c-44b3f9c15691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:27.609842 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-aa979464-31a7-476e-9b5f-0e2ece3e5dcf None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:27.609842 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-aa979464-31a7-476e-9b5f-0e2ece3e5dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:27.795991 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 904/1802] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Sep 6 20:27:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:27.796902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1683206-4d76-4f8c-9a1c-44b3f9c15691 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:27.811672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c1683206-4d76-4f8c-9a1c-44b3f9c15691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:27.871809 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 899/1803] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:27.873979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa979464-31a7-476e-9b5f-0e2ece3e5dcf None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:27.875874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-aa979464-31a7-476e-9b5f-0e2ece3e5dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:27.905492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa979464-31a7-476e-9b5f-0e2ece3e5dcf None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:27.920121 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b4ece-b098-479b-af05-8d0070a9ebe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:27.921384 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b4ece-b098-479b-af05-8d0070a9ebe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:27.921895 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b4ece-b098-479b-af05-8d0070a9ebe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:27.922491 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b4ece-b098-479b-af05-8d0070a9ebe6 admin admin] PATH_INFO: `/v3/users/d80e0987324c42ad8cd8ff4631d721cc` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:27.924573 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b4ece-b098-479b-af05-8d0070a9ebe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d80e0987324c42ad8cd8ff4631d721cc)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:27.927313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b4ece-b098-479b-af05-8d0070a9ebe6 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:28.051109 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1683206-4d76-4f8c-9a1c-44b3f9c15691 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:28.065292 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a443d9-c5e8-46aa-8ae0-9fed36c0747f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:28.065953 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a443d9-c5e8-46aa-8ae0-9fed36c0747f service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:28.066234 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a443d9-c5e8-46aa-8ae0-9fed36c0747f service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:28.066501 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a443d9-c5e8-46aa-8ae0-9fed36c0747f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:28.086841 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-59a443d9-c5e8-46aa-8ae0-9fed36c0747f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:28.223069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a443d9-c5e8-46aa-8ae0-9fed36c0747f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:28.227158 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a443d9-c5e8-46aa-8ae0-9fed36c0747f service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:28.285990 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 905/1804] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:27 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:28.290067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a443d9-c5e8-46aa-8ae0-9fed36c0747f service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:28.314919 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-59a443d9-c5e8-46aa-8ae0-9fed36c0747f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:28.323129 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-fd0b4ece-b098-479b-af05-8d0070a9ebe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd80e0987324c42ad8cd8ff4631d721cc'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:28.480301 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a443d9-c5e8-46aa-8ae0-9fed36c0747f service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:28.485573 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ff239-c961-42f2-9877-486b60c26a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:28.486480 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ff239-c961-42f2-9877-486b60c26a6f service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:28.494474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ff239-c961-42f2-9877-486b60c26a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:28.494848 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ff239-c961-42f2-9877-486b60c26a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:28.506019 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-fd0b4ece-b098-479b-af05-8d0070a9ebe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd80e0987324c42ad8cd8ff4631d721cc'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:28.506019 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-fd0b4ece-b098-479b-af05-8d0070a9ebe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd80e0987324c42ad8cd8ff4631d721cc'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:28.506019 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-fd0b4ece-b098-479b-af05-8d0070a9ebe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd80e0987324c42ad8cd8ff4631d721cc'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:28.521179 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-fd0b4ece-b098-479b-af05-8d0070a9ebe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd80e0987324c42ad8cd8ff4631d721cc'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:28.528124 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ff239-c961-42f2-9877-486b60c26a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:28.533921 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ff239-c961-42f2-9877-486b60c26a6f service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:28.546335 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:28.574780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 906/1805] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:28.576287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 900/1806] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:27:27 2022] DELETE /identity/v3/users/d80e0987324c42ad8cd8ff4631d721cc => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:28.577402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b4ece-b098-479b-af05-8d0070a9ebe6 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:28.579868 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-fd0b4ece-b098-479b-af05-8d0070a9ebe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:28.583149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ff239-c961-42f2-9877-486b60c26a6f service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:28.590749 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-759ff239-c961-42f2-9877-486b60c26a6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:28.659569 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ff239-c961-42f2-9877-486b60c26a6f service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:28.703403 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b4ece-b098-479b-af05-8d0070a9ebe6 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:28.713035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a6cfa-3719-4e29-938e-27546aeee310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:28.714147 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a6cfa-3719-4e29-938e-27546aeee310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:28.715066 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a6cfa-3719-4e29-938e-27546aeee310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:28.715576 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a6cfa-3719-4e29-938e-27546aeee310 admin admin] PATH_INFO: `/v3/users/29ef8e6c419e40c0845cfb7afed8b375` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:28.726401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a6cfa-3719-4e29-938e-27546aeee310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29ef8e6c419e40c0845cfb7afed8b375)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:28.728761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a6cfa-3719-4e29-938e-27546aeee310 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:28.848085 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa8b19-ee34-420c-97a0-736096654d75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:28.849216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa8b19-ee34-420c-97a0-736096654d75 service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:28.849687 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa8b19-ee34-420c-97a0-736096654d75 service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:28.850110 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa8b19-ee34-420c-97a0-736096654d75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:28.853670 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c5aa8b19-ee34-420c-97a0-736096654d75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:28.881452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa8b19-ee34-420c-97a0-736096654d75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:28.881452 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa8b19-ee34-420c-97a0-736096654d75 service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:28.903497 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 907/1807] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:28.906122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e5500-0476-4952-a824-8505a1b4884f None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:28.907285 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e5500-0476-4952-a824-8505a1b4884f None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:28.908079 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e5500-0476-4952-a824-8505a1b4884f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:28.966031 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-ee6e5500-0476-4952-a824-8505a1b4884f None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:28.970959 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-ee6e5500-0476-4952-a824-8505a1b4884f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:29.010694 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 908/1808] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:29.021327 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-e19a6cfa-3719-4e29-938e-27546aeee310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29ef8e6c419e40c0845cfb7afed8b375'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:29.043274 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e5500-0476-4952-a824-8505a1b4884f None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:29.045770 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-ee6e5500-0476-4952-a824-8505a1b4884f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:29.119822 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-e19a6cfa-3719-4e29-938e-27546aeee310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29ef8e6c419e40c0845cfb7afed8b375'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:29.121791 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-e19a6cfa-3719-4e29-938e-27546aeee310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29ef8e6c419e40c0845cfb7afed8b375'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:29.123736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-e19a6cfa-3719-4e29-938e-27546aeee310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29ef8e6c419e40c0845cfb7afed8b375'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:29.154805 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-e19a6cfa-3719-4e29-938e-27546aeee310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29ef8e6c419e40c0845cfb7afed8b375'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:29.250913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 901/1809] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:27:28 2022] DELETE /identity/v3/users/29ef8e6c419e40c0845cfb7afed8b375 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:29.256536 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84a448-b65a-48cf-a17e-4f786bde6a90 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:29.256968 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84a448-b65a-48cf-a17e-4f786bde6a90 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:29.258510 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84a448-b65a-48cf-a17e-4f786bde6a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:29.282429 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e5500-0476-4952-a824-8505a1b4884f None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:29.310799 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-8c84a448-b65a-48cf-a17e-4f786bde6a90 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:29.310799 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-8c84a448-b65a-48cf-a17e-4f786bde6a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:29.486849 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4c870-25a9-4ffa-be5f-0417820cf765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:29.487813 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4c870-25a9-4ffa-be5f-0417820cf765 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:29.494254 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4c870-25a9-4ffa-be5f-0417820cf765 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:29.494254 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4c870-25a9-4ffa-be5f-0417820cf765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:29.494254 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-d4b4c870-25a9-4ffa-be5f-0417820cf765 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:29.500416 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 902/1810] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:29.531992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4c870-25a9-4ffa-be5f-0417820cf765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:29.533592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4c870-25a9-4ffa-be5f-0417820cf765 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:29.546809 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84a448-b65a-48cf-a17e-4f786bde6a90 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:29.549982 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-8c84a448-b65a-48cf-a17e-4f786bde6a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:29.586316 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84a448-b65a-48cf-a17e-4f786bde6a90 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:29.590176 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 909/1811] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:27:29.601795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870411ac-1fe4-4d48-9cda-9a0f1d64a454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:29.606350 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870411ac-1fe4-4d48-9cda-9a0f1d64a454 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:29.606350 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870411ac-1fe4-4d48-9cda-9a0f1d64a454 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:29.606350 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870411ac-1fe4-4d48-9cda-9a0f1d64a454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:29.638750 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870411ac-1fe4-4d48-9cda-9a0f1d64a454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:29.643082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870411ac-1fe4-4d48-9cda-9a0f1d64a454 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:29.686406 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 903/1812] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:30.101482 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4c870-25a9-4ffa-be5f-0417820cf765 service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:30.106168 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-d4b4c870-25a9-4ffa-be5f-0417820cf765 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:30.106300 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:30.136002 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4c870-25a9-4ffa-be5f-0417820cf765 service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:30.184264 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac285171-42fa-4e77-bdd4-84efa226d4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:30.187240 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac285171-42fa-4e77-bdd4-84efa226d4e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:30.188322 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac285171-42fa-4e77-bdd4-84efa226d4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:30.192287 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac285171-42fa-4e77-bdd4-84efa226d4e3 admin admin] PATH_INFO: `/v3/projects/31d2f1ec63364b14a0b3b01bc7f4072f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:30.193915 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac285171-42fa-4e77-bdd4-84efa226d4e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31d2f1ec63364b14a0b3b01bc7f4072f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:30.199138 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac285171-42fa-4e77-bdd4-84efa226d4e3 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:30.550285 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:30.574458 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-ac285171-42fa-4e77-bdd4-84efa226d4e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31d2f1ec63364b14a0b3b01bc7f4072f', 'request_id': 'req-ac285171-42fa-4e77-bdd4-84efa226d4e3'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:30.587385 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-ac285171-42fa-4e77-bdd4-84efa226d4e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31d2f1ec63364b14a0b3b01bc7f4072f', 'request_id': 'req-ac285171-42fa-4e77-bdd4-84efa226d4e3'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:30.685430 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-ac285171-42fa-4e77-bdd4-84efa226d4e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31d2f1ec63364b14a0b3b01bc7f4072f', 'request_id': 'req-ac285171-42fa-4e77-bdd4-84efa226d4e3'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:30.719376 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-ac285171-42fa-4e77-bdd4-84efa226d4e3 admin admin] The token cache is being invalidate because project 31d2f1ec63364b14a0b3b01bc7f4072f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:27:30.719833 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-ac285171-42fa-4e77-bdd4-84efa226d4e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:30.720694 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-ac285171-42fa-4e77-bdd4-84efa226d4e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:30.728993 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 910/1813] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:27:30 2022] DELETE /identity/v3/projects/31d2f1ec63364b14a0b3b01bc7f4072f => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:30.731868 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870411ac-1fe4-4d48-9cda-9a0f1d64a454 service neutron] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:30.762093 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870411ac-1fe4-4d48-9cda-9a0f1d64a454 service neutron] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:30.886661 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252adc07-4a39-4875-8ff0-01610bca89ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:30.887851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252adc07-4a39-4875-8ff0-01610bca89ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:30.888251 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252adc07-4a39-4875-8ff0-01610bca89ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:30.894134 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252adc07-4a39-4875-8ff0-01610bca89ef admin admin] PATH_INFO: `/v3/users/a739db51bc154f32a8611d6d987afbd6` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:30.894134 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252adc07-4a39-4875-8ff0-01610bca89ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=a739db51bc154f32a8611d6d987afbd6)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:30.894134 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252adc07-4a39-4875-8ff0-01610bca89ef admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:31.224092 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-252adc07-4a39-4875-8ff0-01610bca89ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a739db51bc154f32a8611d6d987afbd6'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:31.333783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-252adc07-4a39-4875-8ff0-01610bca89ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a739db51bc154f32a8611d6d987afbd6'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:31.334531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-252adc07-4a39-4875-8ff0-01610bca89ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a739db51bc154f32a8611d6d987afbd6'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:31.336142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-252adc07-4a39-4875-8ff0-01610bca89ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a739db51bc154f32a8611d6d987afbd6'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:31.347335 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-252adc07-4a39-4875-8ff0-01610bca89ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a739db51bc154f32a8611d6d987afbd6'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:31.445669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 904/1814] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:27:30 2022] DELETE /identity/v3/users/a739db51bc154f32a8611d6d987afbd6 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:31.638875 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bac23-cbd8-453a-8af3-179a57037a7b None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:31.639670 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bac23-cbd8-453a-8af3-179a57037a7b None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:31.639670 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bac23-cbd8-453a-8af3-179a57037a7b None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:31.641678 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 911/1815] 10.222.0.77 () {54 vars in 921 bytes} [Tue Sep 6 20:27:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:27:31.674614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a7f1c-6031-4b96-8048-4a743d3f6a39 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:31.674975 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a7f1c-6031-4b96-8048-4a743d3f6a39 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:31.675186 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a7f1c-6031-4b96-8048-4a743d3f6a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:31.728918 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-e20a7f1c-6031-4b96-8048-4a743d3f6a39 None None] MFA Rules not processed for user `b09ce16da49b4af38491ad4eb6287d70`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:31.746273 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-e20a7f1c-6031-4b96-8048-4a743d3f6a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:31.999906 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 905/1816] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Sep 6 20:27:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:32.065233 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bac23-cbd8-453a-8af3-179a57037a7b None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:32.067178 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c18bac23-cbd8-453a-8af3-179a57037a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:32.098599 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bac23-cbd8-453a-8af3-179a57037a7b None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:32.119898 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc358bf8-6f9d-412d-b838-0a40f6558e56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:32.119898 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc358bf8-6f9d-412d-b838-0a40f6558e56 service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:32.119898 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc358bf8-6f9d-412d-b838-0a40f6558e56 service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:32.119898 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc358bf8-6f9d-412d-b838-0a40f6558e56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:32.131756 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc358bf8-6f9d-412d-b838-0a40f6558e56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:32.143051 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc358bf8-6f9d-412d-b838-0a40f6558e56 service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:32.156851 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 912/1817] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:32.161949 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a7f1c-6031-4b96-8048-4a743d3f6a39 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:32.164893 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-e20a7f1c-6031-4b96-8048-4a743d3f6a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:32.292320 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc358bf8-6f9d-412d-b838-0a40f6558e56 service nova] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:32.293859 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-bc358bf8-6f9d-412d-b838-0a40f6558e56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:32.352293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a7f1c-6031-4b96-8048-4a743d3f6a39 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:32.365526 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38d68d-2126-4db3-a93c-e87ab9aa6f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:32.366250 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38d68d-2126-4db3-a93c-e87ab9aa6f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:32.366512 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38d68d-2126-4db3-a93c-e87ab9aa6f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:32.366937 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38d68d-2126-4db3-a93c-e87ab9aa6f0d admin admin] PATH_INFO: `/v3/projects/6f18e01ffd17431087af22fb41741631` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:32.370283 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38d68d-2126-4db3-a93c-e87ab9aa6f0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f18e01ffd17431087af22fb41741631)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:32.372351 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38d68d-2126-4db3-a93c-e87ab9aa6f0d admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:32.450764 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc358bf8-6f9d-412d-b838-0a40f6558e56 service nova] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:32.465133 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef36b93-aa02-40d5-871b-c06716daa8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:32.466958 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef36b93-aa02-40d5-871b-c06716daa8bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:32.466958 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef36b93-aa02-40d5-871b-c06716daa8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:32.466958 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef36b93-aa02-40d5-871b-c06716daa8bc admin admin] PATH_INFO: `/v3/projects/5c1a4423c3054d22b260baef13434c4e` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:32.470551 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef36b93-aa02-40d5-871b-c06716daa8bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c1a4423c3054d22b260baef13434c4e)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:32.484819 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef36b93-aa02-40d5-871b-c06716daa8bc admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:32.637703 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:32.684871 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-5f38d68d-2126-4db3-a93c-e87ab9aa6f0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f18e01ffd17431087af22fb41741631', 'request_id': 'req-5f38d68d-2126-4db3-a93c-e87ab9aa6f0d'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:32.738120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-5f38d68d-2126-4db3-a93c-e87ab9aa6f0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f18e01ffd17431087af22fb41741631', 'request_id': 'req-5f38d68d-2126-4db3-a93c-e87ab9aa6f0d'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:32.738407 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-5ef36b93-aa02-40d5-871b-c06716daa8bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c1a4423c3054d22b260baef13434c4e', 'request_id': 'req-5ef36b93-aa02-40d5-871b-c06716daa8bc'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:32.744709 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-5ef36b93-aa02-40d5-871b-c06716daa8bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c1a4423c3054d22b260baef13434c4e', 'request_id': 'req-5ef36b93-aa02-40d5-871b-c06716daa8bc'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:32.929595 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:32.957684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-5ef36b93-aa02-40d5-871b-c06716daa8bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c1a4423c3054d22b260baef13434c4e', 'request_id': 'req-5ef36b93-aa02-40d5-871b-c06716daa8bc'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:32.972279 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-5ef36b93-aa02-40d5-871b-c06716daa8bc admin admin] The token cache is being invalidate because project 5c1a4423c3054d22b260baef13434c4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:27:32.972584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-5ef36b93-aa02-40d5-871b-c06716daa8bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:32.973466 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-5ef36b93-aa02-40d5-871b-c06716daa8bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:32.975361 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 913/1818] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:27:32 2022] DELETE /identity/v3/projects/5c1a4423c3054d22b260baef13434c4e => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:32.979300 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef36b93-aa02-40d5-871b-c06716daa8bc admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:32.980777 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-5ef36b93-aa02-40d5-871b-c06716daa8bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:33.058182 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-5f38d68d-2126-4db3-a93c-e87ab9aa6f0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f18e01ffd17431087af22fb41741631', 'request_id': 'req-5f38d68d-2126-4db3-a93c-e87ab9aa6f0d'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:33.071873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-5f38d68d-2126-4db3-a93c-e87ab9aa6f0d admin admin] The token cache is being invalidate because project 6f18e01ffd17431087af22fb41741631 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:27:33.072161 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-5f38d68d-2126-4db3-a93c-e87ab9aa6f0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:33.074871 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-5f38d68d-2126-4db3-a93c-e87ab9aa6f0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:33.077073 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 906/1819] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:27:32 2022] DELETE /identity/v3/projects/6f18e01ffd17431087af22fb41741631 => generated 0 bytes in 916 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:33.089798 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38d68d-2126-4db3-a93c-e87ab9aa6f0d admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:33.091564 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-5f38d68d-2126-4db3-a93c-e87ab9aa6f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:33.123292 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef36b93-aa02-40d5-871b-c06716daa8bc admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:33.134933 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032fa89-406d-445c-be6a-74875fb10afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:33.138270 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032fa89-406d-445c-be6a-74875fb10afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:33.138270 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032fa89-406d-445c-be6a-74875fb10afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:33.138270 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032fa89-406d-445c-be6a-74875fb10afc admin admin] PATH_INFO: `/v3/users/df61106fcf3a498ba7ea2af34273ba07` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:33.138270 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032fa89-406d-445c-be6a-74875fb10afc admin admin] RBAC: Authorizing `identity:delete_user(user_id=df61106fcf3a498ba7ea2af34273ba07)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:33.139433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032fa89-406d-445c-be6a-74875fb10afc admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:33.286955 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38d68d-2126-4db3-a93c-e87ab9aa6f0d admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:33.292538 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa0a28-24e7-4f7c-9122-a6a7615f63ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:33.293583 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa0a28-24e7-4f7c-9122-a6a7615f63ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:33.294069 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa0a28-24e7-4f7c-9122-a6a7615f63ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:33.294726 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa0a28-24e7-4f7c-9122-a6a7615f63ac admin admin] PATH_INFO: `/v3/users/1c18e83fbf474ee5a6ad4f68765224aa` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:33.296465 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa0a28-24e7-4f7c-9122-a6a7615f63ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c18e83fbf474ee5a6ad4f68765224aa)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:33.299261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa0a28-24e7-4f7c-9122-a6a7615f63ac admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:33.400465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f032fa89-406d-445c-be6a-74875fb10afc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df61106fcf3a498ba7ea2af34273ba07'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:33.470782 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f032fa89-406d-445c-be6a-74875fb10afc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df61106fcf3a498ba7ea2af34273ba07'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:33.471636 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f032fa89-406d-445c-be6a-74875fb10afc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df61106fcf3a498ba7ea2af34273ba07'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:33.472373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f032fa89-406d-445c-be6a-74875fb10afc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df61106fcf3a498ba7ea2af34273ba07'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:33.481719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f032fa89-406d-445c-be6a-74875fb10afc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df61106fcf3a498ba7ea2af34273ba07'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:33.501905 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 914/1820] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:27:32 2022] DELETE /identity/v3/users/df61106fcf3a498ba7ea2af34273ba07 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:27:33.502834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032fa89-406d-445c-be6a-74875fb10afc admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:33.504299 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f032fa89-406d-445c-be6a-74875fb10afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:33.575050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-cdaa0a28-24e7-4f7c-9122-a6a7615f63ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c18e83fbf474ee5a6ad4f68765224aa'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:33.581785 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032fa89-406d-445c-be6a-74875fb10afc admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:33.587772 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22340b44-8edc-47fc-85e1-002427dddf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:33.588634 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22340b44-8edc-47fc-85e1-002427dddf8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:33.589006 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22340b44-8edc-47fc-85e1-002427dddf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:33.589373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22340b44-8edc-47fc-85e1-002427dddf8f admin admin] PATH_INFO: `/v3/projects/f479dbd2c5864982a45e9b57ec86b436` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:33.590940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22340b44-8edc-47fc-85e1-002427dddf8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f479dbd2c5864982a45e9b57ec86b436)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:33.596836 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22340b44-8edc-47fc-85e1-002427dddf8f admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:33.682347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-cdaa0a28-24e7-4f7c-9122-a6a7615f63ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c18e83fbf474ee5a6ad4f68765224aa'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:33.683079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-cdaa0a28-24e7-4f7c-9122-a6a7615f63ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c18e83fbf474ee5a6ad4f68765224aa'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:33.683710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-cdaa0a28-24e7-4f7c-9122-a6a7615f63ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c18e83fbf474ee5a6ad4f68765224aa'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:33.692217 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-cdaa0a28-24e7-4f7c-9122-a6a7615f63ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c18e83fbf474ee5a6ad4f68765224aa'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:33.712129 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 907/1821] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:27:33 2022] DELETE /identity/v3/users/1c18e83fbf474ee5a6ad4f68765224aa => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:33.752851 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-22340b44-8edc-47fc-85e1-002427dddf8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f479dbd2c5864982a45e9b57ec86b436', 'request_id': 'req-22340b44-8edc-47fc-85e1-002427dddf8f'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:33.762272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-22340b44-8edc-47fc-85e1-002427dddf8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f479dbd2c5864982a45e9b57ec86b436', 'request_id': 'req-22340b44-8edc-47fc-85e1-002427dddf8f'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:33.859554 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-22340b44-8edc-47fc-85e1-002427dddf8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f479dbd2c5864982a45e9b57ec86b436', 'request_id': 'req-22340b44-8edc-47fc-85e1-002427dddf8f'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:33.875337 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-22340b44-8edc-47fc-85e1-002427dddf8f admin admin] The token cache is being invalidate because project f479dbd2c5864982a45e9b57ec86b436 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:27:33.876267 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-22340b44-8edc-47fc-85e1-002427dddf8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:33.876431 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-22340b44-8edc-47fc-85e1-002427dddf8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:33.878255 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 915/1822] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:27:33 2022] DELETE /identity/v3/projects/f479dbd2c5864982a45e9b57ec86b436 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:33.884513 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc492a31-5e0e-4943-97de-4918bf569a15 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:33.884885 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc492a31-5e0e-4943-97de-4918bf569a15 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:33.885255 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc492a31-5e0e-4943-97de-4918bf569a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:33.961843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-cc492a31-5e0e-4943-97de-4918bf569a15 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:33.963112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-cc492a31-5e0e-4943-97de-4918bf569a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:34.068104 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 908/1823] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:34.083097 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42773279-5675-450a-9d6d-fec6c8e23be6 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:34.083273 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42773279-5675-450a-9d6d-fec6c8e23be6 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:34.083627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42773279-5675-450a-9d6d-fec6c8e23be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:34.108926 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-42773279-5675-450a-9d6d-fec6c8e23be6 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:34.110367 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-42773279-5675-450a-9d6d-fec6c8e23be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:34.124434 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 916/1824] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:34.133313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc492a31-5e0e-4943-97de-4918bf569a15 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:34.146562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42773279-5675-450a-9d6d-fec6c8e23be6 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:34.157038 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc492a31-5e0e-4943-97de-4918bf569a15 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:34.162650 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-42773279-5675-450a-9d6d-fec6c8e23be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:34.165463 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc016f4-f6fb-4a0f-b27b-38eadc971a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:34.166465 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc016f4-f6fb-4a0f-b27b-38eadc971a91 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:34.166814 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc016f4-f6fb-4a0f-b27b-38eadc971a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:34.167248 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc016f4-f6fb-4a0f-b27b-38eadc971a91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:34.168414 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc016f4-f6fb-4a0f-b27b-38eadc971a91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:27:34.168899 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc016f4-f6fb-4a0f-b27b-38eadc971a91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:34.186898 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc016f4-f6fb-4a0f-b27b-38eadc971a91 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:34.213936 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 909/1825] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:27:34.214991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc016f4-f6fb-4a0f-b27b-38eadc971a91 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:34.220202 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42773279-5675-450a-9d6d-fec6c8e23be6 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:34.235225 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc016f4-f6fb-4a0f-b27b-38eadc971a91 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:34.235571 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf34afe-56f7-4be0-be27-cb2f6758ea60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:34.236832 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf34afe-56f7-4be0-be27-cb2f6758ea60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:34.237594 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf34afe-56f7-4be0-be27-cb2f6758ea60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:34.238687 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf34afe-56f7-4be0-be27-cb2f6758ea60 admin admin] PATH_INFO: `/v3/projects/d1add75105d147cc8edd08cdf8c6b4f8` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:34.258979 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf34afe-56f7-4be0-be27-cb2f6758ea60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1add75105d147cc8edd08cdf8c6b4f8)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:34.261533 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf34afe-56f7-4be0-be27-cb2f6758ea60 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:34.279778 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07c2af-4abf-4e1d-85b4-32279b3ed118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:34.285470 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07c2af-4abf-4e1d-85b4-32279b3ed118 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:34.285866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07c2af-4abf-4e1d-85b4-32279b3ed118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:34.286178 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07c2af-4abf-4e1d-85b4-32279b3ed118 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:34.288095 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07c2af-4abf-4e1d-85b4-32279b3ed118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:34.294191 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07c2af-4abf-4e1d-85b4-32279b3ed118 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:34.443365 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-2bf34afe-56f7-4be0-be27-cb2f6758ea60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1add75105d147cc8edd08cdf8c6b4f8', 'request_id': 'req-2bf34afe-56f7-4be0-be27-cb2f6758ea60'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:34.479598 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-2bf34afe-56f7-4be0-be27-cb2f6758ea60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1add75105d147cc8edd08cdf8c6b4f8', 'request_id': 'req-2bf34afe-56f7-4be0-be27-cb2f6758ea60'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:34.525504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 910/1826] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:34 2022] POST /identity/v3/projects => generated 391 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:34.526446 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07c2af-4abf-4e1d-85b4-32279b3ed118 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:34.627562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-2bf34afe-56f7-4be0-be27-cb2f6758ea60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1add75105d147cc8edd08cdf8c6b4f8', 'request_id': 'req-2bf34afe-56f7-4be0-be27-cb2f6758ea60'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:34.640350 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-2bf34afe-56f7-4be0-be27-cb2f6758ea60 admin admin] The token cache is being invalidate because project d1add75105d147cc8edd08cdf8c6b4f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:27:34.642886 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:34.643402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-2bf34afe-56f7-4be0-be27-cb2f6758ea60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:34.643402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-2bf34afe-56f7-4be0-be27-cb2f6758ea60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:34.648159 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 917/1827] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:27:34 2022] DELETE /identity/v3/projects/d1add75105d147cc8edd08cdf8c6b4f8 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:34.648159 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf34afe-56f7-4be0-be27-cb2f6758ea60 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:34.648159 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-2bf34afe-56f7-4be0-be27-cb2f6758ea60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:34.688371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07c2af-4abf-4e1d-85b4-32279b3ed118 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:34.694787 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d499a08-3988-4b65-85d3-d84069257743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:34.695972 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d499a08-3988-4b65-85d3-d84069257743 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:34.696458 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d499a08-3988-4b65-85d3-d84069257743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:34.696903 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d499a08-3988-4b65-85d3-d84069257743 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:34.697731 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d499a08-3988-4b65-85d3-d84069257743 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:34.699996 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d499a08-3988-4b65-85d3-d84069257743 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:34.722111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:34.772818 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf34afe-56f7-4be0-be27-cb2f6758ea60 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:34.777882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96585fca-edd0-47ac-bad9-ec879209f8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:34.778569 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96585fca-edd0-47ac-bad9-ec879209f8fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:34.778848 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96585fca-edd0-47ac-bad9-ec879209f8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:34.779234 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96585fca-edd0-47ac-bad9-ec879209f8fb admin admin] PATH_INFO: `/v3/projects/c7a8b9c5d2bd4d04afb3abb2227aafc7` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:34.780538 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96585fca-edd0-47ac-bad9-ec879209f8fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7a8b9c5d2bd4d04afb3abb2227aafc7)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:34.782492 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96585fca-edd0-47ac-bad9-ec879209f8fb admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:34.875805 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 911/1828] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:34 2022] POST /identity/v3/users => generated 296 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:34.877170 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30c0e4-e17d-43f1-b579-af92af494f94 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:34.877457 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30c0e4-e17d-43f1-b579-af92af494f94 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:34.877733 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30c0e4-e17d-43f1-b579-af92af494f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:34.900461 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-0c30c0e4-e17d-43f1-b579-af92af494f94 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:34.901845 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-0c30c0e4-e17d-43f1-b579-af92af494f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:34.918352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 912/1829] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:34.918352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30c0e4-e17d-43f1-b579-af92af494f94 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:34.918352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-0c30c0e4-e17d-43f1-b579-af92af494f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:34.931620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30c0e4-e17d-43f1-b579-af92af494f94 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:34.941701 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08444a59-8a81-4e24-83ae-d77f842d9be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:34.945266 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08444a59-8a81-4e24-83ae-d77f842d9be1 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:34.945266 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08444a59-8a81-4e24-83ae-d77f842d9be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:34.945266 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08444a59-8a81-4e24-83ae-d77f842d9be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:34.945266 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08444a59-8a81-4e24-83ae-d77f842d9be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:34.946666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08444a59-8a81-4e24-83ae-d77f842d9be1 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:34.961952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-96585fca-edd0-47ac-bad9-ec879209f8fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7a8b9c5d2bd4d04afb3abb2227aafc7', 'request_id': 'req-96585fca-edd0-47ac-bad9-ec879209f8fb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:34.966546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 913/1830] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:34.968177 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36b9ba-7eb9-4481-97c6-a43f8d5121ab None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:34.968529 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36b9ba-7eb9-4481-97c6-a43f8d5121ab None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:34.969164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36b9ba-7eb9-4481-97c6-a43f8d5121ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:34.978497 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-96585fca-edd0-47ac-bad9-ec879209f8fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7a8b9c5d2bd4d04afb3abb2227aafc7', 'request_id': 'req-96585fca-edd0-47ac-bad9-ec879209f8fb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:35.008397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-4e36b9ba-7eb9-4481-97c6-a43f8d5121ab None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:35.011126 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-4e36b9ba-7eb9-4481-97c6-a43f8d5121ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:35.088210 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-96585fca-edd0-47ac-bad9-ec879209f8fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7a8b9c5d2bd4d04afb3abb2227aafc7', 'request_id': 'req-96585fca-edd0-47ac-bad9-ec879209f8fb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:35.108094 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 914/1831] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:35.109087 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36b9ba-7eb9-4481-97c6-a43f8d5121ab None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:35.112420 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-96585fca-edd0-47ac-bad9-ec879209f8fb admin admin] The token cache is being invalidate because project c7a8b9c5d2bd4d04afb3abb2227aafc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:27:35.112770 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-96585fca-edd0-47ac-bad9-ec879209f8fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:35.113789 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-96585fca-edd0-47ac-bad9-ec879209f8fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:35.117798 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 918/1832] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:27:34 2022] DELETE /identity/v3/projects/c7a8b9c5d2bd4d04afb3abb2227aafc7 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:35.117798 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96585fca-edd0-47ac-bad9-ec879209f8fb admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:35.125148 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-96585fca-edd0-47ac-bad9-ec879209f8fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:35.129722 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36b9ba-7eb9-4481-97c6-a43f8d5121ab None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:35.148575 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f7f0f-c975-45d1-a398-4f69d8d7eb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:35.149378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f7f0f-c975-45d1-a398-4f69d8d7eb63 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:35.149737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f7f0f-c975-45d1-a398-4f69d8d7eb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:35.150097 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f7f0f-c975-45d1-a398-4f69d8d7eb63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:35.150838 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f7f0f-c975-45d1-a398-4f69d8d7eb63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:35.152612 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f7f0f-c975-45d1-a398-4f69d8d7eb63 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:35.156780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96585fca-edd0-47ac-bad9-ec879209f8fb admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:35.169703 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bacf85-a6c1-4dde-a8ad-2a66242c0e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:35.171391 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bacf85-a6c1-4dde-a8ad-2a66242c0e1f admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:35.171742 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bacf85-a6c1-4dde-a8ad-2a66242c0e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:35.172601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bacf85-a6c1-4dde-a8ad-2a66242c0e1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:35.172931 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bacf85-a6c1-4dde-a8ad-2a66242c0e1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:27:35.173247 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bacf85-a6c1-4dde-a8ad-2a66242c0e1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:35.175677 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 915/1833] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:35.181126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bacf85-a6c1-4dde-a8ad-2a66242c0e1f admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:35.182393 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b075c1-f865-4df2-8784-f08a8b3496a4 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:35.183048 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b075c1-f865-4df2-8784-f08a8b3496a4 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:35.183568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b075c1-f865-4df2-8784-f08a8b3496a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:35.210934 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 919/1834] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:27:35.216090 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bacf85-a6c1-4dde-a8ad-2a66242c0e1f admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:35.218200 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-36bacf85-a6c1-4dde-a8ad-2a66242c0e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:35.223865 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-d2b075c1-f865-4df2-8784-f08a8b3496a4 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:35.226836 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-d2b075c1-f865-4df2-8784-f08a8b3496a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:35.243835 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bacf85-a6c1-4dde-a8ad-2a66242c0e1f admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:35.249445 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ab75d-173e-4a24-90cd-6c886037b066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:35.250819 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ab75d-173e-4a24-90cd-6c886037b066 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:35.251282 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ab75d-173e-4a24-90cd-6c886037b066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:35.251917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ab75d-173e-4a24-90cd-6c886037b066 admin admin] PATH_INFO: `/v3/projects/96d5783ed01347928b74f077f24f3404/users/27ea0d4b49654644b6de9a1ea5b893fd/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:35.254353 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 916/1835] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:35.274217 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b075c1-f865-4df2-8784-f08a8b3496a4 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:35.286256 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b075c1-f865-4df2-8784-f08a8b3496a4 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:35.299314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ab75d-173e-4a24-90cd-6c886037b066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d5783ed01347928b74f077f24f3404, user_id=27ea0d4b49654644b6de9a1ea5b893fd, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:35.302059 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ab75d-173e-4a24-90cd-6c886037b066 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:35.308009 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66dbfa6-297e-4de5-852f-d0d669c91c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:35.310361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66dbfa6-297e-4de5-852f-d0d669c91c74 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:35.311170 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66dbfa6-297e-4de5-852f-d0d669c91c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:35.311705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66dbfa6-297e-4de5-852f-d0d669c91c74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:35.312724 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66dbfa6-297e-4de5-852f-d0d669c91c74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:35.319145 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66dbfa6-297e-4de5-852f-d0d669c91c74 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:35.381930 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 920/1836] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:35 2022] PUT /identity/v3/projects/96d5783ed01347928b74f077f24f3404/users/27ea0d4b49654644b6de9a1ea5b893fd/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:35.383095 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25e84b-cd1d-4033-a46d-aba7f083ce5d None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:35.383381 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25e84b-cd1d-4033-a46d-aba7f083ce5d None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:35.388132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25e84b-cd1d-4033-a46d-aba7f083ce5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:35.428119 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-8a25e84b-cd1d-4033-a46d-aba7f083ce5d None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:35.429896 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-8a25e84b-cd1d-4033-a46d-aba7f083ce5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:35.480884 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 917/1837] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:35 2022] POST /identity/v3/projects => generated 379 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:35.488053 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336c084-699f-4d2b-8b91-a52284aed3f5 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:35.488439 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336c084-699f-4d2b-8b91-a52284aed3f5 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:35.488769 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336c084-699f-4d2b-8b91-a52284aed3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:35.521747 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 921/1838] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:35.521747 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25e84b-cd1d-4033-a46d-aba7f083ce5d None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:35.529429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-a336c084-699f-4d2b-8b91-a52284aed3f5 None None] MFA Rules not processed for user `27ea0d4b49654644b6de9a1ea5b893fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:35.530673 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-a336c084-699f-4d2b-8b91-a52284aed3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:35.532084 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25e84b-cd1d-4033-a46d-aba7f083ce5d None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:35.621603 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b857e8-fd5a-447f-8547-9b8fa6ba3fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:35.622306 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b857e8-fd5a-447f-8547-9b8fa6ba3fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:35.622798 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b857e8-fd5a-447f-8547-9b8fa6ba3fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:35.623084 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b857e8-fd5a-447f-8547-9b8fa6ba3fe1 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:35.623829 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b857e8-fd5a-447f-8547-9b8fa6ba3fe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:35.625972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b857e8-fd5a-447f-8547-9b8fa6ba3fe1 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:35.646100 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 918/1839] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:35.647008 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336c084-699f-4d2b-8b91-a52284aed3f5 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:35.690073 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336c084-699f-4d2b-8b91-a52284aed3f5 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:35.700920 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76c01a-5246-46c7-ad3c-96a32efc4773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:35.702680 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76c01a-5246-46c7-ad3c-96a32efc4773 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:35.703212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76c01a-5246-46c7-ad3c-96a32efc4773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:35.703851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76c01a-5246-46c7-ad3c-96a32efc4773 admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:35.704591 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76c01a-5246-46c7-ad3c-96a32efc4773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:27:35.706375 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76c01a-5246-46c7-ad3c-96a32efc4773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:35.706801 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76c01a-5246-46c7-ad3c-96a32efc4773 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:35.735893 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 922/1840] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:35 2022] POST /identity/v3/users => generated 290 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:35.737390 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b857e8-fd5a-447f-8547-9b8fa6ba3fe1 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:35.742486 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 919/1841] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:27:35.743495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76c01a-5246-46c7-ad3c-96a32efc4773 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:35.758780 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76c01a-5246-46c7-ad3c-96a32efc4773 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:35.764074 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b857e8-fd5a-447f-8547-9b8fa6ba3fe1 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:35.764598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a08104-33e1-43de-a047-7568256c2250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:35.765247 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a08104-33e1-43de-a047-7568256c2250 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:35.765519 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a08104-33e1-43de-a047-7568256c2250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:35.765820 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a08104-33e1-43de-a047-7568256c2250 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:35.766453 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a08104-33e1-43de-a047-7568256c2250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:35.777011 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a08104-33e1-43de-a047-7568256c2250 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:35.793205 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 920/1842] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:35.794092 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a08104-33e1-43de-a047-7568256c2250 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:35.796198 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23771b2f-d4c3-4f73-b751-1ec32393dddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:35.797031 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23771b2f-d4c3-4f73-b751-1ec32393dddc admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:35.797472 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23771b2f-d4c3-4f73-b751-1ec32393dddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:35.797904 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23771b2f-d4c3-4f73-b751-1ec32393dddc admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:35.798717 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23771b2f-d4c3-4f73-b751-1ec32393dddc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:35.801074 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23771b2f-d4c3-4f73-b751-1ec32393dddc admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:35.811643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a08104-33e1-43de-a047-7568256c2250 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:35.821637 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d194e-2e2e-4f2e-8ed1-4799496827de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:35.823898 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d194e-2e2e-4f2e-8ed1-4799496827de admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:35.831874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d194e-2e2e-4f2e-8ed1-4799496827de admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:35.832329 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d194e-2e2e-4f2e-8ed1-4799496827de admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:35.835980 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d194e-2e2e-4f2e-8ed1-4799496827de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:35.842232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d194e-2e2e-4f2e-8ed1-4799496827de admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:35.960517 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 923/1843] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:35 2022] POST /identity/v3/projects => generated 391 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:35.961514 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23771b2f-d4c3-4f73-b751-1ec32393dddc admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:35.984140 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 921/1844] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:35 2022] POST /identity/v3/projects => generated 381 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:35.985159 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d194e-2e2e-4f2e-8ed1-4799496827de admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:36.045584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23771b2f-d4c3-4f73-b751-1ec32393dddc admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:36.081246 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d194e-2e2e-4f2e-8ed1-4799496827de admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:36.086984 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f962b-1423-4a6e-a032-843f7ab1e033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:36.087638 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f962b-1423-4a6e-a032-843f7ab1e033 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:36.087913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f962b-1423-4a6e-a032-843f7ab1e033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:36.088180 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f962b-1423-4a6e-a032-843f7ab1e033 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:36.088812 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f962b-1423-4a6e-a032-843f7ab1e033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:36.090804 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f962b-1423-4a6e-a032-843f7ab1e033 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:36.112502 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18591e-1e59-4e5f-8b08-fcd4ff8bacce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:36.113091 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18591e-1e59-4e5f-8b08-fcd4ff8bacce admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:36.113466 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18591e-1e59-4e5f-8b08-fcd4ff8bacce admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:36.113745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18591e-1e59-4e5f-8b08-fcd4ff8bacce admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:36.114399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18591e-1e59-4e5f-8b08-fcd4ff8bacce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:36.116248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18591e-1e59-4e5f-8b08-fcd4ff8bacce admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:36.127885 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 924/1845] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:36.132298 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18591e-1e59-4e5f-8b08-fcd4ff8bacce admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:36.142567 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18591e-1e59-4e5f-8b08-fcd4ff8bacce admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:36.147803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d976626-0867-4b58-bedc-1c10e7471f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:36.148480 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d976626-0867-4b58-bedc-1c10e7471f11 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:36.148707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d976626-0867-4b58-bedc-1c10e7471f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:36.148986 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d976626-0867-4b58-bedc-1c10e7471f11 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:36.149738 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d976626-0867-4b58-bedc-1c10e7471f11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:36.151947 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d976626-0867-4b58-bedc-1c10e7471f11 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:36.173080 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 922/1846] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:35 2022] POST /identity/v3/users => generated 302 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:36.173080 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f962b-1423-4a6e-a032-843f7ab1e033 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:36.183610 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f962b-1423-4a6e-a032-843f7ab1e033 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:36.188329 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a943e-10ca-4963-8d07-4036b3e0157d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:36.188888 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a943e-10ca-4963-8d07-4036b3e0157d admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:36.189185 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a943e-10ca-4963-8d07-4036b3e0157d admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:36.189454 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a943e-10ca-4963-8d07-4036b3e0157d admin admin] PATH_INFO: `/v3/projects/90b60dbdcd4943298d1df11612a24455/users/08da38d347a94415ac315d98fe460e47/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:36.197472 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:36.208886 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a943e-10ca-4963-8d07-4036b3e0157d admin admin] RBAC: Authorizing `identity:create_grant(project_id=90b60dbdcd4943298d1df11612a24455, user_id=08da38d347a94415ac315d98fe460e47, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:36.212582 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a943e-10ca-4963-8d07-4036b3e0157d admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:36.307265 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:36.313192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 923/1847] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:36 2022] PUT /identity/v3/projects/90b60dbdcd4943298d1df11612a24455/users/08da38d347a94415ac315d98fe460e47/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:36.316455 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 925/1848] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:36 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:36.316578 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a943e-10ca-4963-8d07-4036b3e0157d admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:36.318825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d976626-0867-4b58-bedc-1c10e7471f11 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:36.330526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d976626-0867-4b58-bedc-1c10e7471f11 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:36.387949 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a943e-10ca-4963-8d07-4036b3e0157d admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:36.393126 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad80ce-4580-41fd-9c8f-215df05198b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:36.393752 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad80ce-4580-41fd-9c8f-215df05198b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:36.394024 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad80ce-4580-41fd-9c8f-215df05198b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:36.394292 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad80ce-4580-41fd-9c8f-215df05198b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:36.394982 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad80ce-4580-41fd-9c8f-215df05198b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:36.395473 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5fe62-765c-4f8d-acb4-c521f320e557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:36.396160 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5fe62-765c-4f8d-acb4-c521f320e557 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:36.396588 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5fe62-765c-4f8d-acb4-c521f320e557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:36.396752 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad80ce-4580-41fd-9c8f-215df05198b5 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:36.396864 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5fe62-765c-4f8d-acb4-c521f320e557 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:36.398158 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5fe62-765c-4f8d-acb4-c521f320e557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:36.399914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5fe62-765c-4f8d-acb4-c521f320e557 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:36.410267 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 924/1849] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:36.411895 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9e9fd-d96f-4fb4-9bef-f5317057dee0 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:36.412295 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9e9fd-d96f-4fb4-9bef-f5317057dee0 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:36.412724 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9e9fd-d96f-4fb4-9bef-f5317057dee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:36.415528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 926/1850] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:27:36.416267 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5fe62-765c-4f8d-acb4-c521f320e557 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:36.429302 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5fe62-765c-4f8d-acb4-c521f320e557 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:36.434480 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508d272-5e33-4c26-b4e2-07f1d6cc8445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:36.435149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508d272-5e33-4c26-b4e2-07f1d6cc8445 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:36.435769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508d272-5e33-4c26-b4e2-07f1d6cc8445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:36.435959 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508d272-5e33-4c26-b4e2-07f1d6cc8445 admin admin] PATH_INFO: `/v3/projects/9f611657232c435c9e73bcd3cc50f3a1/users/faac501bcdb345829f47e8e97b52d6e0/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:36.452268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508d272-5e33-4c26-b4e2-07f1d6cc8445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f611657232c435c9e73bcd3cc50f3a1, user_id=faac501bcdb345829f47e8e97b52d6e0, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:36.455351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508d272-5e33-4c26-b4e2-07f1d6cc8445 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:36.465734 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-1bc9e9fd-d96f-4fb4-9bef-f5317057dee0 None None] MFA Rules not processed for user `08da38d347a94415ac315d98fe460e47`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:36.467915 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-1bc9e9fd-d96f-4fb4-9bef-f5317057dee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:36.547309 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 925/1851] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:36.567633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9e9fd-d96f-4fb4-9bef-f5317057dee0 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:36.567633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9e9fd-d96f-4fb4-9bef-f5317057dee0 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:36.567633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca95526-b0c4-479b-a058-d7af92c9fe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:36.567633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca95526-b0c4-479b-a058-d7af92c9fe74 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:36.568196 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca95526-b0c4-479b-a058-d7af92c9fe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:36.568368 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca95526-b0c4-479b-a058-d7af92c9fe74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:36.570045 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca95526-b0c4-479b-a058-d7af92c9fe74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:36.571725 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca95526-b0c4-479b-a058-d7af92c9fe74 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:36.582531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 926/1852] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:36.583371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca95526-b0c4-479b-a058-d7af92c9fe74 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:36.594664 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca95526-b0c4-479b-a058-d7af92c9fe74 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:36.599633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0b9de-158c-4473-833f-6c5c3f445657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:36.600253 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0b9de-158c-4473-833f-6c5c3f445657 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:36.600871 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0b9de-158c-4473-833f-6c5c3f445657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:36.601267 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0b9de-158c-4473-833f-6c5c3f445657 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:36.601910 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0b9de-158c-4473-833f-6c5c3f445657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:36.604018 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0b9de-158c-4473-833f-6c5c3f445657 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:36.652828 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 927/1853] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:36 2022] PUT /identity/v3/projects/9f611657232c435c9e73bcd3cc50f3a1/users/faac501bcdb345829f47e8e97b52d6e0/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:36.654482 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508d272-5e33-4c26-b4e2-07f1d6cc8445 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:36.734509 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508d272-5e33-4c26-b4e2-07f1d6cc8445 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:36.740752 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b068290-2811-4106-a442-86f260a95f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:36.742354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b068290-2811-4106-a442-86f260a95f59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:36.745364 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b068290-2811-4106-a442-86f260a95f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:36.745364 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b068290-2811-4106-a442-86f260a95f59 admin admin] PATH_INFO: `/v3/projects/db58749551014d64a9093e4616714bfe/users/9c2b82f38c0c48f38c10a913cb026cf6/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:36.760604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b068290-2811-4106-a442-86f260a95f59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db58749551014d64a9093e4616714bfe, user_id=9c2b82f38c0c48f38c10a913cb026cf6, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:36.767631 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b068290-2811-4106-a442-86f260a95f59 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:36.779122 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 927/1854] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:36 2022] POST /identity/v3/projects => generated 377 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:36.780212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0b9de-158c-4473-833f-6c5c3f445657 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:36.856711 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0b9de-158c-4473-833f-6c5c3f445657 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:36.862021 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcba4f-afdf-4952-88eb-baa628c9fc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:36.862691 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcba4f-afdf-4952-88eb-baa628c9fc95 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:36.862978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcba4f-afdf-4952-88eb-baa628c9fc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:36.863403 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcba4f-afdf-4952-88eb-baa628c9fc95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:36.864129 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcba4f-afdf-4952-88eb-baa628c9fc95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:36.865862 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcba4f-afdf-4952-88eb-baa628c9fc95 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:36.879094 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 928/1855] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:36.879962 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcba4f-afdf-4952-88eb-baa628c9fc95 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:36.892120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcba4f-afdf-4952-88eb-baa628c9fc95 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:36.897165 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ee8f7-be59-4968-9e1e-4a5f8668dc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:36.897795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ee8f7-be59-4968-9e1e-4a5f8668dc0d admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:36.898141 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ee8f7-be59-4968-9e1e-4a5f8668dc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:36.898401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ee8f7-be59-4968-9e1e-4a5f8668dc0d admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:36.899038 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ee8f7-be59-4968-9e1e-4a5f8668dc0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:36.901021 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ee8f7-be59-4968-9e1e-4a5f8668dc0d admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:36.943549 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 928/1856] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:36 2022] PUT /identity/v3/projects/db58749551014d64a9093e4616714bfe/users/9c2b82f38c0c48f38c10a913cb026cf6/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:36.949712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b068290-2811-4106-a442-86f260a95f59 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:37.023709 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b068290-2811-4106-a442-86f260a95f59 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:37.028599 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5cf87-1037-410b-97c7-51259da1c3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:37.029383 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5cf87-1037-410b-97c7-51259da1c3a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:37.029667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5cf87-1037-410b-97c7-51259da1c3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:37.034867 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5cf87-1037-410b-97c7-51259da1c3a3 admin admin] PATH_INFO: `/v3/projects/9f611657232c435c9e73bcd3cc50f3a1/users/faac501bcdb345829f47e8e97b52d6e0/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:37.034867 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5cf87-1037-410b-97c7-51259da1c3a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f611657232c435c9e73bcd3cc50f3a1, user_id=faac501bcdb345829f47e8e97b52d6e0, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:37.034867 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5cf87-1037-410b-97c7-51259da1c3a3 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:37.038419 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 929/1857] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:36 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:37.040237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ad1eb-a8c8-4f08-9405-8eb6b1db90e5 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:37.040634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ad1eb-a8c8-4f08-9405-8eb6b1db90e5 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:37.041178 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ad1eb-a8c8-4f08-9405-8eb6b1db90e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:37.055960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 929/1858] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:36 2022] PUT /identity/v3/projects/9f611657232c435c9e73bcd3cc50f3a1/users/faac501bcdb345829f47e8e97b52d6e0/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:37.056899 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5cf87-1037-410b-97c7-51259da1c3a3 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:37.089526 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-4a5ad1eb-a8c8-4f08-9405-8eb6b1db90e5 None None] MFA Rules not processed for user `9c2b82f38c0c48f38c10a913cb026cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:37.094781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-4a5ad1eb-a8c8-4f08-9405-8eb6b1db90e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:37.149428 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5cf87-1037-410b-97c7-51259da1c3a3 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:37.154910 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b38d5-3cba-49c1-bbd6-95abc3aee9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:37.155661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b38d5-3cba-49c1-bbd6-95abc3aee9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:37.155946 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b38d5-3cba-49c1-bbd6-95abc3aee9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:37.156215 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b38d5-3cba-49c1-bbd6-95abc3aee9f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:37.156854 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b38d5-3cba-49c1-bbd6-95abc3aee9f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:37.158554 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b38d5-3cba-49c1-bbd6-95abc3aee9f2 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:37.170497 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 930/1859] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:37.171821 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ee909-9338-42dd-8ae3-d6404ac01abc None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:37.172165 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ee909-9338-42dd-8ae3-d6404ac01abc None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:37.172444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ee909-9338-42dd-8ae3-d6404ac01abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:37.209266 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 930/1860] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:37.209266 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ad1eb-a8c8-4f08-9405-8eb6b1db90e5 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:37.209526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-9c4ee909-9338-42dd-8ae3-d6404ac01abc None None] MFA Rules not processed for user `faac501bcdb345829f47e8e97b52d6e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:37.210377 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-9c4ee909-9338-42dd-8ae3-d6404ac01abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:37.221127 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ad1eb-a8c8-4f08-9405-8eb6b1db90e5 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:37.226727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40baf43-2208-4b0f-802d-af94c9db17a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:37.227556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40baf43-2208-4b0f-802d-af94c9db17a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:37.227738 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40baf43-2208-4b0f-802d-af94c9db17a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:37.228001 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40baf43-2208-4b0f-802d-af94c9db17a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:37.228648 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40baf43-2208-4b0f-802d-af94c9db17a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:37.230448 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40baf43-2208-4b0f-802d-af94c9db17a3 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:37.242273 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 931/1861] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:37.243110 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40baf43-2208-4b0f-802d-af94c9db17a3 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:37.260851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40baf43-2208-4b0f-802d-af94c9db17a3 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:37.273019 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c6f8a-50e2-4631-bdae-59a4cfc92d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:37.273715 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c6f8a-50e2-4631-bdae-59a4cfc92d0e admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:37.273991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c6f8a-50e2-4631-bdae-59a4cfc92d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:37.274259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c6f8a-50e2-4631-bdae-59a4cfc92d0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:37.274890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c6f8a-50e2-4631-bdae-59a4cfc92d0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:37.277736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c6f8a-50e2-4631-bdae-59a4cfc92d0e admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:37.300459 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 931/1862] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:37 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:37.301628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ee909-9338-42dd-8ae3-d6404ac01abc None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:37.313084 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ee909-9338-42dd-8ae3-d6404ac01abc None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:37.317688 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32626dd3-15a7-4e01-8eb6-98889441f57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:37.318346 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32626dd3-15a7-4e01-8eb6-98889441f57e admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:37.318622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32626dd3-15a7-4e01-8eb6-98889441f57e admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:37.318893 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32626dd3-15a7-4e01-8eb6-98889441f57e admin admin] PATH_INFO: `/v3/projects/d3a43b4942b64d17a5b72e95c2b64a13/users/a4cb436fea9346e6b407c88f4009221b/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:37.334028 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32626dd3-15a7-4e01-8eb6-98889441f57e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a43b4942b64d17a5b72e95c2b64a13, user_id=a4cb436fea9346e6b407c88f4009221b, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:37.337116 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32626dd3-15a7-4e01-8eb6-98889441f57e admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:37.391405 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 932/1863] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:37 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:37.392460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c6f8a-50e2-4631-bdae-59a4cfc92d0e admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:37.394380 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-a09c6f8a-50e2-4631-bdae-59a4cfc92d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:37.445008 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 932/1864] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:37 2022] PUT /identity/v3/projects/d3a43b4942b64d17a5b72e95c2b64a13/users/a4cb436fea9346e6b407c88f4009221b/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:37.456468 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32626dd3-15a7-4e01-8eb6-98889441f57e admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:37.464381 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c6f8a-50e2-4631-bdae-59a4cfc92d0e admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:37.523734 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3f6e4-40fb-45bf-994a-0ae3da08e99c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:37.524403 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3f6e4-40fb-45bf-994a-0ae3da08e99c service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:37.524678 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3f6e4-40fb-45bf-994a-0ae3da08e99c service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:37.524944 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3f6e4-40fb-45bf-994a-0ae3da08e99c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:37.533947 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32626dd3-15a7-4e01-8eb6-98889441f57e admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:37.544175 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d230a-26a5-4135-941d-8707c277d0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:37.544896 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d230a-26a5-4135-941d-8707c277d0a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:37.545741 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d230a-26a5-4135-941d-8707c277d0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:37.546101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d230a-26a5-4135-941d-8707c277d0a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:37.546784 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d230a-26a5-4135-941d-8707c277d0a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:37.549264 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d230a-26a5-4135-941d-8707c277d0a3 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:37.610218 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3f6e4-40fb-45bf-994a-0ae3da08e99c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:37.611767 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3f6e4-40fb-45bf-994a-0ae3da08e99c service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:37.622607 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 933/1865] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:37 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:37.624366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c6ca8-5edc-4a48-b9ed-efad3974ccdb None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:37.624747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c6ca8-5edc-4a48-b9ed-efad3974ccdb None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:37.625141 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c6ca8-5edc-4a48-b9ed-efad3974ccdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:37.659859 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-037c6ca8-5edc-4a48-b9ed-efad3974ccdb None None] MFA Rules not processed for user `a4cb436fea9346e6b407c88f4009221b`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:37.661836 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-037c6ca8-5edc-4a48-b9ed-efad3974ccdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:37.682084 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 933/1866] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:37 2022] POST /identity/v3/users => generated 296 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:37.686818 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d230a-26a5-4135-941d-8707c277d0a3 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:37.700558 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d230a-26a5-4135-941d-8707c277d0a3 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:37.705433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d76b3-d0a3-4252-8c23-95a747e206df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:37.706052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d76b3-d0a3-4252-8c23-95a747e206df admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:37.706386 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d76b3-d0a3-4252-8c23-95a747e206df admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:37.706665 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d76b3-d0a3-4252-8c23-95a747e206df admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:37.707315 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d76b3-d0a3-4252-8c23-95a747e206df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:37.708973 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d76b3-d0a3-4252-8c23-95a747e206df admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:37.717066 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:37.720798 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 934/1867] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:27:37.721885 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d76b3-d0a3-4252-8c23-95a747e206df admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:37.737085 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d76b3-d0a3-4252-8c23-95a747e206df admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:37.741294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c98b6-e93e-4d92-856f-5ba6a0682f5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:37.741936 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c98b6-e93e-4d92-856f-5ba6a0682f5d service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:37.742436 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c98b6-e93e-4d92-856f-5ba6a0682f5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:37.742717 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c98b6-e93e-4d92-856f-5ba6a0682f5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:37.765755 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 934/1868] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:37.767161 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c6ca8-5edc-4a48-b9ed-efad3974ccdb None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:37.788376 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c6ca8-5edc-4a48-b9ed-efad3974ccdb None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:37.794251 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673388a-efcb-4b90-8559-18c580a3ce35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:37.795138 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673388a-efcb-4b90-8559-18c580a3ce35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:37.795618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673388a-efcb-4b90-8559-18c580a3ce35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:37.800978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673388a-efcb-4b90-8559-18c580a3ce35 admin admin] PATH_INFO: `/v3/projects/7b4c4cfcdb2e42578f1923d21f56a5f6/users/3c7e66e6d7e643c3a835dfbb2b70a7df/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:37.813407 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c98b6-e93e-4d92-856f-5ba6a0682f5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:37.818127 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673388a-efcb-4b90-8559-18c580a3ce35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b4c4cfcdb2e42578f1923d21f56a5f6, user_id=3c7e66e6d7e643c3a835dfbb2b70a7df, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:37.818336 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c98b6-e93e-4d92-856f-5ba6a0682f5d service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:37.818446 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673388a-efcb-4b90-8559-18c580a3ce35 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:37.826222 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 935/1869] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:37 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:37.827301 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c98b6-e93e-4d92-856f-5ba6a0682f5d service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:37.840158 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c98b6-e93e-4d92-856f-5ba6a0682f5d service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:37.846690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca612e8-1270-42b9-afc4-8dc168c2559e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:37.846690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca612e8-1270-42b9-afc4-8dc168c2559e admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:37.847299 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca612e8-1270-42b9-afc4-8dc168c2559e admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:37.847299 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca612e8-1270-42b9-afc4-8dc168c2559e admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:37.847911 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca612e8-1270-42b9-afc4-8dc168c2559e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:37.849979 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca612e8-1270-42b9-afc4-8dc168c2559e admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:37.905441 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:37.989845 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 935/1870] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:37 2022] PUT /identity/v3/projects/7b4c4cfcdb2e42578f1923d21f56a5f6/users/3c7e66e6d7e643c3a835dfbb2b70a7df/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:37.993848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673388a-efcb-4b90-8559-18c580a3ce35 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:38.020997 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 936/1871] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:37 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:38.027367 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca612e8-1270-42b9-afc4-8dc168c2559e admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:38.061030 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673388a-efcb-4b90-8559-18c580a3ce35 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:38.094233 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca612e8-1270-42b9-afc4-8dc168c2559e admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:38.099128 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32738ba0-5817-46ae-babe-bb6effbb2b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:38.099780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32738ba0-5817-46ae-babe-bb6effbb2b19 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:38.100062 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32738ba0-5817-46ae-babe-bb6effbb2b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:38.100364 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32738ba0-5817-46ae-babe-bb6effbb2b19 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:38.100999 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32738ba0-5817-46ae-babe-bb6effbb2b19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:38.103011 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32738ba0-5817-46ae-babe-bb6effbb2b19 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:38.127656 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0b177-c683-4a49-8db4-05b7eedfd9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:38.128280 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0b177-c683-4a49-8db4-05b7eedfd9ec admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:38.128559 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0b177-c683-4a49-8db4-05b7eedfd9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:38.128903 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0b177-c683-4a49-8db4-05b7eedfd9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:38.129543 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0b177-c683-4a49-8db4-05b7eedfd9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:38.131993 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0b177-c683-4a49-8db4-05b7eedfd9ec admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:38.142529 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 936/1872] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:27:38.146711 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0b177-c683-4a49-8db4-05b7eedfd9ec admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:38.157488 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0b177-c683-4a49-8db4-05b7eedfd9ec admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:38.163398 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f585f-72bf-4a50-9872-1b481b29542c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:38.164218 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f585f-72bf-4a50-9872-1b481b29542c admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:38.164400 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f585f-72bf-4a50-9872-1b481b29542c admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:38.164637 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f585f-72bf-4a50-9872-1b481b29542c admin admin] PATH_INFO: `/v3/projects/7b4c4cfcdb2e42578f1923d21f56a5f6/users/3c7e66e6d7e643c3a835dfbb2b70a7df/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:38.166890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f585f-72bf-4a50-9872-1b481b29542c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b4c4cfcdb2e42578f1923d21f56a5f6, user_id=3c7e66e6d7e643c3a835dfbb2b70a7df, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:38.169322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f585f-72bf-4a50-9872-1b481b29542c admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:38.182654 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 937/1873] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:38 2022] PUT /identity/v3/projects/7b4c4cfcdb2e42578f1923d21f56a5f6/users/3c7e66e6d7e643c3a835dfbb2b70a7df/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:27:38.199103 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b105b-6b9d-4ebf-b15c-77667738d077 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:38.199103 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b105b-6b9d-4ebf-b15c-77667738d077 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:38.199103 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b105b-6b9d-4ebf-b15c-77667738d077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:38.203947 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 937/1874] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:38 2022] POST /identity/v3/users => generated 295 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:27:38.205967 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32738ba0-5817-46ae-babe-bb6effbb2b19 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:38.217369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32738ba0-5817-46ae-babe-bb6effbb2b19 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:38.230603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-431b105b-6b9d-4ebf-b15c-77667738d077 None None] MFA Rules not processed for user `3c7e66e6d7e643c3a835dfbb2b70a7df`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:38.231858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-431b105b-6b9d-4ebf-b15c-77667738d077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:38.318584 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 938/1875] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:38.323702 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4be327-1539-48fe-99b8-09e5be5f8248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:38.324784 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4be327-1539-48fe-99b8-09e5be5f8248 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:38.325371 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4be327-1539-48fe-99b8-09e5be5f8248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:38.325792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4be327-1539-48fe-99b8-09e5be5f8248 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:38.326575 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4be327-1539-48fe-99b8-09e5be5f8248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:38.328642 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4be327-1539-48fe-99b8-09e5be5f8248 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:38.332596 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b105b-6b9d-4ebf-b15c-77667738d077 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:38.336162 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-431b105b-6b9d-4ebf-b15c-77667738d077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:38.350926 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 938/1876] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:38.356311 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4be327-1539-48fe-99b8-09e5be5f8248 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:38.370760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4be327-1539-48fe-99b8-09e5be5f8248 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:38.377135 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0b41e-9e5d-4860-83eb-7ae901a55f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:38.377651 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0b41e-9e5d-4860-83eb-7ae901a55f7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:38.377912 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0b41e-9e5d-4860-83eb-7ae901a55f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:38.378182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0b41e-9e5d-4860-83eb-7ae901a55f7f admin admin] PATH_INFO: `/v3/projects/a9d17f6820f548a7972ee5a5bafc10ca/users/41dda2a8685b40d2a7de97df9211d6cb/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:38.401125 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0b41e-9e5d-4860-83eb-7ae901a55f7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9d17f6820f548a7972ee5a5bafc10ca, user_id=41dda2a8685b40d2a7de97df9211d6cb, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:38.403801 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0b41e-9e5d-4860-83eb-7ae901a55f7f admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:38.443937 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b105b-6b9d-4ebf-b15c-77667738d077 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:38.449353 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c246a79-8740-408f-b4a8-dfee134bef90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:38.449992 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c246a79-8740-408f-b4a8-dfee134bef90 service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:38.450251 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c246a79-8740-408f-b4a8-dfee134bef90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:38.450631 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c246a79-8740-408f-b4a8-dfee134bef90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:38.460911 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c246a79-8740-408f-b4a8-dfee134bef90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:38.464073 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c246a79-8740-408f-b4a8-dfee134bef90 service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:38.474934 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 939/1877] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:38.525801 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 939/1878] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:38 2022] PUT /identity/v3/projects/a9d17f6820f548a7972ee5a5bafc10ca/users/41dda2a8685b40d2a7de97df9211d6cb/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:38.528574 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c246a79-8740-408f-b4a8-dfee134bef90 service cinder] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:38.540050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c246a79-8740-408f-b4a8-dfee134bef90 service cinder] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:38.601439 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9fb20-fb11-48c3-825f-adb84a633e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:38.602056 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9fb20-fb11-48c3-825f-adb84a633e2d admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:38.602350 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9fb20-fb11-48c3-825f-adb84a633e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:38.602598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9fb20-fb11-48c3-825f-adb84a633e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:38.603237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9fb20-fb11-48c3-825f-adb84a633e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:38.604975 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9fb20-fb11-48c3-825f-adb84a633e2d admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:38.619039 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 940/1879] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:38.626731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0b41e-9e5d-4860-83eb-7ae901a55f7f admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:38.638471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0b41e-9e5d-4860-83eb-7ae901a55f7f admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:38.643786 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879151d-48c2-4b0a-a070-18079796e720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:38.644821 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879151d-48c2-4b0a-a070-18079796e720 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:38.649221 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879151d-48c2-4b0a-a070-18079796e720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:38.649221 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879151d-48c2-4b0a-a070-18079796e720 admin admin] PATH_INFO: `/v3/projects/a9d17f6820f548a7972ee5a5bafc10ca/users/41dda2a8685b40d2a7de97df9211d6cb/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:38.649221 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879151d-48c2-4b0a-a070-18079796e720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9d17f6820f548a7972ee5a5bafc10ca, user_id=41dda2a8685b40d2a7de97df9211d6cb, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:38.650317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879151d-48c2-4b0a-a070-18079796e720 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:38.661498 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 940/1880] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:38 2022] PUT /identity/v3/projects/a9d17f6820f548a7972ee5a5bafc10ca/users/41dda2a8685b40d2a7de97df9211d6cb/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:38.672405 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97486f8d-b012-42fd-85f7-00c485763041 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:38.672686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97486f8d-b012-42fd-85f7-00c485763041 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:38.672961 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97486f8d-b012-42fd-85f7-00c485763041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:38.692831 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:38.707147 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-97486f8d-b012-42fd-85f7-00c485763041 None None] MFA Rules not processed for user `41dda2a8685b40d2a7de97df9211d6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:38.708507 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-97486f8d-b012-42fd-85f7-00c485763041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:38.774897 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879151d-48c2-4b0a-a070-18079796e720 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:38.811543 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 941/1881] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:38.858536 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879151d-48c2-4b0a-a070-18079796e720 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:38.862342 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47220fd9-14f4-4af7-a5ad-6077df47b596 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:38.862976 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47220fd9-14f4-4af7-a5ad-6077df47b596 service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:38.863250 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47220fd9-14f4-4af7-a5ad-6077df47b596 service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:38.863560 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47220fd9-14f4-4af7-a5ad-6077df47b596 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:38.908878 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97486f8d-b012-42fd-85f7-00c485763041 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:38.919094 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97486f8d-b012-42fd-85f7-00c485763041 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:38.923996 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c26f3-d0b7-46bc-8606-4edd5efd0b69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:38.924658 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c26f3-d0b7-46bc-8606-4edd5efd0b69 service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:38.924938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c26f3-d0b7-46bc-8606-4edd5efd0b69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:38.925270 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c26f3-d0b7-46bc-8606-4edd5efd0b69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:38.936748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c26f3-d0b7-46bc-8606-4edd5efd0b69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:38.938406 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c26f3-d0b7-46bc-8606-4edd5efd0b69 service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:38.941323 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47220fd9-14f4-4af7-a5ad-6077df47b596 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:38.942766 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47220fd9-14f4-4af7-a5ad-6077df47b596 service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:38.950621 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 942/1882] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:27:38.954147 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 941/1883] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:39.106801 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c26f3-d0b7-46bc-8606-4edd5efd0b69 service cinder] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:39.115616 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c26f3-d0b7-46bc-8606-4edd5efd0b69 service cinder] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:39.120022 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e3f5a-33c8-4ea1-8175-2aa924682633 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:39.121266 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e3f5a-33c8-4ea1-8175-2aa924682633 service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:39.122119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e3f5a-33c8-4ea1-8175-2aa924682633 service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:39.122556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e3f5a-33c8-4ea1-8175-2aa924682633 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:39.196160 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e3f5a-33c8-4ea1-8175-2aa924682633 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:39.198141 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e3f5a-33c8-4ea1-8175-2aa924682633 service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:39.213778 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 943/1884] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:39.668163 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47220fd9-14f4-4af7-a5ad-6077df47b596 service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:39.775353 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47220fd9-14f4-4af7-a5ad-6077df47b596 service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:39.781159 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:39.782908 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fc695-cb7d-4ef3-be81-000bd1c33ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:39.783768 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fc695-cb7d-4ef3-be81-000bd1c33ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:39.784118 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fc695-cb7d-4ef3-be81-000bd1c33ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:39.784568 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fc695-cb7d-4ef3-be81-000bd1c33ca0 admin admin] PATH_INFO: `/v3/users/9c2b82f38c0c48f38c10a913cb026cf6` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:39.795040 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345fc695-cb7d-4ef3-be81-000bd1c33ca0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c2b82f38c0c48f38c10a913cb026cf6)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:39.798067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345fc695-cb7d-4ef3-be81-000bd1c33ca0 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:40.139872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-345fc695-cb7d-4ef3-be81-000bd1c33ca0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c2b82f38c0c48f38c10a913cb026cf6'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:40.259233 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-345fc695-cb7d-4ef3-be81-000bd1c33ca0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c2b82f38c0c48f38c10a913cb026cf6'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:40.260292 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-345fc695-cb7d-4ef3-be81-000bd1c33ca0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c2b82f38c0c48f38c10a913cb026cf6'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:40.261069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-345fc695-cb7d-4ef3-be81-000bd1c33ca0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c2b82f38c0c48f38c10a913cb026cf6'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:40.270629 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-345fc695-cb7d-4ef3-be81-000bd1c33ca0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c2b82f38c0c48f38c10a913cb026cf6'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:40.292426 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 942/1885] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:27:39 2022] DELETE /identity/v3/users/9c2b82f38c0c48f38c10a913cb026cf6 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:27:40.300411 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf369f8-efd6-476c-b9af-c6b6e3f7a829 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:40.300960 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf369f8-efd6-476c-b9af-c6b6e3f7a829 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:40.301132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf369f8-efd6-476c-b9af-c6b6e3f7a829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:40.322499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-ccf369f8-efd6-476c-b9af-c6b6e3f7a829 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:40.323790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ccf369f8-efd6-476c-b9af-c6b6e3f7a829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:40.386618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 944/1886] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:40.399116 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fc695-cb7d-4ef3-be81-000bd1c33ca0 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:40.400894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-345fc695-cb7d-4ef3-be81-000bd1c33ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:40.485209 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fc695-cb7d-4ef3-be81-000bd1c33ca0 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:40.488988 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe504b14-5f11-4058-a60d-a171f5cb3e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:40.489791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe504b14-5f11-4058-a60d-a171f5cb3e62 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:40.490062 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe504b14-5f11-4058-a60d-a171f5cb3e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:40.490329 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe504b14-5f11-4058-a60d-a171f5cb3e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:40.505506 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe504b14-5f11-4058-a60d-a171f5cb3e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:40.507002 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe504b14-5f11-4058-a60d-a171f5cb3e62 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:40.516931 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 943/1887] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:41.426133 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf369f8-efd6-476c-b9af-c6b6e3f7a829 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:41.427839 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ccf369f8-efd6-476c-b9af-c6b6e3f7a829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:41.440837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf369f8-efd6-476c-b9af-c6b6e3f7a829 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:41.449192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610506d-0895-4052-8dd0-2ba5252e811a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:41.449192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610506d-0895-4052-8dd0-2ba5252e811a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:41.449192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610506d-0895-4052-8dd0-2ba5252e811a admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:41.449192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610506d-0895-4052-8dd0-2ba5252e811a admin admin] PATH_INFO: `/v3/projects/db58749551014d64a9093e4616714bfe` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:41.451126 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610506d-0895-4052-8dd0-2ba5252e811a admin admin] RBAC: Authorizing `identity:delete_project(project_id=db58749551014d64a9093e4616714bfe)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:41.455424 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610506d-0895-4052-8dd0-2ba5252e811a admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:41.482746 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:41.636773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c610506d-0895-4052-8dd0-2ba5252e811a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db58749551014d64a9093e4616714bfe', 'request_id': 'req-c610506d-0895-4052-8dd0-2ba5252e811a'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:41.643539 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c610506d-0895-4052-8dd0-2ba5252e811a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db58749551014d64a9093e4616714bfe', 'request_id': 'req-c610506d-0895-4052-8dd0-2ba5252e811a'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:41.750203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c610506d-0895-4052-8dd0-2ba5252e811a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db58749551014d64a9093e4616714bfe', 'request_id': 'req-c610506d-0895-4052-8dd0-2ba5252e811a'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:41.761999 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c610506d-0895-4052-8dd0-2ba5252e811a admin admin] The token cache is being invalidate because project db58749551014d64a9093e4616714bfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:27:41.763903 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c610506d-0895-4052-8dd0-2ba5252e811a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:41.764663 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c610506d-0895-4052-8dd0-2ba5252e811a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:41.766883 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 945/1888] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:27:41 2022] DELETE /identity/v3/projects/db58749551014d64a9093e4616714bfe => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:41.770685 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe504b14-5f11-4058-a60d-a171f5cb3e62 service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:41.789273 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe504b14-5f11-4058-a60d-a171f5cb3e62 service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:41.886493 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e3e49-d06c-4672-8fd9-f2e6ddc6a3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:41.887251 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e3e49-d06c-4672-8fd9-f2e6ddc6a3fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:41.887668 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e3e49-d06c-4672-8fd9-f2e6ddc6a3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:41.888072 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e3e49-d06c-4672-8fd9-f2e6ddc6a3fd admin admin] PATH_INFO: `/v3/users/3c7e66e6d7e643c3a835dfbb2b70a7df` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:41.891802 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e3e49-d06c-4672-8fd9-f2e6ddc6a3fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c7e66e6d7e643c3a835dfbb2b70a7df)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:41.895220 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e3e49-d06c-4672-8fd9-f2e6ddc6a3fd admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:42.130185 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-372e3e49-d06c-4672-8fd9-f2e6ddc6a3fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c7e66e6d7e643c3a835dfbb2b70a7df'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:42.232104 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:42.289375 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-372e3e49-d06c-4672-8fd9-f2e6ddc6a3fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c7e66e6d7e643c3a835dfbb2b70a7df'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:42.290401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-372e3e49-d06c-4672-8fd9-f2e6ddc6a3fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c7e66e6d7e643c3a835dfbb2b70a7df'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:42.291351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-372e3e49-d06c-4672-8fd9-f2e6ddc6a3fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c7e66e6d7e643c3a835dfbb2b70a7df'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:42.302551 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-372e3e49-d06c-4672-8fd9-f2e6ddc6a3fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c7e66e6d7e643c3a835dfbb2b70a7df'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:42.329332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 944/1889] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:27:41 2022] DELETE /identity/v3/users/3c7e66e6d7e643c3a835dfbb2b70a7df => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:42.653706 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a4c6d-5e69-4436-939d-c866066a91c5 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:42.654286 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a4c6d-5e69-4436-939d-c866066a91c5 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:42.654286 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a4c6d-5e69-4436-939d-c866066a91c5 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:42.655503 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 946/1890] 10.222.0.77 () {54 vars in 921 bytes} [Tue Sep 6 20:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:27:42.669841 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86be57b-a9ae-4f06-9f9e-373107094ca1 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:42.676508 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86be57b-a9ae-4f06-9f9e-373107094ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:42.676508 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86be57b-a9ae-4f06-9f9e-373107094ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:42.741211 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-a86be57b-a9ae-4f06-9f9e-373107094ca1 None None] MFA Rules not processed for user `b09ce16da49b4af38491ad4eb6287d70`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:42.745596 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-a86be57b-a9ae-4f06-9f9e-373107094ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:42.884916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 945/1891] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Sep 6 20:27:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:42.909914 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a4c6d-5e69-4436-939d-c866066a91c5 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:42.913035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-1c8a4c6d-5e69-4436-939d-c866066a91c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:42.945486 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a4c6d-5e69-4436-939d-c866066a91c5 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:42.972573 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b403bd-1f9b-4c5c-840e-afc973f4a0af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:42.973474 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b403bd-1f9b-4c5c-840e-afc973f4a0af service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:42.975175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b403bd-1f9b-4c5c-840e-afc973f4a0af service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:42.975790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b403bd-1f9b-4c5c-840e-afc973f4a0af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:42.988052 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b403bd-1f9b-4c5c-840e-afc973f4a0af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:42.990264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b403bd-1f9b-4c5c-840e-afc973f4a0af service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:43.017856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 947/1892] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:43.146184 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86be57b-a9ae-4f06-9f9e-373107094ca1 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:43.147348 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-a86be57b-a9ae-4f06-9f9e-373107094ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:43.264961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86be57b-a9ae-4f06-9f9e-373107094ca1 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:43.274605 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e423a40-68ac-4e50-b750-7f8f00a9fce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:43.275609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e423a40-68ac-4e50-b750-7f8f00a9fce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:43.276634 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e423a40-68ac-4e50-b750-7f8f00a9fce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:43.277073 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e423a40-68ac-4e50-b750-7f8f00a9fce7 admin admin] PATH_INFO: `/v3/projects/7b4c4cfcdb2e42578f1923d21f56a5f6` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:43.282010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e423a40-68ac-4e50-b750-7f8f00a9fce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b4c4cfcdb2e42578f1923d21f56a5f6)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:43.283777 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e423a40-68ac-4e50-b750-7f8f00a9fce7 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:43.519407 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-4e423a40-68ac-4e50-b750-7f8f00a9fce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b4c4cfcdb2e42578f1923d21f56a5f6', 'request_id': 'req-4e423a40-68ac-4e50-b750-7f8f00a9fce7'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:43.528200 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-4e423a40-68ac-4e50-b750-7f8f00a9fce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b4c4cfcdb2e42578f1923d21f56a5f6', 'request_id': 'req-4e423a40-68ac-4e50-b750-7f8f00a9fce7'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:43.598580 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-4e423a40-68ac-4e50-b750-7f8f00a9fce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b4c4cfcdb2e42578f1923d21f56a5f6', 'request_id': 'req-4e423a40-68ac-4e50-b750-7f8f00a9fce7'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:43.612049 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-4e423a40-68ac-4e50-b750-7f8f00a9fce7 admin admin] The token cache is being invalidate because project 7b4c4cfcdb2e42578f1923d21f56a5f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:27:43.612347 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-4e423a40-68ac-4e50-b750-7f8f00a9fce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:43.613012 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-4e423a40-68ac-4e50-b750-7f8f00a9fce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:43.615486 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 946/1893] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:27:43 2022] DELETE /identity/v3/projects/7b4c4cfcdb2e42578f1923d21f56a5f6 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:43.619654 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7b507-f0e2-49f9-9e86-5424b8ca8bf0 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:43.620019 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7b507-f0e2-49f9-9e86-5424b8ca8bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:43.620395 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7b507-f0e2-49f9-9e86-5424b8ca8bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:43.641498 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-ecf7b507-f0e2-49f9-9e86-5424b8ca8bf0 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:43.643053 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ecf7b507-f0e2-49f9-9e86-5424b8ca8bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:43.731970 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 948/1894] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:27:43.740302 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f16ed-59b0-407f-a25d-f802dbbc2e13 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:43.740866 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f16ed-59b0-407f-a25d-f802dbbc2e13 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:43.741031 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f16ed-59b0-407f-a25d-f802dbbc2e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:43.762990 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-a31f16ed-59b0-407f-a25d-f802dbbc2e13 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:43.764301 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-a31f16ed-59b0-407f-a25d-f802dbbc2e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:43.775948 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 947/1895] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:43.780710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7b507-f0e2-49f9-9e86-5424b8ca8bf0 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:43.796537 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7b507-f0e2-49f9-9e86-5424b8ca8bf0 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:43.802054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f18bc-ae4f-4530-aa57-d7a241259a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:43.802911 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f18bc-ae4f-4530-aa57-d7a241259a14 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:43.803379 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f18bc-ae4f-4530-aa57-d7a241259a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:43.803654 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f18bc-ae4f-4530-aa57-d7a241259a14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:43.804312 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f18bc-ae4f-4530-aa57-d7a241259a14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:27:43.804616 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f18bc-ae4f-4530-aa57-d7a241259a14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:43.806275 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f18bc-ae4f-4530-aa57-d7a241259a14 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:43.822921 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 949/1896] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:27:43.828051 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f16ed-59b0-407f-a25d-f802dbbc2e13 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:43.844372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f16ed-59b0-407f-a25d-f802dbbc2e13 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:43.849996 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc953c04-7e5f-47c4-a852-a29c50ad68d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:43.851242 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc953c04-7e5f-47c4-a852-a29c50ad68d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:43.851565 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc953c04-7e5f-47c4-a852-a29c50ad68d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:43.854900 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc953c04-7e5f-47c4-a852-a29c50ad68d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:43.855708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc953c04-7e5f-47c4-a852-a29c50ad68d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:43.857703 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc953c04-7e5f-47c4-a852-a29c50ad68d1 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:43.994336 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 948/1897] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:43 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:43.998328 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f18bc-ae4f-4530-aa57-d7a241259a14 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:44.011400 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f18bc-ae4f-4530-aa57-d7a241259a14 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:44.115340 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f1f4b-401f-48ef-8d2a-e6353a5e7137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:44.116435 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f1f4b-401f-48ef-8d2a-e6353a5e7137 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:44.116923 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f1f4b-401f-48ef-8d2a-e6353a5e7137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:44.117401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f1f4b-401f-48ef-8d2a-e6353a5e7137 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:44.118311 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f1f4b-401f-48ef-8d2a-e6353a5e7137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:44.120988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f1f4b-401f-48ef-8d2a-e6353a5e7137 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:44.224917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:44.295860 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 950/1898] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:43 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:44.301014 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc953c04-7e5f-47c4-a852-a29c50ad68d1 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:44.314861 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc953c04-7e5f-47c4-a852-a29c50ad68d1 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:44.320772 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002f971-2b9f-4052-b22c-64c68ea73ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:44.321415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002f971-2b9f-4052-b22c-64c68ea73ccc admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:44.321693 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002f971-2b9f-4052-b22c-64c68ea73ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:44.321969 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002f971-2b9f-4052-b22c-64c68ea73ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:44.322662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002f971-2b9f-4052-b22c-64c68ea73ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:44.324365 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002f971-2b9f-4052-b22c-64c68ea73ccc admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:44.346595 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 949/1899] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:44.351024 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f1f4b-401f-48ef-8d2a-e6353a5e7137 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:44.361489 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f1f4b-401f-48ef-8d2a-e6353a5e7137 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:44.369325 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb51ad-a3ce-47cb-a31c-0ac307f520ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:44.370142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb51ad-a3ce-47cb-a31c-0ac307f520ba admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:44.370319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb51ad-a3ce-47cb-a31c-0ac307f520ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:44.370589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb51ad-a3ce-47cb-a31c-0ac307f520ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:44.371562 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb51ad-a3ce-47cb-a31c-0ac307f520ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:44.373757 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb51ad-a3ce-47cb-a31c-0ac307f520ba admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:44.386717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 951/1900] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:44.390819 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002f971-2b9f-4052-b22c-64c68ea73ccc admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:44.411684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002f971-2b9f-4052-b22c-64c68ea73ccc admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:44.420316 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2768f4-dc86-4938-b7af-134737b65c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:44.421309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2768f4-dc86-4938-b7af-134737b65c78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:44.422350 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2768f4-dc86-4938-b7af-134737b65c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:44.422667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2768f4-dc86-4938-b7af-134737b65c78 admin admin] PATH_INFO: `/v3/projects/c37fe9564b874944a4d6e6dc669d1572/users/6916cce0d810441dadb1448281b5d78b/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:44.447414 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2768f4-dc86-4938-b7af-134737b65c78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c37fe9564b874944a4d6e6dc669d1572, user_id=6916cce0d810441dadb1448281b5d78b, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:44.451051 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2768f4-dc86-4938-b7af-134737b65c78 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:44.563506 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 950/1901] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:44 2022] PUT /identity/v3/projects/c37fe9564b874944a4d6e6dc669d1572/users/6916cce0d810441dadb1448281b5d78b/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:44.575229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71529580-6e67-4343-943c-d8e361225bf1 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:44.575797 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71529580-6e67-4343-943c-d8e361225bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:44.576256 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71529580-6e67-4343-943c-d8e361225bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:44.662128 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2768f4-dc86-4938-b7af-134737b65c78 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:44.670697 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-9a2768f4-dc86-4938-b7af-134737b65c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:44.672449 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-71529580-6e67-4343-943c-d8e361225bf1 None None] MFA Rules not processed for user `6916cce0d810441dadb1448281b5d78b`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:44.674267 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-71529580-6e67-4343-943c-d8e361225bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:44.762341 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2768f4-dc86-4938-b7af-134737b65c78 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:44.768717 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2aeb9a-aba2-47a0-88c2-52968b133cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:44.769729 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2aeb9a-aba2-47a0-88c2-52968b133cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:44.770824 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2aeb9a-aba2-47a0-88c2-52968b133cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:44.771471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2aeb9a-aba2-47a0-88c2-52968b133cad admin admin] PATH_INFO: `/v3/users/27ea0d4b49654644b6de9a1ea5b893fd` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:44.772856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 952/1902] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:44.773822 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2aeb9a-aba2-47a0-88c2-52968b133cad admin admin] RBAC: Authorizing `identity:delete_user(user_id=27ea0d4b49654644b6de9a1ea5b893fd)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:44.776290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2aeb9a-aba2-47a0-88c2-52968b133cad admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:44.846025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71529580-6e67-4343-943c-d8e361225bf1 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:44.847530 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-71529580-6e67-4343-943c-d8e361225bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:44.911849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71529580-6e67-4343-943c-d8e361225bf1 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:44.916057 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120fd8b-02ae-4032-bee6-be40414e2099 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:44.919670 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120fd8b-02ae-4032-bee6-be40414e2099 service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:44.919670 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120fd8b-02ae-4032-bee6-be40414e2099 service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:44.919670 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120fd8b-02ae-4032-bee6-be40414e2099 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:44.926329 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120fd8b-02ae-4032-bee6-be40414e2099 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:44.927813 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120fd8b-02ae-4032-bee6-be40414e2099 service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:44.937811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 953/1903] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:44.965121 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120fd8b-02ae-4032-bee6-be40414e2099 service cinder] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:44.966782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-9120fd8b-02ae-4032-bee6-be40414e2099 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:44.983325 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120fd8b-02ae-4032-bee6-be40414e2099 service cinder] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:44.987256 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:44.991757 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5df33-641b-4b7e-b9b4-9bc1f94cc543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:44.992413 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5df33-641b-4b7e-b9b4-9bc1f94cc543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:44.992695 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5df33-641b-4b7e-b9b4-9bc1f94cc543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:44.994461 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5df33-641b-4b7e-b9b4-9bc1f94cc543 admin admin] PATH_INFO: `/v3/users/08da38d347a94415ac315d98fe460e47` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:44.994582 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-0b2aeb9a-aba2-47a0-88c2-52968b133cad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27ea0d4b49654644b6de9a1ea5b893fd'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:44.994705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5df33-641b-4b7e-b9b4-9bc1f94cc543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08da38d347a94415ac315d98fe460e47)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:44.997432 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5df33-641b-4b7e-b9b4-9bc1f94cc543 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:45.093333 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-0b2aeb9a-aba2-47a0-88c2-52968b133cad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27ea0d4b49654644b6de9a1ea5b893fd'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:45.100717 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-0b2aeb9a-aba2-47a0-88c2-52968b133cad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27ea0d4b49654644b6de9a1ea5b893fd'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:45.100717 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-0b2aeb9a-aba2-47a0-88c2-52968b133cad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27ea0d4b49654644b6de9a1ea5b893fd'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:45.104761 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-0b2aeb9a-aba2-47a0-88c2-52968b133cad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27ea0d4b49654644b6de9a1ea5b893fd'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:45.125958 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 951/1904] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:27:44 2022] DELETE /identity/v3/users/27ea0d4b49654644b6de9a1ea5b893fd => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:45.130995 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61b6c8-f359-4aee-9b7c-5d3d5eeec3b0 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:45.136002 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61b6c8-f359-4aee-9b7c-5d3d5eeec3b0 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:45.136002 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61b6c8-f359-4aee-9b7c-5d3d5eeec3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:45.152402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-6d61b6c8-f359-4aee-9b7c-5d3d5eeec3b0 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:45.153697 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6d61b6c8-f359-4aee-9b7c-5d3d5eeec3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:45.229425 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 952/1905] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:27:45.238415 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c9f5df33-641b-4b7e-b9b4-9bc1f94cc543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08da38d347a94415ac315d98fe460e47'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:45.249908 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61b6c8-f359-4aee-9b7c-5d3d5eeec3b0 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:45.254448 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6d61b6c8-f359-4aee-9b7c-5d3d5eeec3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:45.342987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c9f5df33-641b-4b7e-b9b4-9bc1f94cc543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08da38d347a94415ac315d98fe460e47'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:45.342987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c9f5df33-641b-4b7e-b9b4-9bc1f94cc543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08da38d347a94415ac315d98fe460e47'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:45.342987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c9f5df33-641b-4b7e-b9b4-9bc1f94cc543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08da38d347a94415ac315d98fe460e47'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:45.353002 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c9f5df33-641b-4b7e-b9b4-9bc1f94cc543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08da38d347a94415ac315d98fe460e47'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:45.361454 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61b6c8-f359-4aee-9b7c-5d3d5eeec3b0 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:45.371717 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f930aec-50b0-4777-9787-997da4e30964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:45.372886 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f930aec-50b0-4777-9787-997da4e30964 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:45.373160 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f930aec-50b0-4777-9787-997da4e30964 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:45.373421 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f930aec-50b0-4777-9787-997da4e30964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:45.376257 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-4f930aec-50b0-4777-9787-997da4e30964 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:45.389101 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 954/1906] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:27:44 2022] DELETE /identity/v3/users/08da38d347a94415ac315d98fe460e47 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:27:45.400650 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b875f34-86e8-40b6-a34f-742831a35c5c None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:45.400994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b875f34-86e8-40b6-a34f-742831a35c5c None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:45.401239 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b875f34-86e8-40b6-a34f-742831a35c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:45.410930 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f930aec-50b0-4777-9787-997da4e30964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:45.412678 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f930aec-50b0-4777-9787-997da4e30964 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:45.438170 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-0b875f34-86e8-40b6-a34f-742831a35c5c None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:45.441704 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-0b875f34-86e8-40b6-a34f-742831a35c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:45.458378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 953/1907] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:45.543665 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 955/1908] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:45.553565 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f930aec-50b0-4777-9787-997da4e30964 service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:45.555593 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-4f930aec-50b0-4777-9787-997da4e30964 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:45.568440 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f930aec-50b0-4777-9787-997da4e30964 service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:45.633868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5d3ed-62bc-46c8-a23f-a0f5e1d41d16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:45.634662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5d3ed-62bc-46c8-a23f-a0f5e1d41d16 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:45.635006 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5d3ed-62bc-46c8-a23f-a0f5e1d41d16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:45.635347 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5d3ed-62bc-46c8-a23f-a0f5e1d41d16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:45.646736 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5d3ed-62bc-46c8-a23f-a0f5e1d41d16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:45.648947 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5d3ed-62bc-46c8-a23f-a0f5e1d41d16 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:45.664573 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 954/1909] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:46.067154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b875f34-86e8-40b6-a34f-742831a35c5c None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:46.069884 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-0b875f34-86e8-40b6-a34f-742831a35c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:46.088764 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b875f34-86e8-40b6-a34f-742831a35c5c None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:46.094520 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad65ddd-a6c8-4f10-be4c-4a08987e5d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:46.095575 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad65ddd-a6c8-4f10-be4c-4a08987e5d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:46.096059 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad65ddd-a6c8-4f10-be4c-4a08987e5d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:46.097437 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad65ddd-a6c8-4f10-be4c-4a08987e5d21 admin admin] PATH_INFO: `/v3/users/14ebc5a4efb5403596dbf8a34b15c57d` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:46.098285 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad65ddd-a6c8-4f10-be4c-4a08987e5d21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14ebc5a4efb5403596dbf8a34b15c57d)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:46.101070 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad65ddd-a6c8-4f10-be4c-4a08987e5d21 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:46.161443 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5d3ed-62bc-46c8-a23f-a0f5e1d41d16 service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:46.164018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-fda5d3ed-62bc-46c8-a23f-a0f5e1d41d16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:46.180272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5d3ed-62bc-46c8-a23f-a0f5e1d41d16 service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:46.191427 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a81c4-274d-44ff-bbfb-af7466563896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:46.192712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a81c4-274d-44ff-bbfb-af7466563896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:46.192712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a81c4-274d-44ff-bbfb-af7466563896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:46.192712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a81c4-274d-44ff-bbfb-af7466563896 admin admin] PATH_INFO: `/v3/projects/96d5783ed01347928b74f077f24f3404` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:46.196831 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a81c4-274d-44ff-bbfb-af7466563896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96d5783ed01347928b74f077f24f3404)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:46.197488 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a81c4-274d-44ff-bbfb-af7466563896 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:46.319364 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1ad65ddd-a6c8-4f10-be4c-4a08987e5d21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14ebc5a4efb5403596dbf8a34b15c57d'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:46.347802 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-168a81c4-274d-44ff-bbfb-af7466563896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96d5783ed01347928b74f077f24f3404', 'request_id': 'req-168a81c4-274d-44ff-bbfb-af7466563896'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:46.360222 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-168a81c4-274d-44ff-bbfb-af7466563896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96d5783ed01347928b74f077f24f3404', 'request_id': 'req-168a81c4-274d-44ff-bbfb-af7466563896'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:47.487940 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1ad65ddd-a6c8-4f10-be4c-4a08987e5d21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14ebc5a4efb5403596dbf8a34b15c57d'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:47.488566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1ad65ddd-a6c8-4f10-be4c-4a08987e5d21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14ebc5a4efb5403596dbf8a34b15c57d'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:47.489196 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1ad65ddd-a6c8-4f10-be4c-4a08987e5d21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14ebc5a4efb5403596dbf8a34b15c57d'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:47.506102 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1ad65ddd-a6c8-4f10-be4c-4a08987e5d21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14ebc5a4efb5403596dbf8a34b15c57d'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:47.519461 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 956/1910] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:27:46 2022] DELETE /identity/v3/users/14ebc5a4efb5403596dbf8a34b15c57d => generated 0 bytes in 1453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:47.520524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad65ddd-a6c8-4f10-be4c-4a08987e5d21 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:47.524308 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-1ad65ddd-a6c8-4f10-be4c-4a08987e5d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:47.570417 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-168a81c4-274d-44ff-bbfb-af7466563896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96d5783ed01347928b74f077f24f3404', 'request_id': 'req-168a81c4-274d-44ff-bbfb-af7466563896'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:47.587777 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-168a81c4-274d-44ff-bbfb-af7466563896 admin admin] The token cache is being invalidate because project 96d5783ed01347928b74f077f24f3404 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:27:47.588354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-168a81c4-274d-44ff-bbfb-af7466563896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:47.589633 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-168a81c4-274d-44ff-bbfb-af7466563896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:47.592559 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 955/1911] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:27:46 2022] DELETE /identity/v3/projects/96d5783ed01347928b74f077f24f3404 => generated 0 bytes in 1432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:27:47.594208 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e35734-3b17-43f0-a54f-5163dfd50de6 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:47.595335 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e35734-3b17-43f0-a54f-5163dfd50de6 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:47.595719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e35734-3b17-43f0-a54f-5163dfd50de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:47.626882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-07e35734-3b17-43f0-a54f-5163dfd50de6 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:47.628718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-07e35734-3b17-43f0-a54f-5163dfd50de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:47.634458 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad65ddd-a6c8-4f10-be4c-4a08987e5d21 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:47.641445 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 956/1912] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:47.641445 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e35734-3b17-43f0-a54f-5163dfd50de6 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:47.641445 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-07e35734-3b17-43f0-a54f-5163dfd50de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:47.645668 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19b17c-810a-4b10-9df6-1cd80911d6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:47.646412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19b17c-810a-4b10-9df6-1cd80911d6dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:47.646895 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19b17c-810a-4b10-9df6-1cd80911d6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:47.647326 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19b17c-810a-4b10-9df6-1cd80911d6dd admin admin] PATH_INFO: `/v3/projects/90b60dbdcd4943298d1df11612a24455` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:47.649036 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19b17c-810a-4b10-9df6-1cd80911d6dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=90b60dbdcd4943298d1df11612a24455)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:47.652477 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19b17c-810a-4b10-9df6-1cd80911d6dd admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:47.655328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e35734-3b17-43f0-a54f-5163dfd50de6 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:47.661489 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fede3e-367a-4316-bd0b-2fba14b5c8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:47.662338 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fede3e-367a-4316-bd0b-2fba14b5c8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:47.663225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fede3e-367a-4316-bd0b-2fba14b5c8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:47.663546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fede3e-367a-4316-bd0b-2fba14b5c8a7 admin admin] PATH_INFO: `/v3/users/faac501bcdb345829f47e8e97b52d6e0` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:47.665087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fede3e-367a-4316-bd0b-2fba14b5c8a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faac501bcdb345829f47e8e97b52d6e0)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:47.667197 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fede3e-367a-4316-bd0b-2fba14b5c8a7 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:47.823705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-5c19b17c-810a-4b10-9df6-1cd80911d6dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90b60dbdcd4943298d1df11612a24455', 'request_id': 'req-5c19b17c-810a-4b10-9df6-1cd80911d6dd'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:47.831794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-5c19b17c-810a-4b10-9df6-1cd80911d6dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90b60dbdcd4943298d1df11612a24455', 'request_id': 'req-5c19b17c-810a-4b10-9df6-1cd80911d6dd'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:47.894240 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-d8fede3e-367a-4316-bd0b-2fba14b5c8a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faac501bcdb345829f47e8e97b52d6e0'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:47.933552 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-5c19b17c-810a-4b10-9df6-1cd80911d6dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90b60dbdcd4943298d1df11612a24455', 'request_id': 'req-5c19b17c-810a-4b10-9df6-1cd80911d6dd'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:47.946406 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-5c19b17c-810a-4b10-9df6-1cd80911d6dd admin admin] The token cache is being invalidate because project 90b60dbdcd4943298d1df11612a24455 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:27:47.946778 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-5c19b17c-810a-4b10-9df6-1cd80911d6dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:47.947578 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-5c19b17c-810a-4b10-9df6-1cd80911d6dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:47.949547 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 957/1913] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:27:47 2022] DELETE /identity/v3/projects/90b60dbdcd4943298d1df11612a24455 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:47.950200 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19b17c-810a-4b10-9df6-1cd80911d6dd admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:47.955293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-5c19b17c-810a-4b10-9df6-1cd80911d6dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:48.015970 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19b17c-810a-4b10-9df6-1cd80911d6dd admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:48.019853 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98681ab-86c9-41f3-934c-f65c91475ca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:48.028782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98681ab-86c9-41f3-934c-f65c91475ca7 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:48.028782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98681ab-86c9-41f3-934c-f65c91475ca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:48.028782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98681ab-86c9-41f3-934c-f65c91475ca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:48.028782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-e98681ab-86c9-41f3-934c-f65c91475ca7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:48.055635 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-d8fede3e-367a-4316-bd0b-2fba14b5c8a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faac501bcdb345829f47e8e97b52d6e0'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:48.057272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-d8fede3e-367a-4316-bd0b-2fba14b5c8a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faac501bcdb345829f47e8e97b52d6e0'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:48.058212 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-d8fede3e-367a-4316-bd0b-2fba14b5c8a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faac501bcdb345829f47e8e97b52d6e0'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:48.070977 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-d8fede3e-367a-4316-bd0b-2fba14b5c8a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faac501bcdb345829f47e8e97b52d6e0'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:48.099359 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 957/1914] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:27:47 2022] DELETE /identity/v3/users/faac501bcdb345829f47e8e97b52d6e0 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:48.101214 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fede3e-367a-4316-bd0b-2fba14b5c8a7 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:48.115531 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-d8fede3e-367a-4316-bd0b-2fba14b5c8a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:48.141887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98681ab-86c9-41f3-934c-f65c91475ca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:48.144914 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98681ab-86c9-41f3-934c-f65c91475ca7 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:48.191356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 958/1915] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:48.229418 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fede3e-367a-4316-bd0b-2fba14b5c8a7 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:48.239430 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f227b1-22f9-4df7-9417-ce0e671d2ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:48.241630 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f227b1-22f9-4df7-9417-ce0e671d2ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:48.242291 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f227b1-22f9-4df7-9417-ce0e671d2ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:48.243189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f227b1-22f9-4df7-9417-ce0e671d2ff6 admin admin] PATH_INFO: `/v3/users/a4cb436fea9346e6b407c88f4009221b` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:48.244848 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f227b1-22f9-4df7-9417-ce0e671d2ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4cb436fea9346e6b407c88f4009221b)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:48.247717 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f227b1-22f9-4df7-9417-ce0e671d2ff6 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:48.546752 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-a7f227b1-22f9-4df7-9417-ce0e671d2ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4cb436fea9346e6b407c88f4009221b'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:48.658322 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-a7f227b1-22f9-4df7-9417-ce0e671d2ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4cb436fea9346e6b407c88f4009221b'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:48.660172 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-a7f227b1-22f9-4df7-9417-ce0e671d2ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4cb436fea9346e6b407c88f4009221b'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:48.661063 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-a7f227b1-22f9-4df7-9417-ce0e671d2ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4cb436fea9346e6b407c88f4009221b'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:48.684584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-a7f227b1-22f9-4df7-9417-ce0e671d2ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4cb436fea9346e6b407c88f4009221b'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:48.723796 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 958/1916] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:27:48 2022] DELETE /identity/v3/users/a4cb436fea9346e6b407c88f4009221b => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:48.853587 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:48.952342 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98681ab-86c9-41f3-934c-f65c91475ca7 service neutron] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:48.954149 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-e98681ab-86c9-41f3-934c-f65c91475ca7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:48.968495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98681ab-86c9-41f3-934c-f65c91475ca7 service neutron] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:49.042218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f227b1-22f9-4df7-9417-ce0e671d2ff6 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:49.046749 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-a7f227b1-22f9-4df7-9417-ce0e671d2ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:49.079745 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921d82f-d8cc-419b-a99b-810ac097a7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:49.080815 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921d82f-d8cc-419b-a99b-810ac097a7c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:49.081098 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921d82f-d8cc-419b-a99b-810ac097a7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:49.081422 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921d82f-d8cc-419b-a99b-810ac097a7c7 admin admin] PATH_INFO: `/v3/projects/9f611657232c435c9e73bcd3cc50f3a1` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:49.082868 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921d82f-d8cc-419b-a99b-810ac097a7c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f611657232c435c9e73bcd3cc50f3a1)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:49.086040 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921d82f-d8cc-419b-a99b-810ac097a7c7 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:49.153692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f227b1-22f9-4df7-9417-ce0e671d2ff6 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:49.167206 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e042c4-c15a-42a6-a699-b66d3f96886c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:49.168182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e042c4-c15a-42a6-a699-b66d3f96886c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:49.168628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e042c4-c15a-42a6-a699-b66d3f96886c admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:49.168972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e042c4-c15a-42a6-a699-b66d3f96886c admin admin] PATH_INFO: `/v3/projects/1f7aedc595304239a0df5a158498008a` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:49.170648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e042c4-c15a-42a6-a699-b66d3f96886c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f7aedc595304239a0df5a158498008a)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:49.186714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e042c4-c15a-42a6-a699-b66d3f96886c admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:49.273782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c921d82f-d8cc-419b-a99b-810ac097a7c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f611657232c435c9e73bcd3cc50f3a1', 'request_id': 'req-c921d82f-d8cc-419b-a99b-810ac097a7c7'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:49.282629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c921d82f-d8cc-419b-a99b-810ac097a7c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f611657232c435c9e73bcd3cc50f3a1', 'request_id': 'req-c921d82f-d8cc-419b-a99b-810ac097a7c7'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:49.423812 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-91e042c4-c15a-42a6-a699-b66d3f96886c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f7aedc595304239a0df5a158498008a', 'request_id': 'req-91e042c4-c15a-42a6-a699-b66d3f96886c'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:49.430182 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c921d82f-d8cc-419b-a99b-810ac097a7c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f611657232c435c9e73bcd3cc50f3a1', 'request_id': 'req-c921d82f-d8cc-419b-a99b-810ac097a7c7'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:49.431158 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-91e042c4-c15a-42a6-a699-b66d3f96886c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f7aedc595304239a0df5a158498008a', 'request_id': 'req-91e042c4-c15a-42a6-a699-b66d3f96886c'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:49.443141 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c921d82f-d8cc-419b-a99b-810ac097a7c7 admin admin] The token cache is being invalidate because project 9f611657232c435c9e73bcd3cc50f3a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:27:49.443409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c921d82f-d8cc-419b-a99b-810ac097a7c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:49.444808 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c921d82f-d8cc-419b-a99b-810ac097a7c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:49.446311 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 959/1917] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:27:48 2022] DELETE /identity/v3/projects/9f611657232c435c9e73bcd3cc50f3a1 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:49.451533 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50bde4-e6e8-467f-9ef8-e9d9bd492ffa None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:49.453691 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50bde4-e6e8-467f-9ef8-e9d9bd492ffa None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:49.453691 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50bde4-e6e8-467f-9ef8-e9d9bd492ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:49.480036 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-6b50bde4-e6e8-467f-9ef8-e9d9bd492ffa None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:49.481343 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-6b50bde4-e6e8-467f-9ef8-e9d9bd492ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:49.500698 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-91e042c4-c15a-42a6-a699-b66d3f96886c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f7aedc595304239a0df5a158498008a', 'request_id': 'req-91e042c4-c15a-42a6-a699-b66d3f96886c'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:49.520503 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-91e042c4-c15a-42a6-a699-b66d3f96886c admin admin] The token cache is being invalidate because project 1f7aedc595304239a0df5a158498008a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:27:49.520986 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-91e042c4-c15a-42a6-a699-b66d3f96886c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:49.521729 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-91e042c4-c15a-42a6-a699-b66d3f96886c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:49.523434 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 959/1918] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:27:49 2022] DELETE /identity/v3/projects/1f7aedc595304239a0df5a158498008a => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:27:49.524286 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e042c4-c15a-42a6-a699-b66d3f96886c admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:49.529861 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-91e042c4-c15a-42a6-a699-b66d3f96886c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:49.581038 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 960/1919] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:27:49.582477 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50bde4-e6e8-467f-9ef8-e9d9bd492ffa None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:49.585029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-6b50bde4-e6e8-467f-9ef8-e9d9bd492ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:49.601568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50bde4-e6e8-467f-9ef8-e9d9bd492ffa None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:49.607797 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156021c5-410c-4688-8b27-abafba279be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:49.608758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156021c5-410c-4688-8b27-abafba279be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:49.609035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156021c5-410c-4688-8b27-abafba279be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:49.609331 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156021c5-410c-4688-8b27-abafba279be8 admin admin] PATH_INFO: `/v3/users/cf95ab3a43084ef8be8520b2ae5976fc` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:49.610538 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156021c5-410c-4688-8b27-abafba279be8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf95ab3a43084ef8be8520b2ae5976fc)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:49.612666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156021c5-410c-4688-8b27-abafba279be8 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:49.636448 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e042c4-c15a-42a6-a699-b66d3f96886c admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:49.642161 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9746f40-3804-4ca0-b574-34a8b924a9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:49.642789 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9746f40-3804-4ca0-b574-34a8b924a9b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:49.643125 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9746f40-3804-4ca0-b574-34a8b924a9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:49.643397 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9746f40-3804-4ca0-b574-34a8b924a9b0 admin admin] PATH_INFO: `/v3/projects/d3a43b4942b64d17a5b72e95c2b64a13` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:49.644585 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9746f40-3804-4ca0-b574-34a8b924a9b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a43b4942b64d17a5b72e95c2b64a13)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:49.646498 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9746f40-3804-4ca0-b574-34a8b924a9b0 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:49.942017 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-156021c5-410c-4688-8b27-abafba279be8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf95ab3a43084ef8be8520b2ae5976fc'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:49.944460 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f9746f40-3804-4ca0-b574-34a8b924a9b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a43b4942b64d17a5b72e95c2b64a13', 'request_id': 'req-f9746f40-3804-4ca0-b574-34a8b924a9b0'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:49.951641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f9746f40-3804-4ca0-b574-34a8b924a9b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a43b4942b64d17a5b72e95c2b64a13', 'request_id': 'req-f9746f40-3804-4ca0-b574-34a8b924a9b0'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:50.025040 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:50.027409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-156021c5-410c-4688-8b27-abafba279be8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf95ab3a43084ef8be8520b2ae5976fc'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:50.028075 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-156021c5-410c-4688-8b27-abafba279be8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf95ab3a43084ef8be8520b2ae5976fc'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:50.028701 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-156021c5-410c-4688-8b27-abafba279be8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf95ab3a43084ef8be8520b2ae5976fc'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:50.037223 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-156021c5-410c-4688-8b27-abafba279be8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf95ab3a43084ef8be8520b2ae5976fc'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:50.071652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 961/1920] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:27:49 2022] DELETE /identity/v3/users/cf95ab3a43084ef8be8520b2ae5976fc => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:50.072870 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d56bc-f143-4172-9240-7ab9aabb0c25 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:50.073531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d56bc-f143-4172-9240-7ab9aabb0c25 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:50.073531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d56bc-f143-4172-9240-7ab9aabb0c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:50.107791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f9746f40-3804-4ca0-b574-34a8b924a9b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a43b4942b64d17a5b72e95c2b64a13', 'request_id': 'req-f9746f40-3804-4ca0-b574-34a8b924a9b0'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:50.112124 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-fb6d56bc-f143-4172-9240-7ab9aabb0c25 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:50.114006 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-fb6d56bc-f143-4172-9240-7ab9aabb0c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:50.149336 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f9746f40-3804-4ca0-b574-34a8b924a9b0 admin admin] The token cache is being invalidate because project d3a43b4942b64d17a5b72e95c2b64a13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:27:50.153278 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f9746f40-3804-4ca0-b574-34a8b924a9b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:50.163064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f9746f40-3804-4ca0-b574-34a8b924a9b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:50.169436 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 960/1921] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:27:49 2022] DELETE /identity/v3/projects/d3a43b4942b64d17a5b72e95c2b64a13 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:50.174465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9746f40-3804-4ca0-b574-34a8b924a9b0 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:50.179002 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f9746f40-3804-4ca0-b574-34a8b924a9b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:50.222401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 962/1922] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:50.226118 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d56bc-f143-4172-9240-7ab9aabb0c25 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:50.238926 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d56bc-f143-4172-9240-7ab9aabb0c25 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:50.244607 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d725f-424e-4f34-9854-ddcd7c9b0b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:50.249363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d725f-424e-4f34-9854-ddcd7c9b0b3e admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:50.249363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d725f-424e-4f34-9854-ddcd7c9b0b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:50.249363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d725f-424e-4f34-9854-ddcd7c9b0b3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:50.249363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d725f-424e-4f34-9854-ddcd7c9b0b3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:27:50.249363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d725f-424e-4f34-9854-ddcd7c9b0b3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:50.249363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d725f-424e-4f34-9854-ddcd7c9b0b3e admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:50.263526 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 963/1923] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:27:50.275638 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d725f-424e-4f34-9854-ddcd7c9b0b3e admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:50.277216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9746f40-3804-4ca0-b574-34a8b924a9b0 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:50.282299 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1fb2e-23b5-46ed-b8ac-70cb4f15e4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:50.283684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1fb2e-23b5-46ed-b8ac-70cb4f15e4e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:50.283684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1fb2e-23b5-46ed-b8ac-70cb4f15e4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:50.283684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1fb2e-23b5-46ed-b8ac-70cb4f15e4e3 admin admin] PATH_INFO: `/v3/users/41dda2a8685b40d2a7de97df9211d6cb` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:50.284813 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1fb2e-23b5-46ed-b8ac-70cb4f15e4e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41dda2a8685b40d2a7de97df9211d6cb)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:50.286005 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d725f-424e-4f34-9854-ddcd7c9b0b3e admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:50.286760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1fb2e-23b5-46ed-b8ac-70cb4f15e4e3 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:50.291155 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbea3f-46f3-4b50-a9e4-780e0de5c0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:50.291833 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbea3f-46f3-4b50-a9e4-780e0de5c0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:50.292109 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbea3f-46f3-4b50-a9e4-780e0de5c0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:50.292382 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbea3f-46f3-4b50-a9e4-780e0de5c0c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:50.293031 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfbea3f-46f3-4b50-a9e4-780e0de5c0c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:50.294963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfbea3f-46f3-4b50-a9e4-780e0de5c0c6 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:50.434523 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 964/1924] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:50 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:50.435641 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbea3f-46f3-4b50-a9e4-780e0de5c0c6 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:50.508942 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c1d1fb2e-23b5-46ed-b8ac-70cb4f15e4e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41dda2a8685b40d2a7de97df9211d6cb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:50.529079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbea3f-46f3-4b50-a9e4-780e0de5c0c6 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:50.534649 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773289c-6248-4c88-b977-59a9db86a6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:50.535274 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773289c-6248-4c88-b977-59a9db86a6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:50.535627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773289c-6248-4c88-b977-59a9db86a6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:50.536004 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773289c-6248-4c88-b977-59a9db86a6b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:50.536694 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773289c-6248-4c88-b977-59a9db86a6b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:50.538838 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773289c-6248-4c88-b977-59a9db86a6b7 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:50.642087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c1d1fb2e-23b5-46ed-b8ac-70cb4f15e4e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41dda2a8685b40d2a7de97df9211d6cb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:50.642962 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c1d1fb2e-23b5-46ed-b8ac-70cb4f15e4e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41dda2a8685b40d2a7de97df9211d6cb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:50.644455 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c1d1fb2e-23b5-46ed-b8ac-70cb4f15e4e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41dda2a8685b40d2a7de97df9211d6cb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:50.659816 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 965/1925] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:50 2022] POST /identity/v3/users => generated 292 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:50.660324 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773289c-6248-4c88-b977-59a9db86a6b7 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:50.663893 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c1d1fb2e-23b5-46ed-b8ac-70cb4f15e4e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41dda2a8685b40d2a7de97df9211d6cb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:50.669164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-d773289c-6248-4c88-b977-59a9db86a6b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:50.691893 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 961/1926] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:27:50 2022] DELETE /identity/v3/users/41dda2a8685b40d2a7de97df9211d6cb => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:50.693817 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1fb2e-23b5-46ed-b8ac-70cb4f15e4e3 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:50.695978 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c1d1fb2e-23b5-46ed-b8ac-70cb4f15e4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:50.698460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773289c-6248-4c88-b977-59a9db86a6b7 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:50.792630 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1fb2e-23b5-46ed-b8ac-70cb4f15e4e3 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:50.797926 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7601211-8ac8-4838-a913-097ea33b7b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:50.799288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7601211-8ac8-4838-a913-097ea33b7b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:50.799594 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7601211-8ac8-4838-a913-097ea33b7b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:50.800389 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a62d1-0b8f-4a92-864e-06fd785d586a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:50.800580 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7601211-8ac8-4838-a913-097ea33b7b3f admin admin] PATH_INFO: `/v3/projects/562dacceb0324feeade8d799e62d296d` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:50.800869 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a62d1-0b8f-4a92-864e-06fd785d586a admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:50.801218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a62d1-0b8f-4a92-864e-06fd785d586a admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:50.801559 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a62d1-0b8f-4a92-864e-06fd785d586a admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:50.801705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7601211-8ac8-4838-a913-097ea33b7b3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=562dacceb0324feeade8d799e62d296d)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:50.802397 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a62d1-0b8f-4a92-864e-06fd785d586a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:50.804370 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7601211-8ac8-4838-a913-097ea33b7b3f admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:50.806090 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a62d1-0b8f-4a92-864e-06fd785d586a admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:50.838204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 962/1927] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:50.839724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a62d1-0b8f-4a92-864e-06fd785d586a admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:50.862813 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a62d1-0b8f-4a92-864e-06fd785d586a admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:50.870718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072acca-4534-4e4f-bb06-afaa3140f102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:50.874007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072acca-4534-4e4f-bb06-afaa3140f102 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:50.874811 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072acca-4534-4e4f-bb06-afaa3140f102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:50.875157 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072acca-4534-4e4f-bb06-afaa3140f102 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:50.876093 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072acca-4534-4e4f-bb06-afaa3140f102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:50.880377 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072acca-4534-4e4f-bb06-afaa3140f102 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:50.894504 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 963/1928] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:50.901626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072acca-4534-4e4f-bb06-afaa3140f102 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:50.930337 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072acca-4534-4e4f-bb06-afaa3140f102 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:50.937291 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596bef0-1ef5-4426-bae6-6c56b107a753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:50.937982 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596bef0-1ef5-4426-bae6-6c56b107a753 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:50.938265 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596bef0-1ef5-4426-bae6-6c56b107a753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:50.938543 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596bef0-1ef5-4426-bae6-6c56b107a753 admin admin] PATH_INFO: `/v3/projects/92ff8f4c5e2b4d3d987db92f55e96bc9/users/fcccc574db484acd9dec6da8725bd905/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:50.965450 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596bef0-1ef5-4426-bae6-6c56b107a753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ff8f4c5e2b4d3d987db92f55e96bc9, user_id=fcccc574db484acd9dec6da8725bd905, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:50.967028 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596bef0-1ef5-4426-bae6-6c56b107a753 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:51.098669 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 964/1929] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:50 2022] PUT /identity/v3/projects/92ff8f4c5e2b4d3d987db92f55e96bc9/users/fcccc574db484acd9dec6da8725bd905/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:51.105589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c7601211-8ac8-4838-a913-097ea33b7b3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '562dacceb0324feeade8d799e62d296d', 'request_id': 'req-c7601211-8ac8-4838-a913-097ea33b7b3f'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:51.114642 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c7601211-8ac8-4838-a913-097ea33b7b3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '562dacceb0324feeade8d799e62d296d', 'request_id': 'req-c7601211-8ac8-4838-a913-097ea33b7b3f'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:51.118965 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ead21-e0b4-424f-b222-a42b17568a39 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:51.119380 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ead21-e0b4-424f-b222-a42b17568a39 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:51.119824 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ead21-e0b4-424f-b222-a42b17568a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:51.203195 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-744ead21-e0b4-424f-b222-a42b17568a39 None None] MFA Rules not processed for user `fcccc574db484acd9dec6da8725bd905`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:51.205710 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-744ead21-e0b4-424f-b222-a42b17568a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:51.219598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c7601211-8ac8-4838-a913-097ea33b7b3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '562dacceb0324feeade8d799e62d296d', 'request_id': 'req-c7601211-8ac8-4838-a913-097ea33b7b3f'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:51.244086 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c7601211-8ac8-4838-a913-097ea33b7b3f admin admin] The token cache is being invalidate because project 562dacceb0324feeade8d799e62d296d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:27:51.244831 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c7601211-8ac8-4838-a913-097ea33b7b3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:51.250609 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c7601211-8ac8-4838-a913-097ea33b7b3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:51.250609 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 966/1930] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:27:50 2022] DELETE /identity/v3/projects/562dacceb0324feeade8d799e62d296d => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:51.255149 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2f465-c1db-426c-a98c-86cf8cef70a5 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:51.255474 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2f465-c1db-426c-a98c-86cf8cef70a5 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:51.255771 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2f465-c1db-426c-a98c-86cf8cef70a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:51.285637 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-9ce2f465-c1db-426c-a98c-86cf8cef70a5 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:51.287208 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-9ce2f465-c1db-426c-a98c-86cf8cef70a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:51.387414 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 967/1931] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:51.387634 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 965/1932] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:51.387716 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2f465-c1db-426c-a98c-86cf8cef70a5 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:51.388100 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-9ce2f465-c1db-426c-a98c-86cf8cef70a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:51.389517 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9c5e9-0352-4689-968b-a83bdf5a4cfc None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:51.389799 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9c5e9-0352-4689-968b-a83bdf5a4cfc None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:51.390074 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9c5e9-0352-4689-968b-a83bdf5a4cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:51.408195 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2f465-c1db-426c-a98c-86cf8cef70a5 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:51.419784 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-48b9c5e9-0352-4689-968b-a83bdf5a4cfc None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:51.421323 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-48b9c5e9-0352-4689-968b-a83bdf5a4cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:51.423481 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8820a3-d101-4ef2-aad7-5cc9c1fff593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:51.425351 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8820a3-d101-4ef2-aad7-5cc9c1fff593 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:51.426399 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8820a3-d101-4ef2-aad7-5cc9c1fff593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:51.428416 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8820a3-d101-4ef2-aad7-5cc9c1fff593 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:51.429091 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8820a3-d101-4ef2-aad7-5cc9c1fff593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:51.433473 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 966/1933] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:51.433675 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8820a3-d101-4ef2-aad7-5cc9c1fff593 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:51.438726 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9c5e9-0352-4689-968b-a83bdf5a4cfc None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:51.451057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9c5e9-0352-4689-968b-a83bdf5a4cfc None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:51.456287 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e823cb9-bf4b-4071-80b2-9aad7872e20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:51.456912 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e823cb9-bf4b-4071-80b2-9aad7872e20b admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:51.457292 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e823cb9-bf4b-4071-80b2-9aad7872e20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:51.457468 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e823cb9-bf4b-4071-80b2-9aad7872e20b admin admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:51.458115 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e823cb9-bf4b-4071-80b2-9aad7872e20b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:27:51.458423 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e823cb9-bf4b-4071-80b2-9aad7872e20b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:51.460935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e823cb9-bf4b-4071-80b2-9aad7872e20b admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:51.475246 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 967/1934] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:27:51.480893 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e823cb9-bf4b-4071-80b2-9aad7872e20b admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:51.491752 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e823cb9-bf4b-4071-80b2-9aad7872e20b admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:51.496617 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10805a34-a72b-4e17-81f2-29c5e06f44fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:51.497348 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10805a34-a72b-4e17-81f2-29c5e06f44fd admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:51.497639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10805a34-a72b-4e17-81f2-29c5e06f44fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:51.497912 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10805a34-a72b-4e17-81f2-29c5e06f44fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:51.498577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10805a34-a72b-4e17-81f2-29c5e06f44fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:51.500556 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10805a34-a72b-4e17-81f2-29c5e06f44fd admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:51.566639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:51.574458 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 968/1935] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:51 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:27:51.575657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8820a3-d101-4ef2-aad7-5cc9c1fff593 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:51.577234 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ad8820a3-d101-4ef2-aad7-5cc9c1fff593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:51.603120 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 968/1936] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:51 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:27:51.603120 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10805a34-a72b-4e17-81f2-29c5e06f44fd admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:51.655777 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8820a3-d101-4ef2-aad7-5cc9c1fff593 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:51.680297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10805a34-a72b-4e17-81f2-29c5e06f44fd admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:51.685368 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836698a-fcf3-40d0-9323-20b89f36d894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:51.686015 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836698a-fcf3-40d0-9323-20b89f36d894 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:51.686366 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836698a-fcf3-40d0-9323-20b89f36d894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:51.686575 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836698a-fcf3-40d0-9323-20b89f36d894 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:51.687189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836698a-fcf3-40d0-9323-20b89f36d894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:51.689289 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836698a-fcf3-40d0-9323-20b89f36d894 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:51.718036 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe5962-a8b6-47fd-824d-5edc0cf92c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:51.718682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe5962-a8b6-47fd-824d-5edc0cf92c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:51.718960 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe5962-a8b6-47fd-824d-5edc0cf92c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:51.719288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe5962-a8b6-47fd-824d-5edc0cf92c01 admin admin] PATH_INFO: `/v3/projects/a9d17f6820f548a7972ee5a5bafc10ca` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:51.720476 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe5962-a8b6-47fd-824d-5edc0cf92c01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9d17f6820f548a7972ee5a5bafc10ca)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:51.724650 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe5962-a8b6-47fd-824d-5edc0cf92c01 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:51.924332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 969/1937] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:51 2022] POST /identity/v3/users => generated 293 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:51.925222 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836698a-fcf3-40d0-9323-20b89f36d894 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:51.940393 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836698a-fcf3-40d0-9323-20b89f36d894 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:51.941568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-90fe5962-a8b6-47fd-824d-5edc0cf92c01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9d17f6820f548a7972ee5a5bafc10ca', 'request_id': 'req-90fe5962-a8b6-47fd-824d-5edc0cf92c01'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:51.949907 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-90fe5962-a8b6-47fd-824d-5edc0cf92c01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9d17f6820f548a7972ee5a5bafc10ca', 'request_id': 'req-90fe5962-a8b6-47fd-824d-5edc0cf92c01'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:52.009366 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62addd06-5255-43f1-aa40-f4ef8365b0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:52.015223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62addd06-5255-43f1-aa40-f4ef8365b0d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:52.015223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62addd06-5255-43f1-aa40-f4ef8365b0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:52.015223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62addd06-5255-43f1-aa40-f4ef8365b0d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:52.015223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62addd06-5255-43f1-aa40-f4ef8365b0d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:52.015223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62addd06-5255-43f1-aa40-f4ef8365b0d6 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:52.076213 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-90fe5962-a8b6-47fd-824d-5edc0cf92c01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9d17f6820f548a7972ee5a5bafc10ca', 'request_id': 'req-90fe5962-a8b6-47fd-824d-5edc0cf92c01'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:52.099125 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-90fe5962-a8b6-47fd-824d-5edc0cf92c01 admin admin] The token cache is being invalidate because project a9d17f6820f548a7972ee5a5bafc10ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:27:52.099576 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-90fe5962-a8b6-47fd-824d-5edc0cf92c01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:52.100858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-90fe5962-a8b6-47fd-824d-5edc0cf92c01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:52.102845 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 969/1938] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:27:51 2022] DELETE /identity/v3/projects/a9d17f6820f548a7972ee5a5bafc10ca => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:52.103772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe5962-a8b6-47fd-824d-5edc0cf92c01 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:52.106788 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-90fe5962-a8b6-47fd-824d-5edc0cf92c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:52.132542 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe5962-a8b6-47fd-824d-5edc0cf92c01 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:52.137910 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fdba51-c384-4b19-94ef-25a78e868c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:52.138632 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdba51-c384-4b19-94ef-25a78e868c0f admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:52.138981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdba51-c384-4b19-94ef-25a78e868c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:52.139257 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdba51-c384-4b19-94ef-25a78e868c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:52.140468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fdba51-c384-4b19-94ef-25a78e868c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:52.142934 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fdba51-c384-4b19-94ef-25a78e868c0f admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:52.155992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 970/1939] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:51 2022] POST /identity/v3/users => generated 294 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:52.166169 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 970/1940] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:52.166529 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a317b41-bcda-4282-a9be-8b9b8c0101db None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:52.166529 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a317b41-bcda-4282-a9be-8b9b8c0101db None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:52.166529 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a317b41-bcda-4282-a9be-8b9b8c0101db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:52.171125 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fdba51-c384-4b19-94ef-25a78e868c0f admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:52.194417 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fdba51-c384-4b19-94ef-25a78e868c0f admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:52.194610 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-0a317b41-bcda-4282-a9be-8b9b8c0101db None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:52.198465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-0a317b41-bcda-4282-a9be-8b9b8c0101db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:52.206439 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae7c82-4257-4054-be3a-247426ef0490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:52.211796 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae7c82-4257-4054-be3a-247426ef0490 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:52.211796 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae7c82-4257-4054-be3a-247426ef0490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:52.211796 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae7c82-4257-4054-be3a-247426ef0490 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:52.211796 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae7c82-4257-4054-be3a-247426ef0490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:52.211796 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae7c82-4257-4054-be3a-247426ef0490 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:52.219780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 971/1941] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:52.221797 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a317b41-bcda-4282-a9be-8b9b8c0101db None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:52.223921 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-0a317b41-bcda-4282-a9be-8b9b8c0101db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:52.229381 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 971/1942] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:52.230836 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf713a0-a725-420e-b759-a94848a37878 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:52.232407 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf713a0-a725-420e-b759-a94848a37878 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:52.232969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf713a0-a725-420e-b759-a94848a37878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:52.245675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a317b41-bcda-4282-a9be-8b9b8c0101db None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:52.251997 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698cde8-d511-4777-845b-e2bda86e7fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:52.252729 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698cde8-d511-4777-845b-e2bda86e7fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:52.253136 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698cde8-d511-4777-845b-e2bda86e7fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:52.257692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698cde8-d511-4777-845b-e2bda86e7fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:52.257692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698cde8-d511-4777-845b-e2bda86e7fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:52.257692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698cde8-d511-4777-845b-e2bda86e7fb4 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:52.258077 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-bdf713a0-a725-420e-b759-a94848a37878 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:52.258785 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-bdf713a0-a725-420e-b759-a94848a37878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:52.267990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 972/1943] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:52.268737 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf713a0-a725-420e-b759-a94848a37878 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:52.276970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 972/1944] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:52.277888 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698cde8-d511-4777-845b-e2bda86e7fb4 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:52.282294 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf713a0-a725-420e-b759-a94848a37878 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:52.288410 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20388a8e-f305-4f2c-8d48-da61206ef82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:52.289098 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20388a8e-f305-4f2c-8d48-da61206ef82d admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:52.289513 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20388a8e-f305-4f2c-8d48-da61206ef82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:52.289789 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20388a8e-f305-4f2c-8d48-da61206ef82d admin admin] PATH_INFO: `/v3/projects/1d390c6e7f0b4c02bad1144650b83f14/users/6c1e1ed5ed164ca499aa47b486780ba4/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:52.290149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698cde8-d511-4777-845b-e2bda86e7fb4 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:52.296653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1e010-37a9-4c80-ade2-1b72c190f661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:52.297494 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1e010-37a9-4c80-ade2-1b72c190f661 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:52.297973 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1e010-37a9-4c80-ade2-1b72c190f661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:52.298125 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1e010-37a9-4c80-ade2-1b72c190f661 admin admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:52.299144 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1e010-37a9-4c80-ade2-1b72c190f661 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:27:52.299144 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1e010-37a9-4c80-ade2-1b72c190f661 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:52.301456 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1e010-37a9-4c80-ade2-1b72c190f661 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:52.313457 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20388a8e-f305-4f2c-8d48-da61206ef82d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d390c6e7f0b4c02bad1144650b83f14, user_id=6c1e1ed5ed164ca499aa47b486780ba4, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:52.317998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20388a8e-f305-4f2c-8d48-da61206ef82d admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:52.322927 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 973/1945] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:27:52.324133 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1e010-37a9-4c80-ade2-1b72c190f661 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:52.338062 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1e010-37a9-4c80-ade2-1b72c190f661 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:52.348162 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fb68d-1149-497d-b34f-64e40812368c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:52.348894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fb68d-1149-497d-b34f-64e40812368c admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:52.349233 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fb68d-1149-497d-b34f-64e40812368c admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:52.350273 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fb68d-1149-497d-b34f-64e40812368c admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:52.350886 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fb68d-1149-497d-b34f-64e40812368c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:52.353294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fb68d-1149-497d-b34f-64e40812368c admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:52.377207 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 974/1946] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:52.378102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fb68d-1149-497d-b34f-64e40812368c admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:52.391038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fb68d-1149-497d-b34f-64e40812368c admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:52.397849 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158aa1c2-d596-4779-94be-ff8e878fbd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:52.398649 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158aa1c2-d596-4779-94be-ff8e878fbd10 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:52.398934 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158aa1c2-d596-4779-94be-ff8e878fbd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:52.399204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158aa1c2-d596-4779-94be-ff8e878fbd10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:52.399885 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158aa1c2-d596-4779-94be-ff8e878fbd10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:52.402168 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158aa1c2-d596-4779-94be-ff8e878fbd10 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:52.409576 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 973/1947] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:52 2022] PUT /identity/v3/projects/1d390c6e7f0b4c02bad1144650b83f14/users/6c1e1ed5ed164ca499aa47b486780ba4/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:52.414148 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20388a8e-f305-4f2c-8d48-da61206ef82d admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:52.488698 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20388a8e-f305-4f2c-8d48-da61206ef82d admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:52.493450 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fa1c5-313f-499d-b864-fd2dcaba358f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:52.494123 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fa1c5-313f-499d-b864-fd2dcaba358f admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:52.494399 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fa1c5-313f-499d-b864-fd2dcaba358f admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:52.494673 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fa1c5-313f-499d-b864-fd2dcaba358f admin admin] PATH_INFO: `/v3/projects/8e9a309515d84d11a9b5dda5676f2941/users/c0e38fef89d242f1b8f7671c079bda89/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:52.509882 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fa1c5-313f-499d-b864-fd2dcaba358f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e9a309515d84d11a9b5dda5676f2941, user_id=c0e38fef89d242f1b8f7671c079bda89, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:52.512594 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fa1c5-313f-499d-b864-fd2dcaba358f admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:52.535624 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 975/1948] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:52 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:52.539235 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0455bff-37d6-4d9f-99be-3547394a06c9 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:52.539235 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0455bff-37d6-4d9f-99be-3547394a06c9 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:52.539235 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0455bff-37d6-4d9f-99be-3547394a06c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:52.577969 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-d0455bff-37d6-4d9f-99be-3547394a06c9 None None] MFA Rules not processed for user `6c1e1ed5ed164ca499aa47b486780ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:52.577969 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-d0455bff-37d6-4d9f-99be-3547394a06c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:52.591681 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 974/1949] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:52 2022] PUT /identity/v3/projects/8e9a309515d84d11a9b5dda5676f2941/users/c0e38fef89d242f1b8f7671c079bda89/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:52.601664 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fa1c5-313f-499d-b864-fd2dcaba358f admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:52.680761 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 976/1950] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:52.688532 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb690c-b8f6-4e56-a475-b84ae709e907 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:52.688925 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb690c-b8f6-4e56-a475-b84ae709e907 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:52.689407 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb690c-b8f6-4e56-a475-b84ae709e907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:52.693346 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fa1c5-313f-499d-b864-fd2dcaba358f admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:52.700314 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fea8c4-d7c9-4552-83eb-0da400a5ce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:52.701273 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fea8c4-d7c9-4552-83eb-0da400a5ce17 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:52.701791 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fea8c4-d7c9-4552-83eb-0da400a5ce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:52.702369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fea8c4-d7c9-4552-83eb-0da400a5ce17 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:52.703248 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fea8c4-d7c9-4552-83eb-0da400a5ce17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:52.708758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fea8c4-d7c9-4552-83eb-0da400a5ce17 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:52.751049 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-85eb690c-b8f6-4e56-a475-b84ae709e907 None None] MFA Rules not processed for user `c0e38fef89d242f1b8f7671c079bda89`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:52.752855 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-85eb690c-b8f6-4e56-a475-b84ae709e907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:52.862232 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 977/1951] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:52.863328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb690c-b8f6-4e56-a475-b84ae709e907 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:52.876326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb690c-b8f6-4e56-a475-b84ae709e907 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:52.878147 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 975/1952] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:52 2022] POST /identity/v3/users => generated 292 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:52.883503 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fea8c4-d7c9-4552-83eb-0da400a5ce17 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:52.883858 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ff38d-0832-4721-8cca-45a57b8ddde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:52.883858 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ff38d-0832-4721-8cca-45a57b8ddde2 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:52.884201 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ff38d-0832-4721-8cca-45a57b8ddde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:52.884671 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ff38d-0832-4721-8cca-45a57b8ddde2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:52.885654 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ff38d-0832-4721-8cca-45a57b8ddde2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:52.888152 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ff38d-0832-4721-8cca-45a57b8ddde2 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:52.892173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fea8c4-d7c9-4552-83eb-0da400a5ce17 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:52.897791 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d80a53-7d50-4a6a-9e19-19244addfb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:52.898421 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d80a53-7d50-4a6a-9e19-19244addfb07 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:52.898727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d80a53-7d50-4a6a-9e19-19244addfb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:52.899006 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d80a53-7d50-4a6a-9e19-19244addfb07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:52.899687 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d80a53-7d50-4a6a-9e19-19244addfb07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:52.901841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d80a53-7d50-4a6a-9e19-19244addfb07 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:53.024990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 976/1953] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:52 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:53.025415 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d80a53-7d50-4a6a-9e19-19244addfb07 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:53.026997 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 978/1954] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:52 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:53.032479 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ff38d-0832-4721-8cca-45a57b8ddde2 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:53.143976 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ff38d-0832-4721-8cca-45a57b8ddde2 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:53.145330 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d80a53-7d50-4a6a-9e19-19244addfb07 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:53.147891 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:53.149751 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f060b-54ea-400a-918c-53fc21b70da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:53.150429 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f060b-54ea-400a-918c-53fc21b70da9 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:53.150720 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f060b-54ea-400a-918c-53fc21b70da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:53.151136 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f060b-54ea-400a-918c-53fc21b70da9 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:53.151813 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f060b-54ea-400a-918c-53fc21b70da9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:53.152652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef25fad-73c7-4ccc-8cd8-112a4f3fe4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:53.154368 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef25fad-73c7-4ccc-8cd8-112a4f3fe4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:53.154368 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef25fad-73c7-4ccc-8cd8-112a4f3fe4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:53.154613 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f060b-54ea-400a-918c-53fc21b70da9 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:53.154692 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef25fad-73c7-4ccc-8cd8-112a4f3fe4e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:53.154982 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef25fad-73c7-4ccc-8cd8-112a4f3fe4e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:53.156625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef25fad-73c7-4ccc-8cd8-112a4f3fe4e2 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:53.171283 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 977/1955] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:53.172426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef25fad-73c7-4ccc-8cd8-112a4f3fe4e2 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:53.183372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef25fad-73c7-4ccc-8cd8-112a4f3fe4e2 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:53.193101 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4ac9c-3c08-4b5d-abac-f676cc7318ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:53.194357 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4ac9c-3c08-4b5d-abac-f676cc7318ee admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:53.194679 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4ac9c-3c08-4b5d-abac-f676cc7318ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:53.194958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4ac9c-3c08-4b5d-abac-f676cc7318ee admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:53.195760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4ac9c-3c08-4b5d-abac-f676cc7318ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:53.196933 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:53.197890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4ac9c-3c08-4b5d-abac-f676cc7318ee admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:53.233970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 979/1956] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:53 2022] POST /identity/v3/users => generated 294 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:53.233970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f060b-54ea-400a-918c-53fc21b70da9 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:53.246191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f060b-54ea-400a-918c-53fc21b70da9 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:53.254784 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540fe2e-3430-4284-a4c4-cf49a4f8194e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:53.255415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540fe2e-3430-4284-a4c4-cf49a4f8194e admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:53.255735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540fe2e-3430-4284-a4c4-cf49a4f8194e admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:53.256063 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540fe2e-3430-4284-a4c4-cf49a4f8194e admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:53.257224 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540fe2e-3430-4284-a4c4-cf49a4f8194e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:53.262228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540fe2e-3430-4284-a4c4-cf49a4f8194e admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:53.272840 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 980/1957] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:53.273731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540fe2e-3430-4284-a4c4-cf49a4f8194e admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:53.284987 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540fe2e-3430-4284-a4c4-cf49a4f8194e admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:53.287954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 978/1958] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:53 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:53.289384 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4ac9c-3c08-4b5d-abac-f676cc7318ee admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:53.290907 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1038f-c0e5-45ac-a14a-eb2c155e48d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:53.293126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1038f-c0e5-45ac-a14a-eb2c155e48d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:53.293552 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1038f-c0e5-45ac-a14a-eb2c155e48d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:53.293833 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1038f-c0e5-45ac-a14a-eb2c155e48d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:53.294488 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1038f-c0e5-45ac-a14a-eb2c155e48d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:53.296185 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1038f-c0e5-45ac-a14a-eb2c155e48d9 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:53.299952 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4ac9c-3c08-4b5d-abac-f676cc7318ee admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:53.306628 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fc12e-0bbc-4038-9217-6eb19c502e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:53.307698 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fc12e-0bbc-4038-9217-6eb19c502e6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:53.308006 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 981/1959] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:53.308577 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fc12e-0bbc-4038-9217-6eb19c502e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:53.309006 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1038f-c0e5-45ac-a14a-eb2c155e48d9 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:53.309270 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fc12e-0bbc-4038-9217-6eb19c502e6c admin admin] PATH_INFO: `/v3/projects/778637a20f3c465495a99e00fe21dc2a/users/9312d185e74b49bd99e02af6311a1636/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:53.322542 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1038f-c0e5-45ac-a14a-eb2c155e48d9 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:53.328088 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586a8b2-9b84-4e78-8bfe-1f7f0277536b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:53.328741 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586a8b2-9b84-4e78-8bfe-1f7f0277536b admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:53.329023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586a8b2-9b84-4e78-8bfe-1f7f0277536b admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:53.329297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586a8b2-9b84-4e78-8bfe-1f7f0277536b admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:53.329732 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8fc12e-0bbc-4038-9217-6eb19c502e6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=778637a20f3c465495a99e00fe21dc2a, user_id=9312d185e74b49bd99e02af6311a1636, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:53.329942 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586a8b2-9b84-4e78-8bfe-1f7f0277536b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:53.331697 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586a8b2-9b84-4e78-8bfe-1f7f0277536b admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:53.332849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8fc12e-0bbc-4038-9217-6eb19c502e6c admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:53.343044 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 982/1960] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:53.343945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586a8b2-9b84-4e78-8bfe-1f7f0277536b admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:53.354361 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586a8b2-9b84-4e78-8bfe-1f7f0277536b admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:53.359309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e24bf2-f1a9-41f1-935c-b03d9c686c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:53.359994 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e24bf2-f1a9-41f1-935c-b03d9c686c24 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:53.360291 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e24bf2-f1a9-41f1-935c-b03d9c686c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:53.364902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e24bf2-f1a9-41f1-935c-b03d9c686c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:53.364902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e24bf2-f1a9-41f1-935c-b03d9c686c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:53.364902 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e24bf2-f1a9-41f1-935c-b03d9c686c24 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:53.375415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 983/1961] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:53.376576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e24bf2-f1a9-41f1-935c-b03d9c686c24 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:53.387934 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e24bf2-f1a9-41f1-935c-b03d9c686c24 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:53.399259 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed705d1-0d7d-47d7-b7cb-2c2c3298947e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:53.399259 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed705d1-0d7d-47d7-b7cb-2c2c3298947e admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:53.399259 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed705d1-0d7d-47d7-b7cb-2c2c3298947e admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:53.399259 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed705d1-0d7d-47d7-b7cb-2c2c3298947e admin admin] PATH_INFO: `/v3/projects/c9a545f03e8749eab32cecbb868b6532/users/4f0086646bea4a33bd1155bfb0ae97cd/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:53.431460 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed705d1-0d7d-47d7-b7cb-2c2c3298947e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9a545f03e8749eab32cecbb868b6532, user_id=4f0086646bea4a33bd1155bfb0ae97cd, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:53.435095 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed705d1-0d7d-47d7-b7cb-2c2c3298947e admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:53.435545 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 979/1962] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:53 2022] PUT /identity/v3/projects/778637a20f3c465495a99e00fe21dc2a/users/9312d185e74b49bd99e02af6311a1636/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:53.436878 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fc12e-0bbc-4038-9217-6eb19c502e6c admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:53.518353 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fc12e-0bbc-4038-9217-6eb19c502e6c admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:53.522171 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 984/1963] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:53 2022] PUT /identity/v3/projects/c9a545f03e8749eab32cecbb868b6532/users/4f0086646bea4a33bd1155bfb0ae97cd/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:53.522867 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed705d1-0d7d-47d7-b7cb-2c2c3298947e admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:53.525904 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-fed705d1-0d7d-47d7-b7cb-2c2c3298947e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:53.600736 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed705d1-0d7d-47d7-b7cb-2c2c3298947e admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:53.609440 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a16b77-bd78-4146-96ea-7baa5af6e943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:53.610998 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a16b77-bd78-4146-96ea-7baa5af6e943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:53.611332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a16b77-bd78-4146-96ea-7baa5af6e943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:53.611896 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a16b77-bd78-4146-96ea-7baa5af6e943 admin admin] PATH_INFO: `/v3/users/b41b531e9d7847039b37090d97aaf242` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:53.616036 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a16b77-bd78-4146-96ea-7baa5af6e943 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b41b531e9d7847039b37090d97aaf242)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:53.616233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c3b57-3f43-4ebb-bc98-079a8e8572ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:53.616233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c3b57-3f43-4ebb-bc98-079a8e8572ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:53.616473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c3b57-3f43-4ebb-bc98-079a8e8572ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:53.616805 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c3b57-3f43-4ebb-bc98-079a8e8572ba admin admin] PATH_INFO: `/v3/projects/679accc8ece245d1a36df4d889982453/users/55b4e818df334c8ca344ddb8e7f40237/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:53.617022 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a16b77-bd78-4146-96ea-7baa5af6e943 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:53.653348 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c3b57-3f43-4ebb-bc98-079a8e8572ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=679accc8ece245d1a36df4d889982453, user_id=55b4e818df334c8ca344ddb8e7f40237, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:53.653348 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c3b57-3f43-4ebb-bc98-079a8e8572ba admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:53.743528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:53.802291 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 980/1964] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:53 2022] PUT /identity/v3/projects/679accc8ece245d1a36df4d889982453/users/55b4e818df334c8ca344ddb8e7f40237/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:53.804077 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368d27c-eb51-4c87-a170-78214ca1db87 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:53.806657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368d27c-eb51-4c87-a170-78214ca1db87 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:53.806657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368d27c-eb51-4c87-a170-78214ca1db87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:53.842648 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-3368d27c-eb51-4c87-a170-78214ca1db87 None None] MFA Rules not processed for user `9312d185e74b49bd99e02af6311a1636`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:53.844392 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-3368d27c-eb51-4c87-a170-78214ca1db87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:53.925049 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 981/1965] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:53.928859 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368d27c-eb51-4c87-a170-78214ca1db87 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:53.951763 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f9a16b77-bd78-4146-96ea-7baa5af6e943 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b41b531e9d7847039b37090d97aaf242'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:54.023996 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f9a16b77-bd78-4146-96ea-7baa5af6e943 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b41b531e9d7847039b37090d97aaf242'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:54.024764 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f9a16b77-bd78-4146-96ea-7baa5af6e943 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b41b531e9d7847039b37090d97aaf242'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:54.025859 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f9a16b77-bd78-4146-96ea-7baa5af6e943 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b41b531e9d7847039b37090d97aaf242'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:54.033106 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368d27c-eb51-4c87-a170-78214ca1db87 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:54.035115 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f9a16b77-bd78-4146-96ea-7baa5af6e943 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b41b531e9d7847039b37090d97aaf242'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:54.041713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f463afd-7182-40ea-9b7d-16d09cc06263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:54.042671 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f463afd-7182-40ea-9b7d-16d09cc06263 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:54.042950 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f463afd-7182-40ea-9b7d-16d09cc06263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:54.043229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f463afd-7182-40ea-9b7d-16d09cc06263 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:54.044260 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f463afd-7182-40ea-9b7d-16d09cc06263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:54.050483 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f463afd-7182-40ea-9b7d-16d09cc06263 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:54.059525 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 985/1966] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:27:53 2022] DELETE /identity/v3/users/b41b531e9d7847039b37090d97aaf242 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:54.060838 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764db582-73d5-4422-83e0-6fc3e947d918 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:54.061120 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764db582-73d5-4422-83e0-6fc3e947d918 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:54.061393 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764db582-73d5-4422-83e0-6fc3e947d918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:54.063788 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 982/1967] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:54.065384 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f463afd-7182-40ea-9b7d-16d09cc06263 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:54.067873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-1f463afd-7182-40ea-9b7d-16d09cc06263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:54.082447 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f463afd-7182-40ea-9b7d-16d09cc06263 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:54.106370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-764db582-73d5-4422-83e0-6fc3e947d918 None None] MFA Rules not processed for user `55b4e818df334c8ca344ddb8e7f40237`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:54.108100 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-764db582-73d5-4422-83e0-6fc3e947d918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:54.193918 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf053d0-a5dc-4ab3-9193-a1fe530fbe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:54.194760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf053d0-a5dc-4ab3-9193-a1fe530fbe63 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:54.195570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf053d0-a5dc-4ab3-9193-a1fe530fbe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:54.195570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf053d0-a5dc-4ab3-9193-a1fe530fbe63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:54.196158 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf053d0-a5dc-4ab3-9193-a1fe530fbe63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:54.200101 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf053d0-a5dc-4ab3-9193-a1fe530fbe63 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:54.257793 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 986/1968] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:54.260420 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1278b-e037-426b-ac26-2f37c564f7b7 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:54.261157 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1278b-e037-426b-ac26-2f37c564f7b7 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:54.261860 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1278b-e037-426b-ac26-2f37c564f7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:54.298518 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-10d1278b-e037-426b-ac26-2f37c564f7b7 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:54.300607 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-10d1278b-e037-426b-ac26-2f37c564f7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:54.315874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 987/1969] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:54.324265 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1278b-e037-426b-ac26-2f37c564f7b7 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:54.329073 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-10d1278b-e037-426b-ac26-2f37c564f7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:54.336663 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 983/1970] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:54 2022] POST /identity/v3/projects => generated 383 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:54.338162 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf053d0-a5dc-4ab3-9193-a1fe530fbe63 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:54.363981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-daf053d0-a5dc-4ab3-9193-a1fe530fbe63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:54.369743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1278b-e037-426b-ac26-2f37c564f7b7 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:54.463773 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb37b9-43df-47ff-9f87-eb77d93b4495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:54.464493 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb37b9-43df-47ff-9f87-eb77d93b4495 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:54.465286 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb37b9-43df-47ff-9f87-eb77d93b4495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:54.465632 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb37b9-43df-47ff-9f87-eb77d93b4495 admin admin] PATH_INFO: `/v3/projects/c9a545f03e8749eab32cecbb868b6532/users/4f0086646bea4a33bd1155bfb0ae97cd/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:54.469773 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb37b9-43df-47ff-9f87-eb77d93b4495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9a545f03e8749eab32cecbb868b6532, user_id=4f0086646bea4a33bd1155bfb0ae97cd, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:54.470972 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf053d0-a5dc-4ab3-9193-a1fe530fbe63 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:54.476288 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb37b9-43df-47ff-9f87-eb77d93b4495 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:54.477485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b387fbe-0536-4d9f-b2f0-ef0af45bc6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:54.478186 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b387fbe-0536-4d9f-b2f0-ef0af45bc6cd admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:54.478641 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b387fbe-0536-4d9f-b2f0-ef0af45bc6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:54.478995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b387fbe-0536-4d9f-b2f0-ef0af45bc6cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:54.479846 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b387fbe-0536-4d9f-b2f0-ef0af45bc6cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:54.481888 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b387fbe-0536-4d9f-b2f0-ef0af45bc6cd admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:54.486763 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 988/1971] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:54 2022] PUT /identity/v3/projects/c9a545f03e8749eab32cecbb868b6532/users/4f0086646bea4a33bd1155bfb0ae97cd/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:54.496257 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb37b9-43df-47ff-9f87-eb77d93b4495 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:54.499277 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-46cb37b9-43df-47ff-9f87-eb77d93b4495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:54.569693 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb37b9-43df-47ff-9f87-eb77d93b4495 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:54.573004 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45f6a9-b10a-460d-b415-0a840ff70a46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:54.573989 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45f6a9-b10a-460d-b415-0a840ff70a46 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:54.574276 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45f6a9-b10a-460d-b415-0a840ff70a46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:54.574577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45f6a9-b10a-460d-b415-0a840ff70a46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:54.602838 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 984/1972] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:54 2022] POST /identity/v3/projects => generated 387 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:54.607072 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b387fbe-0536-4d9f-b2f0-ef0af45bc6cd admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:54.663972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45f6a9-b10a-460d-b415-0a840ff70a46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:54.665562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45f6a9-b10a-460d-b415-0a840ff70a46 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:54.677376 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 989/1973] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:54.679205 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6b294-6d7d-438b-987d-43148a81b9d6 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:54.695880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6b294-6d7d-438b-987d-43148a81b9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:54.695880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6b294-6d7d-438b-987d-43148a81b9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:54.698305 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b387fbe-0536-4d9f-b2f0-ef0af45bc6cd admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:54.704143 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716ff38-08c6-4d19-9efe-fd209c3b8117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:54.704854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716ff38-08c6-4d19-9efe-fd209c3b8117 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:54.705248 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716ff38-08c6-4d19-9efe-fd209c3b8117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:54.705407 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716ff38-08c6-4d19-9efe-fd209c3b8117 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:54.706315 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716ff38-08c6-4d19-9efe-fd209c3b8117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:54.709129 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716ff38-08c6-4d19-9efe-fd209c3b8117 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:54.728470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-3aa6b294-6d7d-438b-987d-43148a81b9d6 None None] MFA Rules not processed for user `4f0086646bea4a33bd1155bfb0ae97cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:54.728470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-3aa6b294-6d7d-438b-987d-43148a81b9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:54.781498 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:54.825758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 990/1974] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:54.826810 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6b294-6d7d-438b-987d-43148a81b9d6 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:54.841999 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6b294-6d7d-438b-987d-43148a81b9d6 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:54.848030 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03282db-5eb3-492d-b651-e57987b49c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:54.849495 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03282db-5eb3-492d-b651-e57987b49c22 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:54.849495 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03282db-5eb3-492d-b651-e57987b49c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:54.849495 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03282db-5eb3-492d-b651-e57987b49c22 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:54.850475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03282db-5eb3-492d-b651-e57987b49c22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:54.852330 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03282db-5eb3-492d-b651-e57987b49c22 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:54.858051 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 985/1975] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:54 2022] POST /identity/v3/users => generated 298 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:54.858051 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716ff38-08c6-4d19-9efe-fd209c3b8117 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:54.859961 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-0716ff38-08c6-4d19-9efe-fd209c3b8117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:54.942065 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716ff38-08c6-4d19-9efe-fd209c3b8117 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:54.951936 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3756fb-1fa1-4af0-a157-727ebaba084c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:54.952767 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3756fb-1fa1-4af0-a157-727ebaba084c service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:54.953144 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3756fb-1fa1-4af0-a157-727ebaba084c service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:54.953740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3756fb-1fa1-4af0-a157-727ebaba084c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:54.956513 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-6e3756fb-1fa1-4af0-a157-727ebaba084c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:55.007467 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 991/1976] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:54 2022] POST /identity/v3/users => generated 300 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:55.008990 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03282db-5eb3-492d-b651-e57987b49c22 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:55.020050 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03282db-5eb3-492d-b651-e57987b49c22 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:55.046558 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8be81a-62df-4f12-97af-af30a44bed21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:55.048222 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8be81a-62df-4f12-97af-af30a44bed21 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:55.048724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8be81a-62df-4f12-97af-af30a44bed21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:55.049430 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8be81a-62df-4f12-97af-af30a44bed21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:55.050238 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8be81a-62df-4f12-97af-af30a44bed21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:55.055933 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8be81a-62df-4f12-97af-af30a44bed21 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:55.066011 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3756fb-1fa1-4af0-a157-727ebaba084c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:55.067933 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3756fb-1fa1-4af0-a157-727ebaba084c service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:55.078918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 992/1977] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:55.080408 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8be81a-62df-4f12-97af-af30a44bed21 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:55.093960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8be81a-62df-4f12-97af-af30a44bed21 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:55.096982 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 986/1978] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:55.098157 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3756fb-1fa1-4af0-a157-727ebaba084c service cinder] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:55.102809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c7075-301a-4cfc-a8c9-088f5df8c948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:55.102809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c7075-301a-4cfc-a8c9-088f5df8c948 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:55.103464 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c7075-301a-4cfc-a8c9-088f5df8c948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:55.103893 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c7075-301a-4cfc-a8c9-088f5df8c948 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:55.104587 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-6e3756fb-1fa1-4af0-a157-727ebaba084c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:55.104895 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c7075-301a-4cfc-a8c9-088f5df8c948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:55.107188 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c7075-301a-4cfc-a8c9-088f5df8c948 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:55.125653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 993/1979] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:55.130476 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c7075-301a-4cfc-a8c9-088f5df8c948 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:55.144318 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c7075-301a-4cfc-a8c9-088f5df8c948 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:55.153706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007acbc-99a9-4923-bac8-9cf3367e11c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:55.154658 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007acbc-99a9-4923-bac8-9cf3367e11c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:55.155111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007acbc-99a9-4923-bac8-9cf3367e11c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:55.156019 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007acbc-99a9-4923-bac8-9cf3367e11c8 admin admin] PATH_INFO: `/v3/projects/22e5a4d483174e4aae6912da2e51a72c/users/1a2f297d928c4afa9f69814426c6bbdc/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:55.158951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3756fb-1fa1-4af0-a157-727ebaba084c service cinder] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:55.164992 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469bada-d6cb-4b0d-84eb-e528f229a92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:55.165662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469bada-d6cb-4b0d-84eb-e528f229a92e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:55.166053 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469bada-d6cb-4b0d-84eb-e528f229a92e admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:55.166702 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469bada-d6cb-4b0d-84eb-e528f229a92e admin admin] PATH_INFO: `/v3/users/6916cce0d810441dadb1448281b5d78b` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:55.167999 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469bada-d6cb-4b0d-84eb-e528f229a92e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6916cce0d810441dadb1448281b5d78b)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:55.170413 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469bada-d6cb-4b0d-84eb-e528f229a92e admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:55.221846 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007acbc-99a9-4923-bac8-9cf3367e11c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22e5a4d483174e4aae6912da2e51a72c, user_id=1a2f297d928c4afa9f69814426c6bbdc, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:55.228121 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007acbc-99a9-4923-bac8-9cf3367e11c8 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:55.320325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 994/1980] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:55 2022] PUT /identity/v3/projects/22e5a4d483174e4aae6912da2e51a72c/users/1a2f297d928c4afa9f69814426c6bbdc/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:55.322256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007acbc-99a9-4923-bac8-9cf3367e11c8 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:55.405527 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-8469bada-d6cb-4b0d-84eb-e528f229a92e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6916cce0d810441dadb1448281b5d78b'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:55.484458 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007acbc-99a9-4923-bac8-9cf3367e11c8 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:55.489899 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7ab0d-9289-4e47-a3c5-1cb96eb18664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:55.490842 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7ab0d-9289-4e47-a3c5-1cb96eb18664 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:55.491284 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7ab0d-9289-4e47-a3c5-1cb96eb18664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:55.491613 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7ab0d-9289-4e47-a3c5-1cb96eb18664 admin admin] PATH_INFO: `/v3/projects/05711d4a883d4c509863d73daa90191b/users/a9c570fc083843d489edc4a2c0dfca69/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:55.499077 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:55.510533 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7ab0d-9289-4e47-a3c5-1cb96eb18664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05711d4a883d4c509863d73daa90191b, user_id=a9c570fc083843d489edc4a2c0dfca69, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:55.513510 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7ab0d-9289-4e47-a3c5-1cb96eb18664 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:55.566648 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-8469bada-d6cb-4b0d-84eb-e528f229a92e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6916cce0d810441dadb1448281b5d78b'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:55.567598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-8469bada-d6cb-4b0d-84eb-e528f229a92e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6916cce0d810441dadb1448281b5d78b'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:55.568367 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-8469bada-d6cb-4b0d-84eb-e528f229a92e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6916cce0d810441dadb1448281b5d78b'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:55.577185 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-8469bada-d6cb-4b0d-84eb-e528f229a92e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6916cce0d810441dadb1448281b5d78b'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:55.598394 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 987/1981] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:27:55 2022] DELETE /identity/v3/users/6916cce0d810441dadb1448281b5d78b => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:55.599022 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469bada-d6cb-4b0d-84eb-e528f229a92e admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:55.601237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-8469bada-d6cb-4b0d-84eb-e528f229a92e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:55.626023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 995/1982] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:55 2022] PUT /identity/v3/projects/05711d4a883d4c509863d73daa90191b/users/a9c570fc083843d489edc4a2c0dfca69/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:55.627394 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fab75-0771-46fc-a0f5-de9f0e4be242 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:55.627716 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fab75-0771-46fc-a0f5-de9f0e4be242 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:55.628108 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fab75-0771-46fc-a0f5-de9f0e4be242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:55.657456 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-974fab75-0771-46fc-a0f5-de9f0e4be242 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:55.657456 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-974fab75-0771-46fc-a0f5-de9f0e4be242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:55.711371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469bada-d6cb-4b0d-84eb-e528f229a92e admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:55.801879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60844523-4ac5-4f48-9b8a-49ad2a9c49b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:55.802691 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60844523-4ac5-4f48-9b8a-49ad2a9c49b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:55.803064 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60844523-4ac5-4f48-9b8a-49ad2a9c49b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:55.803420 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60844523-4ac5-4f48-9b8a-49ad2a9c49b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:55.804212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60844523-4ac5-4f48-9b8a-49ad2a9c49b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:55.810101 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60844523-4ac5-4f48-9b8a-49ad2a9c49b9 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:55.812180 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 996/1983] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:55.815887 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fab75-0771-46fc-a0f5-de9f0e4be242 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:55.817873 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-974fab75-0771-46fc-a0f5-de9f0e4be242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:55.825508 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 988/1984] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:55.825508 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60844523-4ac5-4f48-9b8a-49ad2a9c49b9 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:55.827126 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-60844523-4ac5-4f48-9b8a-49ad2a9c49b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:55.846994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60844523-4ac5-4f48-9b8a-49ad2a9c49b9 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:55.859367 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e27bd-b44c-4bed-b896-c0061b172d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:55.859367 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e27bd-b44c-4bed-b896-c0061b172d45 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:55.859865 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e27bd-b44c-4bed-b896-c0061b172d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:55.860032 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e27bd-b44c-4bed-b896-c0061b172d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:55.860570 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fab75-0771-46fc-a0f5-de9f0e4be242 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:55.860810 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e27bd-b44c-4bed-b896-c0061b172d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:55.862439 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e27bd-b44c-4bed-b896-c0061b172d45 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:55.866136 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08e56f-16db-4cd4-a3c2-cff476eb7d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:55.867120 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08e56f-16db-4cd4-a3c2-cff476eb7d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:55.867308 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08e56f-16db-4cd4-a3c2-cff476eb7d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:55.867645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08e56f-16db-4cd4-a3c2-cff476eb7d18 admin admin] PATH_INFO: `/v3/projects/4e2138b2720b4818a60a6b189ffe6ab2` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:55.869866 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca08e56f-16db-4cd4-a3c2-cff476eb7d18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e2138b2720b4818a60a6b189ffe6ab2)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:55.872613 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca08e56f-16db-4cd4-a3c2-cff476eb7d18 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:55.893881 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 989/1985] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:55.897400 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e27bd-b44c-4bed-b896-c0061b172d45 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:55.920572 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e27bd-b44c-4bed-b896-c0061b172d45 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:55.934152 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acebc72-a335-4297-9f12-c3bfb0a8ba27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:55.936766 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acebc72-a335-4297-9f12-c3bfb0a8ba27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:55.941313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acebc72-a335-4297-9f12-c3bfb0a8ba27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:55.941313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acebc72-a335-4297-9f12-c3bfb0a8ba27 admin admin] PATH_INFO: `/v3/projects/22e5a4d483174e4aae6912da2e51a72c/users/1a2f297d928c4afa9f69814426c6bbdc/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:55.944453 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acebc72-a335-4297-9f12-c3bfb0a8ba27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22e5a4d483174e4aae6912da2e51a72c, user_id=1a2f297d928c4afa9f69814426c6bbdc, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:55.948744 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acebc72-a335-4297-9f12-c3bfb0a8ba27 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:55.999708 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 990/1986] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:55 2022] PUT /identity/v3/projects/22e5a4d483174e4aae6912da2e51a72c/users/1a2f297d928c4afa9f69814426c6bbdc/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:56.009653 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acebc72-a335-4297-9f12-c3bfb0a8ba27 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:56.009653 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-7acebc72-a335-4297-9f12-c3bfb0a8ba27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:56.092447 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acebc72-a335-4297-9f12-c3bfb0a8ba27 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:56.112593 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c0beb-cc03-4dd9-99f7-c022fc44cce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:56.115312 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c0beb-cc03-4dd9-99f7-c022fc44cce3 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:56.118154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c0beb-cc03-4dd9-99f7-c022fc44cce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:56.119520 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c0beb-cc03-4dd9-99f7-c022fc44cce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:56.137010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-ca08e56f-16db-4cd4-a3c2-cff476eb7d18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e2138b2720b4818a60a6b189ffe6ab2', 'request_id': 'req-ca08e56f-16db-4cd4-a3c2-cff476eb7d18'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:56.153674 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-ca08e56f-16db-4cd4-a3c2-cff476eb7d18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e2138b2720b4818a60a6b189ffe6ab2', 'request_id': 'req-ca08e56f-16db-4cd4-a3c2-cff476eb7d18'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:56.257491 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c0beb-cc03-4dd9-99f7-c022fc44cce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:56.259108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c0beb-cc03-4dd9-99f7-c022fc44cce3 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:56.274109 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 991/1987] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:56.275062 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c0beb-cc03-4dd9-99f7-c022fc44cce3 service neutron] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:56.290659 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c0beb-cc03-4dd9-99f7-c022fc44cce3 service neutron] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:56.299048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-ca08e56f-16db-4cd4-a3c2-cff476eb7d18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e2138b2720b4818a60a6b189ffe6ab2', 'request_id': 'req-ca08e56f-16db-4cd4-a3c2-cff476eb7d18'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:56.319655 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-ca08e56f-16db-4cd4-a3c2-cff476eb7d18 admin admin] The token cache is being invalidate because project 4e2138b2720b4818a60a6b189ffe6ab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:27:56.319910 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-ca08e56f-16db-4cd4-a3c2-cff476eb7d18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:56.323519 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-ca08e56f-16db-4cd4-a3c2-cff476eb7d18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:56.331189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 997/1988] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:27:55 2022] DELETE /identity/v3/projects/4e2138b2720b4818a60a6b189ffe6ab2 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:56.340337 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171a378-f5bc-4138-91d2-e935a863ba99 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:56.343384 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171a378-f5bc-4138-91d2-e935a863ba99 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:56.344213 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171a378-f5bc-4138-91d2-e935a863ba99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:56.418029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-5171a378-f5bc-4138-91d2-e935a863ba99 None None] MFA Rules not processed for user `1a2f297d928c4afa9f69814426c6bbdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:56.420995 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-5171a378-f5bc-4138-91d2-e935a863ba99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:56.463619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb24ef-3a01-49c5-9552-6e2108bec8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:56.466419 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb24ef-3a01-49c5-9552-6e2108bec8ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:56.467043 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb24ef-3a01-49c5-9552-6e2108bec8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:56.468509 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb24ef-3a01-49c5-9552-6e2108bec8ab admin admin] PATH_INFO: `/v3/projects/05711d4a883d4c509863d73daa90191b/users/a9c570fc083843d489edc4a2c0dfca69/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:56.470840 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb24ef-3a01-49c5-9552-6e2108bec8ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=05711d4a883d4c509863d73daa90191b, user_id=a9c570fc083843d489edc4a2c0dfca69, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:56.474646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb24ef-3a01-49c5-9552-6e2108bec8ab admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:56.501420 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 992/1989] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:56 2022] PUT /identity/v3/projects/05711d4a883d4c509863d73daa90191b/users/a9c570fc083843d489edc4a2c0dfca69/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:56.502929 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb24ef-3a01-49c5-9552-6e2108bec8ab admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:56.508579 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-9fcb24ef-3a01-49c5-9552-6e2108bec8ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:56.588310 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 998/1990] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:56.589327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bba4e-92c7-4ca5-b2cf-fe657460233f None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:56.589512 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bba4e-92c7-4ca5-b2cf-fe657460233f None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:56.589920 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bba4e-92c7-4ca5-b2cf-fe657460233f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:56.638315 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-4e0bba4e-92c7-4ca5-b2cf-fe657460233f None None] MFA Rules not processed for user `a9c570fc083843d489edc4a2c0dfca69`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:56.641537 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-4e0bba4e-92c7-4ca5-b2cf-fe657460233f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:56.648823 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb24ef-3a01-49c5-9552-6e2108bec8ab admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:56.655588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69d5b8-77dc-49e6-a8a1-380c1dc62f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:56.655588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69d5b8-77dc-49e6-a8a1-380c1dc62f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:56.655588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69d5b8-77dc-49e6-a8a1-380c1dc62f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:56.655588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69d5b8-77dc-49e6-a8a1-380c1dc62f2f admin admin] PATH_INFO: `/v3/users/8844717050e845abab4e2e6d5de9b674` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:56.657349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69d5b8-77dc-49e6-a8a1-380c1dc62f2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8844717050e845abab4e2e6d5de9b674)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:56.659792 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69d5b8-77dc-49e6-a8a1-380c1dc62f2f admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:56.757171 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 999/1991] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:56 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:56.757171 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bba4e-92c7-4ca5-b2cf-fe657460233f None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:56.757171 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-4e0bba4e-92c7-4ca5-b2cf-fe657460233f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:56.832428 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bba4e-92c7-4ca5-b2cf-fe657460233f None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:56.837148 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bfa83-692d-4a97-a8a0-de00630f12a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:56.837870 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bfa83-692d-4a97-a8a0-de00630f12a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:56.838222 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bfa83-692d-4a97-a8a0-de00630f12a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:56.838625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bfa83-692d-4a97-a8a0-de00630f12a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:56.841130 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-0b8bfa83-692d-4a97-a8a0-de00630f12a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:56.915793 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bfa83-692d-4a97-a8a0-de00630f12a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:56.917537 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bfa83-692d-4a97-a8a0-de00630f12a7 service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:56.928770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:56.930055 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1000/1992] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:56.931028 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bfa83-692d-4a97-a8a0-de00630f12a7 service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:56.933279 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-0b8bfa83-692d-4a97-a8a0-de00630f12a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:56.947824 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bfa83-692d-4a97-a8a0-de00630f12a7 service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:56.951007 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9d69d5b8-77dc-49e6-a8a1-380c1dc62f2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8844717050e845abab4e2e6d5de9b674'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:56.953674 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94ce51-5655-441d-a6d5-5e7f5ef34eaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:56.954840 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94ce51-5655-441d-a6d5-5e7f5ef34eaa service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:56.955850 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94ce51-5655-441d-a6d5-5e7f5ef34eaa service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:56.956294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94ce51-5655-441d-a6d5-5e7f5ef34eaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:56.970913 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94ce51-5655-441d-a6d5-5e7f5ef34eaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:56.972803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94ce51-5655-441d-a6d5-5e7f5ef34eaa service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:56.995899 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1001/1993] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:56 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:57.030371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9d69d5b8-77dc-49e6-a8a1-380c1dc62f2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8844717050e845abab4e2e6d5de9b674'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:57.031670 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9d69d5b8-77dc-49e6-a8a1-380c1dc62f2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8844717050e845abab4e2e6d5de9b674'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:57.032356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9d69d5b8-77dc-49e6-a8a1-380c1dc62f2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8844717050e845abab4e2e6d5de9b674'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:57.041558 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94ce51-5655-441d-a6d5-5e7f5ef34eaa service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:57.042290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9d69d5b8-77dc-49e6-a8a1-380c1dc62f2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8844717050e845abab4e2e6d5de9b674'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:57.045260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-8c94ce51-5655-441d-a6d5-5e7f5ef34eaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:57.065925 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94ce51-5655-441d-a6d5-5e7f5ef34eaa service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:57.074161 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2d687-5e80-4844-941d-833343177302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:57.074954 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2d687-5e80-4844-941d-833343177302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:57.075161 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2d687-5e80-4844-941d-833343177302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:57.075417 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2d687-5e80-4844-941d-833343177302 admin admin] PATH_INFO: `/v3/projects/c37fe9564b874944a4d6e6dc669d1572` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:57.076708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2d687-5e80-4844-941d-833343177302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c37fe9564b874944a4d6e6dc669d1572)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:57.079425 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2d687-5e80-4844-941d-833343177302 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:57.080805 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 993/1994] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:27:56 2022] DELETE /identity/v3/users/8844717050e845abab4e2e6d5de9b674 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:57.310508 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-1ed2d687-5e80-4844-941d-833343177302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c37fe9564b874944a4d6e6dc669d1572', 'request_id': 'req-1ed2d687-5e80-4844-941d-833343177302'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:57.317543 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-1ed2d687-5e80-4844-941d-833343177302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c37fe9564b874944a4d6e6dc669d1572', 'request_id': 'req-1ed2d687-5e80-4844-941d-833343177302'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:57.414818 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-1ed2d687-5e80-4844-941d-833343177302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c37fe9564b874944a4d6e6dc669d1572', 'request_id': 'req-1ed2d687-5e80-4844-941d-833343177302'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:57.430776 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-1ed2d687-5e80-4844-941d-833343177302 admin admin] The token cache is being invalidate because project c37fe9564b874944a4d6e6dc669d1572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:27:57.432118 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-1ed2d687-5e80-4844-941d-833343177302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:57.434847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-1ed2d687-5e80-4844-941d-833343177302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:57.439538 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1002/1995] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:27:57 2022] DELETE /identity/v3/projects/c37fe9564b874944a4d6e6dc669d1572 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:57.443832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819bc32-1027-44f5-9828-3d0defee2cba None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:57.444146 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819bc32-1027-44f5-9828-3d0defee2cba None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:57.444631 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819bc32-1027-44f5-9828-3d0defee2cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:57.480413 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-3819bc32-1027-44f5-9828-3d0defee2cba None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:57.482155 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-3819bc32-1027-44f5-9828-3d0defee2cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:57.567662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 994/1996] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:57.571315 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955937df-7701-461d-bdf3-ccdb3fc6e871 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:57.571632 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955937df-7701-461d-bdf3-ccdb3fc6e871 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:57.572053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955937df-7701-461d-bdf3-ccdb3fc6e871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:57.596857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-955937df-7701-461d-bdf3-ccdb3fc6e871 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:57.598159 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-955937df-7701-461d-bdf3-ccdb3fc6e871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:57.607656 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1003/1997] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:57.612913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819bc32-1027-44f5-9828-3d0defee2cba None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:57.625149 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819bc32-1027-44f5-9828-3d0defee2cba None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:57.630242 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9531f6e-ba9a-49d5-898b-51f5d110f8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:57.630927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9531f6e-ba9a-49d5-898b-51f5d110f8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:57.637911 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9531f6e-ba9a-49d5-898b-51f5d110f8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:57.637911 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9531f6e-ba9a-49d5-898b-51f5d110f8b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:57.637911 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9531f6e-ba9a-49d5-898b-51f5d110f8b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:27:57.637911 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9531f6e-ba9a-49d5-898b-51f5d110f8b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:57.637911 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9531f6e-ba9a-49d5-898b-51f5d110f8b5 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:57.647405 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 995/1998] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:27:57.652283 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955937df-7701-461d-bdf3-ccdb3fc6e871 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:57.663182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955937df-7701-461d-bdf3-ccdb3fc6e871 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:57.667989 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260c227-3439-42e0-aec7-1363aec5bfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:57.668594 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260c227-3439-42e0-aec7-1363aec5bfc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:57.668869 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260c227-3439-42e0-aec7-1363aec5bfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:57.669139 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260c227-3439-42e0-aec7-1363aec5bfc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:57.669828 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260c227-3439-42e0-aec7-1363aec5bfc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:57.671908 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260c227-3439-42e0-aec7-1363aec5bfc9 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:57.707371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9531f6e-ba9a-49d5-898b-51f5d110f8b5 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:57.709909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-c9531f6e-ba9a-49d5-898b-51f5d110f8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:57.727019 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9531f6e-ba9a-49d5-898b-51f5d110f8b5 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:57.734084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e956a-534a-450c-8ba6-0e61e83a25fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:57.734782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e956a-534a-450c-8ba6-0e61e83a25fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:57.734982 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e956a-534a-450c-8ba6-0e61e83a25fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:57.735250 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e956a-534a-450c-8ba6-0e61e83a25fa admin admin] PATH_INFO: `/v3/projects/f4dfae19376043c3bc6e0fc32edb26f0` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:57.736413 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e956a-534a-450c-8ba6-0e61e83a25fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4dfae19376043c3bc6e0fc32edb26f0)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:57.738550 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e956a-534a-450c-8ba6-0e61e83a25fa admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:57.792979 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1004/1999] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:57 2022] POST /identity/v3/projects => generated 361 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:57.797215 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260c227-3439-42e0-aec7-1363aec5bfc9 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:57.862407 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260c227-3439-42e0-aec7-1363aec5bfc9 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:57.868664 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25146ef-eaeb-4f12-ad23-10ed9fff8ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:57.868860 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25146ef-eaeb-4f12-ad23-10ed9fff8ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:57.869119 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25146ef-eaeb-4f12-ad23-10ed9fff8ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:57.869315 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25146ef-eaeb-4f12-ad23-10ed9fff8ed4 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:57.870169 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25146ef-eaeb-4f12-ad23-10ed9fff8ed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:57.872087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25146ef-eaeb-4f12-ad23-10ed9fff8ed4 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:57.976059 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-0b8e956a-534a-450c-8ba6-0e61e83a25fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4dfae19376043c3bc6e0fc32edb26f0', 'request_id': 'req-0b8e956a-534a-450c-8ba6-0e61e83a25fa'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:57.983168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-0b8e956a-534a-450c-8ba6-0e61e83a25fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4dfae19376043c3bc6e0fc32edb26f0', 'request_id': 'req-0b8e956a-534a-450c-8ba6-0e61e83a25fa'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:58.013441 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1005/2000] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:57 2022] POST /identity/v3/users => generated 281 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:27:58.017558 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25146ef-eaeb-4f12-ad23-10ed9fff8ed4 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:58.029164 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25146ef-eaeb-4f12-ad23-10ed9fff8ed4 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:58.032387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:58.038277 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-0b8e956a-534a-450c-8ba6-0e61e83a25fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4dfae19376043c3bc6e0fc32edb26f0', 'request_id': 'req-0b8e956a-534a-450c-8ba6-0e61e83a25fa'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:58.064506 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-0b8e956a-534a-450c-8ba6-0e61e83a25fa admin admin] The token cache is being invalidate because project f4dfae19376043c3bc6e0fc32edb26f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:27:58.064506 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-0b8e956a-534a-450c-8ba6-0e61e83a25fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:58.064818 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-0b8e956a-534a-450c-8ba6-0e61e83a25fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:58.072659 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 996/2001] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:27:57 2022] DELETE /identity/v3/projects/f4dfae19376043c3bc6e0fc32edb26f0 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:58.075029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c592fcc-50fe-4278-b90c-10a8a6fc6a98 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:58.075511 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c592fcc-50fe-4278-b90c-10a8a6fc6a98 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:58.075936 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c592fcc-50fe-4278-b90c-10a8a6fc6a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:58.100167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-4c592fcc-50fe-4278-b90c-10a8a6fc6a98 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:58.101405 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-4c592fcc-50fe-4278-b90c-10a8a6fc6a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:58.109815 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7ca24-4cee-4c36-a2dc-9c8c7f12fe49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:58.111620 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7ca24-4cee-4c36-a2dc-9c8c7f12fe49 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:58.111987 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7ca24-4cee-4c36-a2dc-9c8c7f12fe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:58.112330 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7ca24-4cee-4c36-a2dc-9c8c7f12fe49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:58.113234 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7ca24-4cee-4c36-a2dc-9c8c7f12fe49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:58.115072 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7ca24-4cee-4c36-a2dc-9c8c7f12fe49 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:58.133261 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1006/2002] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:27:58.133261 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7ca24-4cee-4c36-a2dc-9c8c7f12fe49 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:58.134633 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f8b7ca24-4cee-4c36-a2dc-9c8c7f12fe49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:58.149315 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7ca24-4cee-4c36-a2dc-9c8c7f12fe49 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:58.154226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0ff47-ba9e-44c9-aebb-58e0674fa332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:58.154839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0ff47-ba9e-44c9-aebb-58e0674fa332 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:58.155128 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0ff47-ba9e-44c9-aebb-58e0674fa332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:58.155469 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0ff47-ba9e-44c9-aebb-58e0674fa332 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:58.156126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0ff47-ba9e-44c9-aebb-58e0674fa332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:58.157745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0ff47-ba9e-44c9-aebb-58e0674fa332 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:58.171886 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1007/2003] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:27:58.176531 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0ff47-ba9e-44c9-aebb-58e0674fa332 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:58.185684 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 997/2004] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:27:58.187044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0095b-7ce4-4471-ba25-960fb158b8e8 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:58.187837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0095b-7ce4-4471-ba25-960fb158b8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:58.187837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0095b-7ce4-4471-ba25-960fb158b8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:58.188932 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0ff47-ba9e-44c9-aebb-58e0674fa332 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:58.196090 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e3504-b11b-4685-b726-c54dca408cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:58.196958 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e3504-b11b-4685-b726-c54dca408cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:58.197223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e3504-b11b-4685-b726-c54dca408cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:58.197503 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e3504-b11b-4685-b726-c54dca408cf9 admin admin] PATH_INFO: `/v3/projects/1b56c551a7564ae0b239522a513a7520/users/4d4a6f12595845a59026f90aeaa6895e/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:58.210097 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-f3f0095b-7ce4-4471-ba25-960fb158b8e8 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:58.212574 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-f3f0095b-7ce4-4471-ba25-960fb158b8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:58.216904 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e3504-b11b-4685-b726-c54dca408cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b56c551a7564ae0b239522a513a7520, user_id=4d4a6f12595845a59026f90aeaa6895e, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:58.219755 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e3504-b11b-4685-b726-c54dca408cf9 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:58.226131 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 998/2005] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:58.230371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0095b-7ce4-4471-ba25-960fb158b8e8 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:58.240160 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0095b-7ce4-4471-ba25-960fb158b8e8 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:58.245300 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd39e4d-0cfa-431c-b651-a155f0f2722c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:58.246129 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd39e4d-0cfa-431c-b651-a155f0f2722c admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:58.246558 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd39e4d-0cfa-431c-b651-a155f0f2722c admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:58.246831 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd39e4d-0cfa-431c-b651-a155f0f2722c admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:58.247696 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd39e4d-0cfa-431c-b651-a155f0f2722c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:27:58.248023 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd39e4d-0cfa-431c-b651-a155f0f2722c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:58.249657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd39e4d-0cfa-431c-b651-a155f0f2722c admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:58.262275 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 999/2006] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:27:58.266785 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd39e4d-0cfa-431c-b651-a155f0f2722c admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:58.277489 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd39e4d-0cfa-431c-b651-a155f0f2722c admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:58.282289 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a7215-6a3a-4b8c-b37c-d78d3518fd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:58.282910 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a7215-6a3a-4b8c-b37c-d78d3518fd51 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:58.283185 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a7215-6a3a-4b8c-b37c-d78d3518fd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:58.283470 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a7215-6a3a-4b8c-b37c-d78d3518fd51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:58.284117 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a7215-6a3a-4b8c-b37c-d78d3518fd51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:58.286190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a7215-6a3a-4b8c-b37c-d78d3518fd51 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:58.321540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1008/2007] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:58 2022] PUT /identity/v3/projects/1b56c551a7564ae0b239522a513a7520/users/4d4a6f12595845a59026f90aeaa6895e/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:58.331711 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d38cf-780d-4ebc-8367-e76be2b62b85 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:58.331996 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d38cf-780d-4ebc-8367-e76be2b62b85 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:58.332271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d38cf-780d-4ebc-8367-e76be2b62b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:58.361280 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-623d38cf-780d-4ebc-8367-e76be2b62b85 None None] MFA Rules not processed for user `4d4a6f12595845a59026f90aeaa6895e`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:58.362507 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-623d38cf-780d-4ebc-8367-e76be2b62b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:58.424666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1000/2008] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:58 2022] POST /identity/v3/projects => generated 379 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:27:58.425629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a7215-6a3a-4b8c-b37c-d78d3518fd51 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:58.449699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1009/2009] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:27:58.511174 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d38cf-780d-4ebc-8367-e76be2b62b85 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:58.512730 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-623d38cf-780d-4ebc-8367-e76be2b62b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:58.540921 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a7215-6a3a-4b8c-b37c-d78d3518fd51 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:58.548822 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305592c-25b2-4383-a428-32ac782ae6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:58.549592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305592c-25b2-4383-a428-32ac782ae6d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:58.549973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305592c-25b2-4383-a428-32ac782ae6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:58.550346 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305592c-25b2-4383-a428-32ac782ae6d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:58.551090 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305592c-25b2-4383-a428-32ac782ae6d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:58.554154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305592c-25b2-4383-a428-32ac782ae6d6 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:58.592800 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d38cf-780d-4ebc-8367-e76be2b62b85 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:58.649659 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1001/2010] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:58 2022] POST /identity/v3/users => generated 290 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:27:58.653913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305592c-25b2-4383-a428-32ac782ae6d6 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:58.667413 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305592c-25b2-4383-a428-32ac782ae6d6 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:58.694997 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9bd70-a7f6-4b7d-921a-ab9821e34d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:58.695580 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00834e-d4ea-4f19-8c1b-485ba98f9f26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:58.695580 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00834e-d4ea-4f19-8c1b-485ba98f9f26 service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:58.695729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9bd70-a7f6-4b7d-921a-ab9821e34d23 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:58.695799 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00834e-d4ea-4f19-8c1b-485ba98f9f26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:58.695799 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00834e-d4ea-4f19-8c1b-485ba98f9f26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:58.695929 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9bd70-a7f6-4b7d-921a-ab9821e34d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:58.695929 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9bd70-a7f6-4b7d-921a-ab9821e34d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:58.695929 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9bd70-a7f6-4b7d-921a-ab9821e34d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:58.695929 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d9bd70-a7f6-4b7d-921a-ab9821e34d23 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:58.703566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1002/2011] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:58.710523 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9bd70-a7f6-4b7d-921a-ab9821e34d23 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:58.726506 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9bd70-a7f6-4b7d-921a-ab9821e34d23 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:58.730883 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:27:58.736530 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a9791-5b06-4da0-a084-66ea89220148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:58.737480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a9791-5b06-4da0-a084-66ea89220148 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:58.737969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a9791-5b06-4da0-a084-66ea89220148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:58.738491 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a9791-5b06-4da0-a084-66ea89220148 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:58.739586 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a9791-5b06-4da0-a084-66ea89220148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:58.742371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a9791-5b06-4da0-a084-66ea89220148 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:58.761235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1003/2012] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:27:58.762941 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a9791-5b06-4da0-a084-66ea89220148 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:58.777598 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00834e-d4ea-4f19-8c1b-485ba98f9f26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:58.778621 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a9791-5b06-4da0-a084-66ea89220148 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:58.780168 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00834e-d4ea-4f19-8c1b-485ba98f9f26 service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:58.792804 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3b202-8aa4-4275-a960-000ed7405a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:58.793679 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3b202-8aa4-4275-a960-000ed7405a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:58.794111 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3b202-8aa4-4275-a960-000ed7405a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:58.794581 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3b202-8aa4-4275-a960-000ed7405a33 admin admin] PATH_INFO: `/v3/projects/6e83a468349f48a397a385f3ec241bdb/users/c195aa44405b41459119835210d82d59/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:58.799244 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1010/2013] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:58.800282 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00834e-d4ea-4f19-8c1b-485ba98f9f26 service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:58.801936 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-0f00834e-d4ea-4f19-8c1b-485ba98f9f26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:58.818057 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3b202-8aa4-4275-a960-000ed7405a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e83a468349f48a397a385f3ec241bdb, user_id=c195aa44405b41459119835210d82d59, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:58.821621 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3b202-8aa4-4275-a960-000ed7405a33 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:58.828617 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00834e-d4ea-4f19-8c1b-485ba98f9f26 service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:58.834865 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff217b4-4332-4e3d-a270-a6e4a1b9b627 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:58.835797 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff217b4-4332-4e3d-a270-a6e4a1b9b627 service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:58.836181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff217b4-4332-4e3d-a270-a6e4a1b9b627 service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:58.839705 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff217b4-4332-4e3d-a270-a6e4a1b9b627 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:58.840316 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-eff217b4-4332-4e3d-a270-a6e4a1b9b627 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:58.919659 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1004/2014] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:58 2022] PUT /identity/v3/projects/6e83a468349f48a397a385f3ec241bdb/users/c195aa44405b41459119835210d82d59/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:27:58.919659 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3b202-8aa4-4275-a960-000ed7405a33 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:58.930536 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff217b4-4332-4e3d-a270-a6e4a1b9b627 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:58.932019 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff217b4-4332-4e3d-a270-a6e4a1b9b627 service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:58.942547 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1011/2015] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:58.943129 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff217b4-4332-4e3d-a270-a6e4a1b9b627 service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:58.952071 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff217b4-4332-4e3d-a270-a6e4a1b9b627 service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:58.987671 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3b202-8aa4-4275-a960-000ed7405a33 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:58.997205 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49eff6-b60f-4e7a-a05a-d494fbf4ae9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:58.998394 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49eff6-b60f-4e7a-a05a-d494fbf4ae9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:58.998863 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49eff6-b60f-4e7a-a05a-d494fbf4ae9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:58.999260 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49eff6-b60f-4e7a-a05a-d494fbf4ae9b admin admin] PATH_INFO: `/v3/users/4d4a6f12595845a59026f90aeaa6895e` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:59.004558 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49eff6-b60f-4e7a-a05a-d494fbf4ae9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d4a6f12595845a59026f90aeaa6895e)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:59.007073 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49eff6-b60f-4e7a-a05a-d494fbf4ae9b admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:59.021654 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d596e1-c174-446a-87d1-c3e5f542dd60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:59.022468 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d596e1-c174-446a-87d1-c3e5f542dd60 service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:59.022876 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d596e1-c174-446a-87d1-c3e5f542dd60 service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:59.023250 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d596e1-c174-446a-87d1-c3e5f542dd60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:59.025527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-93d596e1-c174-446a-87d1-c3e5f542dd60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:59.096281 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d596e1-c174-446a-87d1-c3e5f542dd60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:59.097718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d596e1-c174-446a-87d1-c3e5f542dd60 service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:59.107910 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1012/2016] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:27:59.109332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed70b8-9b6d-48da-8083-f5ad4c1d95e7 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:59.109618 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed70b8-9b6d-48da-8083-f5ad4c1d95e7 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:59.109986 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed70b8-9b6d-48da-8083-f5ad4c1d95e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:59.143136 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-e9ed70b8-9b6d-48da-8083-f5ad4c1d95e7 None None] MFA Rules not processed for user `c195aa44405b41459119835210d82d59`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:59.144708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-e9ed70b8-9b6d-48da-8083-f5ad4c1d95e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:59.214881 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1013/2017] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:59.219373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed70b8-9b6d-48da-8083-f5ad4c1d95e7 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:59.230993 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed70b8-9b6d-48da-8083-f5ad4c1d95e7 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:59.235630 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c14da7-7aa3-4054-9579-8f4f91d5ecb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:59.236243 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c14da7-7aa3-4054-9579-8f4f91d5ecb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:59.236519 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c14da7-7aa3-4054-9579-8f4f91d5ecb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:59.236789 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c14da7-7aa3-4054-9579-8f4f91d5ecb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:59.237417 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c14da7-7aa3-4054-9579-8f4f91d5ecb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:59.239352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c14da7-7aa3-4054-9579-8f4f91d5ecb4 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:59.269346 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1b49eff6-b60f-4e7a-a05a-d494fbf4ae9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d4a6f12595845a59026f90aeaa6895e'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:59.356485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1b49eff6-b60f-4e7a-a05a-d494fbf4ae9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d4a6f12595845a59026f90aeaa6895e'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:59.357184 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1b49eff6-b60f-4e7a-a05a-d494fbf4ae9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d4a6f12595845a59026f90aeaa6895e'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:59.357851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1b49eff6-b60f-4e7a-a05a-d494fbf4ae9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d4a6f12595845a59026f90aeaa6895e'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:59.359986 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1014/2018] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:27:59 2022] POST /identity/v3/projects => generated 381 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:27:59.366155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c14da7-7aa3-4054-9579-8f4f91d5ecb4 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:59.368276 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-b5c14da7-7aa3-4054-9579-8f4f91d5ecb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:59.368630 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1b49eff6-b60f-4e7a-a05a-d494fbf4ae9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d4a6f12595845a59026f90aeaa6895e'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:27:59.408871 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1005/2019] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:27:58 2022] DELETE /identity/v3/users/4d4a6f12595845a59026f90aeaa6895e => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:27:59.410931 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9636de-aff4-4c30-8a43-ad26c388ad3f None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:59.411533 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9636de-aff4-4c30-8a43-ad26c388ad3f None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:59.412023 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9636de-aff4-4c30-8a43-ad26c388ad3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:59.438883 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-ca9636de-aff4-4c30-8a43-ad26c388ad3f None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:27:59.441316 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ca9636de-aff4-4c30-8a43-ad26c388ad3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:59.456185 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c14da7-7aa3-4054-9579-8f4f91d5ecb4 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:59.541110 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1006/2020] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:27:59.554660 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9636de-aff4-4c30-8a43-ad26c388ad3f None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:59.554848 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b859421-fd7a-4f26-978b-d29095fbb228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:59.555402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b859421-fd7a-4f26-978b-d29095fbb228 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:59.555714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b859421-fd7a-4f26-978b-d29095fbb228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:59.556133 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b859421-fd7a-4f26-978b-d29095fbb228 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:59.556275 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ca9636de-aff4-4c30-8a43-ad26c388ad3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:27:59.557199 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b859421-fd7a-4f26-978b-d29095fbb228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:59.559583 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b859421-fd7a-4f26-978b-d29095fbb228 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:59.617855 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9636de-aff4-4c30-8a43-ad26c388ad3f None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:59.621628 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1f862-c8ff-4e01-8b02-1ef57dd9cf8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:59.622290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1f862-c8ff-4e01-8b02-1ef57dd9cf8c service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:59.622565 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1f862-c8ff-4e01-8b02-1ef57dd9cf8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:59.622831 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1f862-c8ff-4e01-8b02-1ef57dd9cf8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:59.634455 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1f862-c8ff-4e01-8b02-1ef57dd9cf8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:59.636690 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1f862-c8ff-4e01-8b02-1ef57dd9cf8c service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:59.650577 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1007/2021] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:27:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:27:59.738675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1015/2022] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:27:59 2022] POST /identity/v3/users => generated 297 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:27:59.743484 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1f862-c8ff-4e01-8b02-1ef57dd9cf8c service neutron] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:59.754284 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1f862-c8ff-4e01-8b02-1ef57dd9cf8c service neutron] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:59.764224 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8ce23-6331-400b-888d-984f4545939b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:59.764850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8ce23-6331-400b-888d-984f4545939b admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:59.765299 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8ce23-6331-400b-888d-984f4545939b admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:59.765576 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8ce23-6331-400b-888d-984f4545939b admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:59.766420 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8ce23-6331-400b-888d-984f4545939b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:59.768173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8ce23-6331-400b-888d-984f4545939b admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:27:59.803238 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1008/2023] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:27:59.807482 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b859421-fd7a-4f26-978b-d29095fbb228 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:27:59.819896 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b859421-fd7a-4f26-978b-d29095fbb228 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:27:59.825106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc4575-e1df-4ec9-a64c-9cfec6f893ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:27:59.825944 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc4575-e1df-4ec9-a64c-9cfec6f893ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:27:59.826561 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc4575-e1df-4ec9-a64c-9cfec6f893ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:27:59.826938 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc4575-e1df-4ec9-a64c-9cfec6f893ed admin admin] PATH_INFO: `/v3/projects/8c725cd8954a47a9a5263ccd49bbac11/users/ded2d677cbb34445ae4a6109ee35e140/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:27:59.862470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc4575-e1df-4ec9-a64c-9cfec6f893ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c725cd8954a47a9a5263ccd49bbac11, user_id=ded2d677cbb34445ae4a6109ee35e140, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:27:59.868240 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc4575-e1df-4ec9-a64c-9cfec6f893ed admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:00.025091 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1016/2024] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:27:59 2022] PUT /identity/v3/projects/8c725cd8954a47a9a5263ccd49bbac11/users/ded2d677cbb34445ae4a6109ee35e140/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:00.029705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8ce23-6331-400b-888d-984f4545939b admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:00.048037 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8ce23-6331-400b-888d-984f4545939b admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:00.153073 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbb0ae-720d-42d1-b109-a93056d0c4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:00.154361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbb0ae-720d-42d1-b109-a93056d0c4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:00.154644 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbb0ae-720d-42d1-b109-a93056d0c4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:00.154982 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbb0ae-720d-42d1-b109-a93056d0c4f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:00.155677 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbb0ae-720d-42d1-b109-a93056d0c4f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:00.157491 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbb0ae-720d-42d1-b109-a93056d0c4f1 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:00.181065 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1009/2025] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:00.185360 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc4575-e1df-4ec9-a64c-9cfec6f893ed admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:00.197304 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc4575-e1df-4ec9-a64c-9cfec6f893ed admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:00.202983 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae45b2-26ed-4ba4-b395-2cb1d8a72626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:00.203853 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae45b2-26ed-4ba4-b395-2cb1d8a72626 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:00.204251 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae45b2-26ed-4ba4-b395-2cb1d8a72626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:00.205684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae45b2-26ed-4ba4-b395-2cb1d8a72626 admin admin] PATH_INFO: `/v3/projects/8c725cd8954a47a9a5263ccd49bbac11/users/ded2d677cbb34445ae4a6109ee35e140/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:00.207923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae45b2-26ed-4ba4-b395-2cb1d8a72626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c725cd8954a47a9a5263ccd49bbac11, user_id=ded2d677cbb34445ae4a6109ee35e140, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:00.211329 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae45b2-26ed-4ba4-b395-2cb1d8a72626 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:00.224458 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1017/2026] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:00 2022] PUT /identity/v3/projects/8c725cd8954a47a9a5263ccd49bbac11/users/ded2d677cbb34445ae4a6109ee35e140/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:00.225610 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:00.239306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b9f5e-f624-47c8-8629-623c1ff22dc5 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:00.241614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b9f5e-f624-47c8-8629-623c1ff22dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:00.241910 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b9f5e-f624-47c8-8629-623c1ff22dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:00.289177 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-e45b9f5e-f624-47c8-8629-623c1ff22dc5 None None] MFA Rules not processed for user `ded2d677cbb34445ae4a6109ee35e140`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:00.290753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-e45b9f5e-f624-47c8-8629-623c1ff22dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:00.338986 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:00.399648 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1010/2027] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:00 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:00.546634 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae45b2-26ed-4ba4-b395-2cb1d8a72626 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:00.546634 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-10ae45b2-26ed-4ba4-b395-2cb1d8a72626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:00.655685 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae45b2-26ed-4ba4-b395-2cb1d8a72626 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:00.667134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514ff5b-2dce-47a4-a815-d2ac1f2d2fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:00.667622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514ff5b-2dce-47a4-a815-d2ac1f2d2fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:00.667923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514ff5b-2dce-47a4-a815-d2ac1f2d2fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:00.668166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514ff5b-2dce-47a4-a815-d2ac1f2d2fc8 admin admin] PATH_INFO: `/v3/projects/1b56c551a7564ae0b239522a513a7520` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:00.669474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8514ff5b-2dce-47a4-a815-d2ac1f2d2fc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b56c551a7564ae0b239522a513a7520)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:00.671540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8514ff5b-2dce-47a4-a815-d2ac1f2d2fc8 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:00.947326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-8514ff5b-2dce-47a4-a815-d2ac1f2d2fc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b56c551a7564ae0b239522a513a7520', 'request_id': 'req-8514ff5b-2dce-47a4-a815-d2ac1f2d2fc8'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:00.953946 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-8514ff5b-2dce-47a4-a815-d2ac1f2d2fc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b56c551a7564ae0b239522a513a7520', 'request_id': 'req-8514ff5b-2dce-47a4-a815-d2ac1f2d2fc8'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:01.076170 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-8514ff5b-2dce-47a4-a815-d2ac1f2d2fc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b56c551a7564ae0b239522a513a7520', 'request_id': 'req-8514ff5b-2dce-47a4-a815-d2ac1f2d2fc8'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:01.090650 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-8514ff5b-2dce-47a4-a815-d2ac1f2d2fc8 admin admin] The token cache is being invalidate because project 1b56c551a7564ae0b239522a513a7520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:01.090934 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-8514ff5b-2dce-47a4-a815-d2ac1f2d2fc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:01.091663 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-8514ff5b-2dce-47a4-a815-d2ac1f2d2fc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:01.093724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1018/2028] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:00 2022] DELETE /identity/v3/projects/1b56c551a7564ae0b239522a513a7520 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:01.098864 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659e26c-afcf-43f1-afec-e5a1d2e9fa7b None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:01.099752 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659e26c-afcf-43f1-afec-e5a1d2e9fa7b None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:01.099752 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659e26c-afcf-43f1-afec-e5a1d2e9fa7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:01.128833 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-8659e26c-afcf-43f1-afec-e5a1d2e9fa7b None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:01.130122 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-8659e26c-afcf-43f1-afec-e5a1d2e9fa7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:01.208518 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1011/2029] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:01.217436 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1190c-5c31-48a7-983d-7cf0b1064b59 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:01.220098 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1190c-5c31-48a7-983d-7cf0b1064b59 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:01.220098 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1190c-5c31-48a7-983d-7cf0b1064b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:01.240442 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-a1e1190c-5c31-48a7-983d-7cf0b1064b59 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:01.244370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-a1e1190c-5c31-48a7-983d-7cf0b1064b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:01.256701 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1019/2030] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:01.261022 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659e26c-afcf-43f1-afec-e5a1d2e9fa7b None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:01.278349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659e26c-afcf-43f1-afec-e5a1d2e9fa7b None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:01.280399 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d0d0b-b767-4c20-91c5-9c9a460fb4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:01.281123 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d0d0b-b767-4c20-91c5-9c9a460fb4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:01.281544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d0d0b-b767-4c20-91c5-9c9a460fb4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:01.281864 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d0d0b-b767-4c20-91c5-9c9a460fb4e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:01.282611 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d0d0b-b767-4c20-91c5-9c9a460fb4e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:28:01.282989 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d0d0b-b767-4c20-91c5-9c9a460fb4e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:01.284810 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d0d0b-b767-4c20-91c5-9c9a460fb4e9 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:01.298378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1012/2031] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:28:01.303765 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1190c-5c31-48a7-983d-7cf0b1064b59 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:01.313986 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1190c-5c31-48a7-983d-7cf0b1064b59 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:01.321275 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c4ecd-d641-43ac-b151-ff817da21743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:01.322012 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c4ecd-d641-43ac-b151-ff817da21743 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:01.322532 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c4ecd-d641-43ac-b151-ff817da21743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:01.322641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c4ecd-d641-43ac-b151-ff817da21743 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:01.323245 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c4ecd-d641-43ac-b151-ff817da21743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:01.325638 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c4ecd-d641-43ac-b151-ff817da21743 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:01.450550 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1020/2032] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:28:01 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:01.454963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d0d0b-b767-4c20-91c5-9c9a460fb4e9 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:01.466756 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d0d0b-b767-4c20-91c5-9c9a460fb4e9 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:01.539693 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03105947-3c39-4dba-8e02-acf092554105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:01.540318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03105947-3c39-4dba-8e02-acf092554105 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:01.540734 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03105947-3c39-4dba-8e02-acf092554105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:01.540937 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03105947-3c39-4dba-8e02-acf092554105 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:01.541544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03105947-3c39-4dba-8e02-acf092554105 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:01.544022 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03105947-3c39-4dba-8e02-acf092554105 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:01.578132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c4ecd-d641-43ac-b151-ff817da21743 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:01.580058 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f53c4ecd-d641-43ac-b151-ff817da21743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:01.629320 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1013/2033] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:28:01 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:01.633986 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03105947-3c39-4dba-8e02-acf092554105 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:01.642204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c4ecd-d641-43ac-b151-ff817da21743 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:01.644597 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03105947-3c39-4dba-8e02-acf092554105 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:01.646441 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6c1c7-691c-4290-8a30-99fc015f7488 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:01.647323 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6c1c7-691c-4290-8a30-99fc015f7488 service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:01.647641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6c1c7-691c-4290-8a30-99fc015f7488 service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:01.647919 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6c1c7-691c-4290-8a30-99fc015f7488 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:01.650809 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f1654-806f-416c-8cfd-44dfd8864f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:01.650960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-9af6c1c7-691c-4290-8a30-99fc015f7488 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:01.651057 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f1654-806f-416c-8cfd-44dfd8864f2c admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:01.651057 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f1654-806f-416c-8cfd-44dfd8864f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:01.651057 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f1654-806f-416c-8cfd-44dfd8864f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:01.651293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f1654-806f-416c-8cfd-44dfd8864f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:01.652915 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f1654-806f-416c-8cfd-44dfd8864f2c admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:01.668762 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1014/2034] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:28:01.670340 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f1654-806f-416c-8cfd-44dfd8864f2c admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:01.681719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f1654-806f-416c-8cfd-44dfd8864f2c admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:01.687598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e284d-d82c-42d0-930e-f45900913e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:01.688549 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e284d-d82c-42d0-930e-f45900913e2a admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:01.688833 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e284d-d82c-42d0-930e-f45900913e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:01.689232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e284d-d82c-42d0-930e-f45900913e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:01.689915 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e284d-d82c-42d0-930e-f45900913e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:01.691880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e284d-d82c-42d0-930e-f45900913e2a admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:01.703318 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1015/2035] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:01.708406 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e284d-d82c-42d0-930e-f45900913e2a admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:01.719682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e284d-d82c-42d0-930e-f45900913e2a admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:01.720037 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6c1c7-691c-4290-8a30-99fc015f7488 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:01.721494 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6c1c7-691c-4290-8a30-99fc015f7488 service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:01.724697 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b8781-a64a-4246-871c-d01f98692705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:01.725378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b8781-a64a-4246-871c-d01f98692705 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:01.725664 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b8781-a64a-4246-871c-d01f98692705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:01.725941 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b8781-a64a-4246-871c-d01f98692705 admin admin] PATH_INFO: `/v3/projects/19f06715a3794d6e8bc681787c92aca5/users/408014d04a6540bbb907a2b349fee229/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:01.732711 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1021/2036] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:28:01.743204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b8781-a64a-4246-871c-d01f98692705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f06715a3794d6e8bc681787c92aca5, user_id=408014d04a6540bbb907a2b349fee229, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:01.745985 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b8781-a64a-4246-871c-d01f98692705 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:01.897617 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1016/2037] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:01 2022] PUT /identity/v3/projects/19f06715a3794d6e8bc681787c92aca5/users/408014d04a6540bbb907a2b349fee229/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:01.910182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c92a4-560b-495c-835a-2d0825451bd4 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:01.910475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c92a4-560b-495c-835a-2d0825451bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:01.910854 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c92a4-560b-495c-835a-2d0825451bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:01.938971 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:01.945515 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-499c92a4-560b-495c-835a-2d0825451bd4 None None] MFA Rules not processed for user `408014d04a6540bbb907a2b349fee229`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:01.946771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-499c92a4-560b-495c-835a-2d0825451bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:02.041589 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1022/2038] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:02.049429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b8781-a64a-4246-871c-d01f98692705 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:02.157778 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b8781-a64a-4246-871c-d01f98692705 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:02.178286 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff103b6-c1c2-4733-9e74-bc34a7a8c560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:02.178928 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff103b6-c1c2-4733-9e74-bc34a7a8c560 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:02.179342 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff103b6-c1c2-4733-9e74-bc34a7a8c560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:02.179643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff103b6-c1c2-4733-9e74-bc34a7a8c560 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:02.180299 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff103b6-c1c2-4733-9e74-bc34a7a8c560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:02.182229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff103b6-c1c2-4733-9e74-bc34a7a8c560 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:02.330510 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1017/2039] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:28:02 2022] POST /identity/v3/projects => generated 375 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:02.335819 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c92a4-560b-495c-835a-2d0825451bd4 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:02.346726 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c92a4-560b-495c-835a-2d0825451bd4 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:02.428483 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa34146-1fa5-448f-a6be-3182761b6486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:02.429631 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa34146-1fa5-448f-a6be-3182761b6486 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:02.436123 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa34146-1fa5-448f-a6be-3182761b6486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:02.436123 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa34146-1fa5-448f-a6be-3182761b6486 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:02.436123 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa34146-1fa5-448f-a6be-3182761b6486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:02.436123 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa34146-1fa5-448f-a6be-3182761b6486 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:02.574016 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1023/2040] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:28:02 2022] POST /identity/v3/users => generated 294 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:02.578130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff103b6-c1c2-4733-9e74-bc34a7a8c560 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:02.589089 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff103b6-c1c2-4733-9e74-bc34a7a8c560 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:02.594209 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f2822-47f2-46b9-87f7-3178c4754cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:02.594807 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f2822-47f2-46b9-87f7-3178c4754cfa admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:02.595087 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f2822-47f2-46b9-87f7-3178c4754cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:02.595358 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f2822-47f2-46b9-87f7-3178c4754cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:02.596027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f2822-47f2-46b9-87f7-3178c4754cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:02.597653 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f2822-47f2-46b9-87f7-3178c4754cfa admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:02.609899 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1018/2041] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:28:02.614332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa34146-1fa5-448f-a6be-3182761b6486 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:02.624488 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa34146-1fa5-448f-a6be-3182761b6486 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:02.629326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d276e-8a19-4f8a-833d-7c7d10c4271f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:02.629999 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d276e-8a19-4f8a-833d-7c7d10c4271f admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:02.630329 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d276e-8a19-4f8a-833d-7c7d10c4271f admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:02.631261 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d276e-8a19-4f8a-833d-7c7d10c4271f admin admin] PATH_INFO: `/v3/projects/39c3cfab671d4cbcabb446628e3cfca3/users/9c700c53b05d43c3a852a01ff04d66e2/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:02.647767 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d276e-8a19-4f8a-833d-7c7d10c4271f admin admin] RBAC: Authorizing `identity:create_grant(project_id=39c3cfab671d4cbcabb446628e3cfca3, user_id=9c700c53b05d43c3a852a01ff04d66e2, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:02.650728 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d276e-8a19-4f8a-833d-7c7d10c4271f admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:02.664791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:02.790473 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1024/2042] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:02 2022] PUT /identity/v3/projects/39c3cfab671d4cbcabb446628e3cfca3/users/9c700c53b05d43c3a852a01ff04d66e2/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:02.794828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f2822-47f2-46b9-87f7-3178c4754cfa admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:02.805221 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f2822-47f2-46b9-87f7-3178c4754cfa admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:02.864062 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8252c2-4ca9-4bd8-98d7-b85ebf1426b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:02.864701 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8252c2-4ca9-4bd8-98d7-b85ebf1426b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:02.865015 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8252c2-4ca9-4bd8-98d7-b85ebf1426b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:02.865277 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8252c2-4ca9-4bd8-98d7-b85ebf1426b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:02.865915 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8252c2-4ca9-4bd8-98d7-b85ebf1426b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:02.867525 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8252c2-4ca9-4bd8-98d7-b85ebf1426b4 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:02.878008 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1019/2043] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:02.882633 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d276e-8a19-4f8a-833d-7c7d10c4271f admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:02.895250 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d276e-8a19-4f8a-833d-7c7d10c4271f admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:02.905034 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3078f-8a05-46e7-85e9-5131ba64d1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:02.905740 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3078f-8a05-46e7-85e9-5131ba64d1ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:02.906035 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3078f-8a05-46e7-85e9-5131ba64d1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:02.906466 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3078f-8a05-46e7-85e9-5131ba64d1ce admin admin] PATH_INFO: `/v3/projects/39c3cfab671d4cbcabb446628e3cfca3/users/9c700c53b05d43c3a852a01ff04d66e2/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:02.908483 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3078f-8a05-46e7-85e9-5131ba64d1ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=39c3cfab671d4cbcabb446628e3cfca3, user_id=9c700c53b05d43c3a852a01ff04d66e2, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:02.911128 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3078f-8a05-46e7-85e9-5131ba64d1ce admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:02.922000 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1025/2044] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:02 2022] PUT /identity/v3/projects/39c3cfab671d4cbcabb446628e3cfca3/users/9c700c53b05d43c3a852a01ff04d66e2/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:02.932852 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9ce2d-7969-4108-92c6-cd426b2d1deb None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:02.933131 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9ce2d-7969-4108-92c6-cd426b2d1deb None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:02.933405 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9ce2d-7969-4108-92c6-cd426b2d1deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:02.967542 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-78e9ce2d-7969-4108-92c6-cd426b2d1deb None None] MFA Rules not processed for user `9c700c53b05d43c3a852a01ff04d66e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:02.968789 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-78e9ce2d-7969-4108-92c6-cd426b2d1deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:03.037001 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:03.059873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1020/2045] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:03.071545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3078f-8a05-46e7-85e9-5131ba64d1ce admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:03.073443 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c1a3078f-8a05-46e7-85e9-5131ba64d1ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:03.134561 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3078f-8a05-46e7-85e9-5131ba64d1ce admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:03.139071 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158da8b-c853-4f4a-a661-de732da00bcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:03.139611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158da8b-c853-4f4a-a661-de732da00bcc service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:03.139884 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158da8b-c853-4f4a-a661-de732da00bcc service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:03.140154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158da8b-c853-4f4a-a661-de732da00bcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:03.213428 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158da8b-c853-4f4a-a661-de732da00bcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:03.215065 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158da8b-c853-4f4a-a661-de732da00bcc service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:03.225683 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1026/2046] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:28:03.532995 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:03.822358 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:04.338494 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:04.893582 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:05.280503 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:05.321301 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:05.813442 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:06.012962 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:06.578867 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:06.938640 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:07.030558 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9ce2d-7969-4108-92c6-cd426b2d1deb None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:07.048936 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9ce2d-7969-4108-92c6-cd426b2d1deb None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:07.065949 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605486d2-d27c-4e15-a613-f5ea9ca51b54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:07.067635 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605486d2-d27c-4e15-a613-f5ea9ca51b54 service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:07.068701 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605486d2-d27c-4e15-a613-f5ea9ca51b54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:07.070063 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605486d2-d27c-4e15-a613-f5ea9ca51b54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:07.071952 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-605486d2-d27c-4e15-a613-f5ea9ca51b54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:07.166585 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605486d2-d27c-4e15-a613-f5ea9ca51b54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:07.168116 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605486d2-d27c-4e15-a613-f5ea9ca51b54 service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:07.180035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1021/2047] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:07 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:28:07.213340 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158da8b-c853-4f4a-a661-de732da00bcc service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:07.222661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158da8b-c853-4f4a-a661-de732da00bcc service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:07.227645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c932e-7049-44b3-a76a-44636b988bb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:07.228473 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c932e-7049-44b3-a76a-44636b988bb1 service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:07.228914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c932e-7049-44b3-a76a-44636b988bb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:07.231913 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c932e-7049-44b3-a76a-44636b988bb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:07.231913 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-027c932e-7049-44b3-a76a-44636b988bb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:07.312742 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c932e-7049-44b3-a76a-44636b988bb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:07.314428 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c932e-7049-44b3-a76a-44636b988bb1 service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:07.325564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1027/2048] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:28:08.106257 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605486d2-d27c-4e15-a613-f5ea9ca51b54 service cinder] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:08.108098 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-605486d2-d27c-4e15-a613-f5ea9ca51b54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:08.112754 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:08.194672 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605486d2-d27c-4e15-a613-f5ea9ca51b54 service cinder] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:08.199296 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6704bf-b1c1-47a3-a769-1b71dcbf684c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:08.200105 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6704bf-b1c1-47a3-a769-1b71dcbf684c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:08.200387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6704bf-b1c1-47a3-a769-1b71dcbf684c admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:08.200663 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6704bf-b1c1-47a3-a769-1b71dcbf684c admin admin] PATH_INFO: `/v3/users/fcccc574db484acd9dec6da8725bd905` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:08.201870 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6704bf-b1c1-47a3-a769-1b71dcbf684c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcccc574db484acd9dec6da8725bd905)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:08.205822 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6704bf-b1c1-47a3-a769-1b71dcbf684c admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:08.250732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c932e-7049-44b3-a76a-44636b988bb1 service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:08.263858 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c932e-7049-44b3-a76a-44636b988bb1 service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:08.268630 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca57fde-89e7-4291-9b36-563ee61d21bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:08.269273 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca57fde-89e7-4291-9b36-563ee61d21bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:08.269549 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca57fde-89e7-4291-9b36-563ee61d21bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:08.269814 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca57fde-89e7-4291-9b36-563ee61d21bb admin admin] PATH_INFO: `/v3/users/408014d04a6540bbb907a2b349fee229` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:08.270947 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca57fde-89e7-4291-9b36-563ee61d21bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=408014d04a6540bbb907a2b349fee229)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:08.273117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca57fde-89e7-4291-9b36-563ee61d21bb admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:08.430206 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:08.476800 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-fa6704bf-b1c1-47a3-a769-1b71dcbf684c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcccc574db484acd9dec6da8725bd905'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:08.483366 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-7ca57fde-89e7-4291-9b36-563ee61d21bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '408014d04a6540bbb907a2b349fee229'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:08.589885 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-fa6704bf-b1c1-47a3-a769-1b71dcbf684c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcccc574db484acd9dec6da8725bd905'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:08.590629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-fa6704bf-b1c1-47a3-a769-1b71dcbf684c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcccc574db484acd9dec6da8725bd905'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:08.591325 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-fa6704bf-b1c1-47a3-a769-1b71dcbf684c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcccc574db484acd9dec6da8725bd905'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:08.599755 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-fa6704bf-b1c1-47a3-a769-1b71dcbf684c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcccc574db484acd9dec6da8725bd905'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:08.621773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1022/2049] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:28:08 2022] DELETE /identity/v3/users/fcccc574db484acd9dec6da8725bd905 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:08.626261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5789cd5-5eae-4845-bb6a-498bccf897f8 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:08.626556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5789cd5-5eae-4845-bb6a-498bccf897f8 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:08.626833 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5789cd5-5eae-4845-bb6a-498bccf897f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:08.648238 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-c5789cd5-5eae-4845-bb6a-498bccf897f8 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:08.650089 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-c5789cd5-5eae-4845-bb6a-498bccf897f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:08.686410 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-7ca57fde-89e7-4291-9b36-563ee61d21bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '408014d04a6540bbb907a2b349fee229'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:08.687373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-7ca57fde-89e7-4291-9b36-563ee61d21bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '408014d04a6540bbb907a2b349fee229'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:08.688218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-7ca57fde-89e7-4291-9b36-563ee61d21bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '408014d04a6540bbb907a2b349fee229'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:08.698601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-7ca57fde-89e7-4291-9b36-563ee61d21bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '408014d04a6540bbb907a2b349fee229'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:08.714577 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1023/2050] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:28:08.719099 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1028/2051] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:28:08 2022] DELETE /identity/v3/users/408014d04a6540bbb907a2b349fee229 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:28:08.723749 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bb0ca-b1c2-444b-bef1-4e987bba8bd0 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:08.724101 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bb0ca-b1c2-444b-bef1-4e987bba8bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:08.724879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bb0ca-b1c2-444b-bef1-4e987bba8bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:08.728940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca57fde-89e7-4291-9b36-563ee61d21bb admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:08.730168 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-7ca57fde-89e7-4291-9b36-563ee61d21bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:08.751238 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-e18bb0ca-b1c2-444b-bef1-4e987bba8bd0 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:08.752602 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-e18bb0ca-b1c2-444b-bef1-4e987bba8bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:08.806718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca57fde-89e7-4291-9b36-563ee61d21bb admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:08.815254 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2e692-14b4-4166-bf48-2ad098e46941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:08.816544 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2e692-14b4-4166-bf48-2ad098e46941 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:08.817079 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2e692-14b4-4166-bf48-2ad098e46941 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:08.817678 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2e692-14b4-4166-bf48-2ad098e46941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:08.842237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1024/2052] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:28:08.853757 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bb0ca-b1c2-444b-bef1-4e987bba8bd0 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:08.867139 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bb0ca-b1c2-444b-bef1-4e987bba8bd0 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:08.871636 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a643ad-0ff6-4151-a29c-41d6a92f7003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:08.872683 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a643ad-0ff6-4151-a29c-41d6a92f7003 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:08.872966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a643ad-0ff6-4151-a29c-41d6a92f7003 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:08.873237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a643ad-0ff6-4151-a29c-41d6a92f7003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:08.883415 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a643ad-0ff6-4151-a29c-41d6a92f7003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:08.884936 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a643ad-0ff6-4151-a29c-41d6a92f7003 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:08.890945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2e692-14b4-4166-bf48-2ad098e46941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:08.892731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2e692-14b4-4166-bf48-2ad098e46941 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:08.897166 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1025/2053] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:28:08.904190 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1029/2054] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:28:09.042235 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:09.330331 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:09.579974 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a643ad-0ff6-4151-a29c-41d6a92f7003 service neutron] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:09.581485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-10a643ad-0ff6-4151-a29c-41d6a92f7003 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:09.589952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2e692-14b4-4166-bf48-2ad098e46941 service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:09.592108 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-dbc2e692-14b4-4166-bf48-2ad098e46941 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:09.605261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a643ad-0ff6-4151-a29c-41d6a92f7003 service neutron] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:09.611191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2e692-14b4-4166-bf48-2ad098e46941 service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:09.623127 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef78d07-91ae-4bd7-8c2a-15c62f5ac7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:09.623596 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81143b6-ab8d-4c33-a0df-54fabba77a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:09.623929 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef78d07-91ae-4bd7-8c2a-15c62f5ac7c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:09.624209 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef78d07-91ae-4bd7-8c2a-15c62f5ac7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:09.624482 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef78d07-91ae-4bd7-8c2a-15c62f5ac7c2 admin admin] PATH_INFO: `/v3/projects/19f06715a3794d6e8bc681787c92aca5` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:09.625785 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81143b6-ab8d-4c33-a0df-54fabba77a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:09.626583 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef78d07-91ae-4bd7-8c2a-15c62f5ac7c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19f06715a3794d6e8bc681787c92aca5)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:09.626816 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81143b6-ab8d-4c33-a0df-54fabba77a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:09.627304 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81143b6-ab8d-4c33-a0df-54fabba77a41 admin admin] PATH_INFO: `/v3/projects/92ff8f4c5e2b4d3d987db92f55e96bc9` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:09.628756 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef78d07-91ae-4bd7-8c2a-15c62f5ac7c2 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:09.636880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81143b6-ab8d-4c33-a0df-54fabba77a41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92ff8f4c5e2b4d3d987db92f55e96bc9)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:09.636880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81143b6-ab8d-4c33-a0df-54fabba77a41 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:09.850626 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-0ef78d07-91ae-4bd7-8c2a-15c62f5ac7c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f06715a3794d6e8bc681787c92aca5', 'request_id': 'req-0ef78d07-91ae-4bd7-8c2a-15c62f5ac7c2'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:09.872705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-0ef78d07-91ae-4bd7-8c2a-15c62f5ac7c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f06715a3794d6e8bc681787c92aca5', 'request_id': 'req-0ef78d07-91ae-4bd7-8c2a-15c62f5ac7c2'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:09.890758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f81143b6-ab8d-4c33-a0df-54fabba77a41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92ff8f4c5e2b4d3d987db92f55e96bc9', 'request_id': 'req-f81143b6-ab8d-4c33-a0df-54fabba77a41'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:09.899614 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f81143b6-ab8d-4c33-a0df-54fabba77a41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92ff8f4c5e2b4d3d987db92f55e96bc9', 'request_id': 'req-f81143b6-ab8d-4c33-a0df-54fabba77a41'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:10.013460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-0ef78d07-91ae-4bd7-8c2a-15c62f5ac7c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f06715a3794d6e8bc681787c92aca5', 'request_id': 'req-0ef78d07-91ae-4bd7-8c2a-15c62f5ac7c2'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:10.037546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-0ef78d07-91ae-4bd7-8c2a-15c62f5ac7c2 admin admin] The token cache is being invalidate because project 19f06715a3794d6e8bc681787c92aca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:10.037912 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-0ef78d07-91ae-4bd7-8c2a-15c62f5ac7c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:10.038902 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-0ef78d07-91ae-4bd7-8c2a-15c62f5ac7c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:10.045617 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1026/2055] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:09 2022] DELETE /identity/v3/projects/19f06715a3794d6e8bc681787c92aca5 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:10.047784 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef78d07-91ae-4bd7-8c2a-15c62f5ac7c2 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:10.049794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-0ef78d07-91ae-4bd7-8c2a-15c62f5ac7c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:10.126735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f81143b6-ab8d-4c33-a0df-54fabba77a41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92ff8f4c5e2b4d3d987db92f55e96bc9', 'request_id': 'req-f81143b6-ab8d-4c33-a0df-54fabba77a41'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:10.131999 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef78d07-91ae-4bd7-8c2a-15c62f5ac7c2 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:10.145227 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f81143b6-ab8d-4c33-a0df-54fabba77a41 admin admin] The token cache is being invalidate because project 92ff8f4c5e2b4d3d987db92f55e96bc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:10.145665 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f81143b6-ab8d-4c33-a0df-54fabba77a41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:10.147093 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f81143b6-ab8d-4c33-a0df-54fabba77a41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:10.149382 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1030/2056] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:09 2022] DELETE /identity/v3/projects/92ff8f4c5e2b4d3d987db92f55e96bc9 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:28:10.154141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81143b6-ab8d-4c33-a0df-54fabba77a41 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:10.155775 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f81143b6-ab8d-4c33-a0df-54fabba77a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:10.200364 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfcba6-c76d-4703-b3c6-030c9b728965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:10.201016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfcba6-c76d-4703-b3c6-030c9b728965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:10.201296 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfcba6-c76d-4703-b3c6-030c9b728965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:10.201572 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfcba6-c76d-4703-b3c6-030c9b728965 admin admin] PATH_INFO: `/v3/users/9c700c53b05d43c3a852a01ff04d66e2` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:10.202757 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dfcba6-c76d-4703-b3c6-030c9b728965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c700c53b05d43c3a852a01ff04d66e2)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:10.204850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dfcba6-c76d-4703-b3c6-030c9b728965 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:10.268538 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81143b6-ab8d-4c33-a0df-54fabba77a41 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:10.275379 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6932cb-f53d-434d-8112-b5015f3e0861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:10.276352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6932cb-f53d-434d-8112-b5015f3e0861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:10.277067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6932cb-f53d-434d-8112-b5015f3e0861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:10.278232 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6932cb-f53d-434d-8112-b5015f3e0861 admin admin] PATH_INFO: `/v3/users/6c1e1ed5ed164ca499aa47b486780ba4` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:10.279615 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6932cb-f53d-434d-8112-b5015f3e0861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c1e1ed5ed164ca499aa47b486780ba4)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:10.281992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6932cb-f53d-434d-8112-b5015f3e0861 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:10.458173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-26dfcba6-c76d-4703-b3c6-030c9b728965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c700c53b05d43c3a852a01ff04d66e2'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:10.460268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-df6932cb-f53d-434d-8112-b5015f3e0861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c1e1ed5ed164ca499aa47b486780ba4'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:10.580824 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-26dfcba6-c76d-4703-b3c6-030c9b728965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c700c53b05d43c3a852a01ff04d66e2'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:10.581824 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-26dfcba6-c76d-4703-b3c6-030c9b728965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c700c53b05d43c3a852a01ff04d66e2'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:10.582612 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-26dfcba6-c76d-4703-b3c6-030c9b728965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c700c53b05d43c3a852a01ff04d66e2'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:10.591631 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-26dfcba6-c76d-4703-b3c6-030c9b728965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c700c53b05d43c3a852a01ff04d66e2'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:10.613578 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1027/2057] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:28:10 2022] DELETE /identity/v3/users/9c700c53b05d43c3a852a01ff04d66e2 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:10.675757 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-df6932cb-f53d-434d-8112-b5015f3e0861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c1e1ed5ed164ca499aa47b486780ba4'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:10.676887 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-df6932cb-f53d-434d-8112-b5015f3e0861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c1e1ed5ed164ca499aa47b486780ba4'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:10.677705 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-df6932cb-f53d-434d-8112-b5015f3e0861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c1e1ed5ed164ca499aa47b486780ba4'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:10.698761 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-df6932cb-f53d-434d-8112-b5015f3e0861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c1e1ed5ed164ca499aa47b486780ba4'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:10.750138 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1031/2058] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:28:10 2022] DELETE /identity/v3/users/6c1e1ed5ed164ca499aa47b486780ba4 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:28:10.940761 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:11.293567 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfcba6-c76d-4703-b3c6-030c9b728965 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:11.296639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-26dfcba6-c76d-4703-b3c6-030c9b728965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:11.379979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfcba6-c76d-4703-b3c6-030c9b728965 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:11.449069 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79ad87-8b7f-4697-b99c-238735bda506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:11.449740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79ad87-8b7f-4697-b99c-238735bda506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:11.450060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79ad87-8b7f-4697-b99c-238735bda506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:11.450513 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79ad87-8b7f-4697-b99c-238735bda506 admin admin] PATH_INFO: `/v3/projects/39c3cfab671d4cbcabb446628e3cfca3` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:11.452006 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79ad87-8b7f-4697-b99c-238735bda506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39c3cfab671d4cbcabb446628e3cfca3)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:11.454365 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79ad87-8b7f-4697-b99c-238735bda506 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:11.518638 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6932cb-f53d-434d-8112-b5015f3e0861 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:11.520551 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-df6932cb-f53d-434d-8112-b5015f3e0861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:11.540183 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:11.542419 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6932cb-f53d-434d-8112-b5015f3e0861 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:11.552278 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41cfd3-07ff-4e1a-a507-c90eab74bfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:11.553066 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41cfd3-07ff-4e1a-a507-c90eab74bfbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:11.553772 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41cfd3-07ff-4e1a-a507-c90eab74bfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:11.554052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41cfd3-07ff-4e1a-a507-c90eab74bfbe admin admin] PATH_INFO: `/v3/projects/1d390c6e7f0b4c02bad1144650b83f14` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:11.555361 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41cfd3-07ff-4e1a-a507-c90eab74bfbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d390c6e7f0b4c02bad1144650b83f14)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:11.559423 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41cfd3-07ff-4e1a-a507-c90eab74bfbe admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:11.592414 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-ee79ad87-8b7f-4697-b99c-238735bda506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39c3cfab671d4cbcabb446628e3cfca3', 'request_id': 'req-ee79ad87-8b7f-4697-b99c-238735bda506'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:11.600683 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-ee79ad87-8b7f-4697-b99c-238735bda506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39c3cfab671d4cbcabb446628e3cfca3', 'request_id': 'req-ee79ad87-8b7f-4697-b99c-238735bda506'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:11.721473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-ee79ad87-8b7f-4697-b99c-238735bda506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39c3cfab671d4cbcabb446628e3cfca3', 'request_id': 'req-ee79ad87-8b7f-4697-b99c-238735bda506'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:11.733842 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-ee79ad87-8b7f-4697-b99c-238735bda506 admin admin] The token cache is being invalidate because project 39c3cfab671d4cbcabb446628e3cfca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:11.734135 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-ee79ad87-8b7f-4697-b99c-238735bda506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:11.734810 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-ee79ad87-8b7f-4697-b99c-238735bda506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:11.736443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1028/2059] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:11 2022] DELETE /identity/v3/projects/39c3cfab671d4cbcabb446628e3cfca3 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:11.741335 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e37ed-226c-4043-8173-faf15898b136 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:11.741783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e37ed-226c-4043-8173-faf15898b136 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:11.742115 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e37ed-226c-4043-8173-faf15898b136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:11.743207 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-ac41cfd3-07ff-4e1a-a507-c90eab74bfbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d390c6e7f0b4c02bad1144650b83f14', 'request_id': 'req-ac41cfd3-07ff-4e1a-a507-c90eab74bfbe'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:11.750613 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-ac41cfd3-07ff-4e1a-a507-c90eab74bfbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d390c6e7f0b4c02bad1144650b83f14', 'request_id': 'req-ac41cfd3-07ff-4e1a-a507-c90eab74bfbe'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:11.763821 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-d36e37ed-226c-4043-8173-faf15898b136 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:11.765016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-d36e37ed-226c-4043-8173-faf15898b136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:11.842251 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1029/2060] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:28:11.852507 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d48afb-390d-410e-9259-e7900bc2d15b None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:11.852791 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d48afb-390d-410e-9259-e7900bc2d15b None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:11.853171 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d48afb-390d-410e-9259-e7900bc2d15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:11.876116 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-19d48afb-390d-410e-9259-e7900bc2d15b None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:11.881644 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-19d48afb-390d-410e-9259-e7900bc2d15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:11.887779 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1030/2061] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:28:11.898951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d48afb-390d-410e-9259-e7900bc2d15b None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:11.908839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-ac41cfd3-07ff-4e1a-a507-c90eab74bfbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d390c6e7f0b4c02bad1144650b83f14', 'request_id': 'req-ac41cfd3-07ff-4e1a-a507-c90eab74bfbe'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:11.910476 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d48afb-390d-410e-9259-e7900bc2d15b None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:11.921127 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280114e-1dba-42a8-a371-9a8ca0e1ffbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:11.922179 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280114e-1dba-42a8-a371-9a8ca0e1ffbe admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:11.922464 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-ac41cfd3-07ff-4e1a-a507-c90eab74bfbe admin admin] The token cache is being invalidate because project 1d390c6e7f0b4c02bad1144650b83f14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:11.922761 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-ac41cfd3-07ff-4e1a-a507-c90eab74bfbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:11.928049 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280114e-1dba-42a8-a371-9a8ca0e1ffbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:11.928049 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280114e-1dba-42a8-a371-9a8ca0e1ffbe admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:11.928252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-ac41cfd3-07ff-4e1a-a507-c90eab74bfbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:11.928328 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c280114e-1dba-42a8-a371-9a8ca0e1ffbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:28:11.928328 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c280114e-1dba-42a8-a371-9a8ca0e1ffbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:11.928471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1032/2062] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:11 2022] DELETE /identity/v3/projects/1d390c6e7f0b4c02bad1144650b83f14 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:11.930613 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c280114e-1dba-42a8-a371-9a8ca0e1ffbe admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:11.931300 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41cfd3-07ff-4e1a-a507-c90eab74bfbe admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:11.933352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-ac41cfd3-07ff-4e1a-a507-c90eab74bfbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:11.945433 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1031/2063] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:28:11.950955 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280114e-1dba-42a8-a371-9a8ca0e1ffbe admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:11.953274 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41cfd3-07ff-4e1a-a507-c90eab74bfbe admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:11.953659 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-c280114e-1dba-42a8-a371-9a8ca0e1ffbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:11.963716 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd502f70-2117-4efc-bfaf-89da5274c08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:11.965156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd502f70-2117-4efc-bfaf-89da5274c08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:11.965644 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd502f70-2117-4efc-bfaf-89da5274c08c admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:11.966123 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd502f70-2117-4efc-bfaf-89da5274c08c admin admin] PATH_INFO: `/v3/users/4f0086646bea4a33bd1155bfb0ae97cd` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:11.968118 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd502f70-2117-4efc-bfaf-89da5274c08c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f0086646bea4a33bd1155bfb0ae97cd)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:11.972981 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd502f70-2117-4efc-bfaf-89da5274c08c admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:11.986598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280114e-1dba-42a8-a371-9a8ca0e1ffbe admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:11.992201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9861fd8-3033-40a9-8ce9-ddd65ec90d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:11.992823 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9861fd8-3033-40a9-8ce9-ddd65ec90d52 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:11.993124 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9861fd8-3033-40a9-8ce9-ddd65ec90d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:11.993589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9861fd8-3033-40a9-8ce9-ddd65ec90d52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:11.994236 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9861fd8-3033-40a9-8ce9-ddd65ec90d52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:11.996235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9861fd8-3033-40a9-8ce9-ddd65ec90d52 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:12.150846 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1032/2064] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:28:11 2022] POST /identity/v3/projects => generated 377 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:12.155256 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9861fd8-3033-40a9-8ce9-ddd65ec90d52 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:12.228417 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9861fd8-3033-40a9-8ce9-ddd65ec90d52 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:12.234214 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf1313-d08a-4b94-a02f-97aa95c2506b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:12.234843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf1313-d08a-4b94-a02f-97aa95c2506b admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:12.243794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf1313-d08a-4b94-a02f-97aa95c2506b admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:12.243794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf1313-d08a-4b94-a02f-97aa95c2506b admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:12.243794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf1313-d08a-4b94-a02f-97aa95c2506b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:12.243794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf1313-d08a-4b94-a02f-97aa95c2506b admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:12.302025 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-bd502f70-2117-4efc-bfaf-89da5274c08c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f0086646bea4a33bd1155bfb0ae97cd'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:12.375128 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1033/2065] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:28:12 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:28:12.376560 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf1313-d08a-4b94-a02f-97aa95c2506b admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:12.388475 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf1313-d08a-4b94-a02f-97aa95c2506b admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:12.394163 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032a268-88c7-4d41-a32f-d45ae9f598fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:12.395159 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032a268-88c7-4d41-a32f-d45ae9f598fb admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:12.395598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032a268-88c7-4d41-a32f-d45ae9f598fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:12.396018 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032a268-88c7-4d41-a32f-d45ae9f598fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:12.407245 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032a268-88c7-4d41-a32f-d45ae9f598fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:12.409264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032a268-88c7-4d41-a32f-d45ae9f598fb admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:12.427908 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1034/2066] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:12.428753 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-bd502f70-2117-4efc-bfaf-89da5274c08c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f0086646bea4a33bd1155bfb0ae97cd'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:12.429522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-bd502f70-2117-4efc-bfaf-89da5274c08c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f0086646bea4a33bd1155bfb0ae97cd'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:12.430213 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-bd502f70-2117-4efc-bfaf-89da5274c08c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f0086646bea4a33bd1155bfb0ae97cd'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:12.437240 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032a268-88c7-4d41-a32f-d45ae9f598fb admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:12.440430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-e032a268-88c7-4d41-a32f-d45ae9f598fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:12.445094 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-bd502f70-2117-4efc-bfaf-89da5274c08c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f0086646bea4a33bd1155bfb0ae97cd'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:12.456266 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032a268-88c7-4d41-a32f-d45ae9f598fb admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:12.463227 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be14a5-e8b9-4279-8187-a6c35638be73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:12.465732 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be14a5-e8b9-4279-8187-a6c35638be73 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:12.471335 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be14a5-e8b9-4279-8187-a6c35638be73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:12.471335 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be14a5-e8b9-4279-8187-a6c35638be73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:12.471335 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be14a5-e8b9-4279-8187-a6c35638be73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:12.471335 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be14a5-e8b9-4279-8187-a6c35638be73 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:12.485938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1035/2067] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:12.490590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be14a5-e8b9-4279-8187-a6c35638be73 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:12.502971 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1033/2068] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:28:11 2022] DELETE /identity/v3/users/4f0086646bea4a33bd1155bfb0ae97cd => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:12.513444 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be14a5-e8b9-4279-8187-a6c35638be73 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:12.626058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296c2fc-2db2-438c-9f37-dfa8ab6df527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:12.626764 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296c2fc-2db2-438c-9f37-dfa8ab6df527 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:12.627114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296c2fc-2db2-438c-9f37-dfa8ab6df527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:12.627657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296c2fc-2db2-438c-9f37-dfa8ab6df527 admin admin] PATH_INFO: `/v3/projects/01a52b767c284d72bf5e5b1fb0a2c75f/users/e52d4965209b4351b3c4feb76517e897/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:12.649776 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296c2fc-2db2-438c-9f37-dfa8ab6df527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a52b767c284d72bf5e5b1fb0a2c75f, user_id=e52d4965209b4351b3c4feb76517e897, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:12.652778 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296c2fc-2db2-438c-9f37-dfa8ab6df527 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:13.022346 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd502f70-2117-4efc-bfaf-89da5274c08c admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:13.022346 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-bd502f70-2117-4efc-bfaf-89da5274c08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:13.024636 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1036/2069] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:12 2022] PUT /identity/v3/projects/01a52b767c284d72bf5e5b1fb0a2c75f/users/e52d4965209b4351b3c4feb76517e897/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:28:13.024636 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296c2fc-2db2-438c-9f37-dfa8ab6df527 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:13.024636 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-a296c2fc-2db2-438c-9f37-dfa8ab6df527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:13.026154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd502f70-2117-4efc-bfaf-89da5274c08c admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:13.027251 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296c2fc-2db2-438c-9f37-dfa8ab6df527 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:13.027251 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71a648-eecb-4df5-bf8c-99e36c116ddc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:13.027251 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71a648-eecb-4df5-bf8c-99e36c116ddc service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:13.027251 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71a648-eecb-4df5-bf8c-99e36c116ddc service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:13.028257 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71a648-eecb-4df5-bf8c-99e36c116ddc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:13.028257 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-9c71a648-eecb-4df5-bf8c-99e36c116ddc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:13.028927 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e9cb7-1c13-49be-8251-e1973cc84e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:13.028927 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e9cb7-1c13-49be-8251-e1973cc84e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:13.028927 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e9cb7-1c13-49be-8251-e1973cc84e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:13.028927 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e9cb7-1c13-49be-8251-e1973cc84e03 admin admin] PATH_INFO: `/v3/users/c0e38fef89d242f1b8f7671c079bda89` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:13.029731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e9cb7-1c13-49be-8251-e1973cc84e03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0e38fef89d242f1b8f7671c079bda89)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:13.029731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e9cb7-1c13-49be-8251-e1973cc84e03 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:13.030478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71a648-eecb-4df5-bf8c-99e36c116ddc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:13.030478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71a648-eecb-4df5-bf8c-99e36c116ddc service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:13.030478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1037/2070] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:28:13.030478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89389206-6511-4443-a1b2-56519415a1d4 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:13.030478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89389206-6511-4443-a1b2-56519415a1d4 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:13.030478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89389206-6511-4443-a1b2-56519415a1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:13.066491 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-89389206-6511-4443-a1b2-56519415a1d4 None None] MFA Rules not processed for user `e52d4965209b4351b3c4feb76517e897`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:13.068883 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-89389206-6511-4443-a1b2-56519415a1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:13.167080 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1038/2071] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:13.180565 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89389206-6511-4443-a1b2-56519415a1d4 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:13.182560 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-89389206-6511-4443-a1b2-56519415a1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:13.200294 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89389206-6511-4443-a1b2-56519415a1d4 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:13.205058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1ea18-1775-4a1b-bd44-1cc9da7117fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:13.205991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1ea18-1775-4a1b-bd44-1cc9da7117fe service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:13.206370 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1ea18-1775-4a1b-bd44-1cc9da7117fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:13.206740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1ea18-1775-4a1b-bd44-1cc9da7117fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:13.223787 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1ea18-1775-4a1b-bd44-1cc9da7117fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:13.226014 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1ea18-1775-4a1b-bd44-1cc9da7117fe service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:13.237186 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1039/2072] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:28:13.324340 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1ea18-1775-4a1b-bd44-1cc9da7117fe service cinder] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:13.325420 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-c2b1ea18-1775-4a1b-bd44-1cc9da7117fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:13.339795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f26e9cb7-1c13-49be-8251-e1973cc84e03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0e38fef89d242f1b8f7671c079bda89'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:13.351264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1ea18-1775-4a1b-bd44-1cc9da7117fe service cinder] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:13.368376 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdade285-1725-41d9-8ea3-81b65cc5d837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:13.369021 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdade285-1725-41d9-8ea3-81b65cc5d837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:13.369297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdade285-1725-41d9-8ea3-81b65cc5d837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:13.369568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdade285-1725-41d9-8ea3-81b65cc5d837 admin admin] PATH_INFO: `/v3/projects/c9a545f03e8749eab32cecbb868b6532` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:13.370961 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdade285-1725-41d9-8ea3-81b65cc5d837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9a545f03e8749eab32cecbb868b6532)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:13.373524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdade285-1725-41d9-8ea3-81b65cc5d837 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:13.459418 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f26e9cb7-1c13-49be-8251-e1973cc84e03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0e38fef89d242f1b8f7671c079bda89'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:13.460246 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f26e9cb7-1c13-49be-8251-e1973cc84e03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0e38fef89d242f1b8f7671c079bda89'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:13.460930 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f26e9cb7-1c13-49be-8251-e1973cc84e03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0e38fef89d242f1b8f7671c079bda89'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:13.470503 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f26e9cb7-1c13-49be-8251-e1973cc84e03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0e38fef89d242f1b8f7671c079bda89'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:13.503497 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1034/2073] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:28:12 2022] DELETE /identity/v3/users/c0e38fef89d242f1b8f7671c079bda89 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:28:13.509614 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459fdc7-6cbf-4abc-a15b-8908a775eb22 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:13.510548 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459fdc7-6cbf-4abc-a15b-8908a775eb22 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:13.511102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459fdc7-6cbf-4abc-a15b-8908a775eb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:13.533931 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-bdade285-1725-41d9-8ea3-81b65cc5d837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9a545f03e8749eab32cecbb868b6532', 'request_id': 'req-bdade285-1725-41d9-8ea3-81b65cc5d837'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:13.545466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-bdade285-1725-41d9-8ea3-81b65cc5d837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9a545f03e8749eab32cecbb868b6532', 'request_id': 'req-bdade285-1725-41d9-8ea3-81b65cc5d837'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:13.553340 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-f459fdc7-6cbf-4abc-a15b-8908a775eb22 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:13.557308 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f459fdc7-6cbf-4abc-a15b-8908a775eb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:13.652043 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1035/2074] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:28:13.654802 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459fdc7-6cbf-4abc-a15b-8908a775eb22 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:13.656459 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f459fdc7-6cbf-4abc-a15b-8908a775eb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:13.670440 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459fdc7-6cbf-4abc-a15b-8908a775eb22 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:13.676087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2762a-0618-4166-96e9-2e7c2ed96e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:13.676891 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2762a-0618-4166-96e9-2e7c2ed96e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:13.677031 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2762a-0618-4166-96e9-2e7c2ed96e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:13.677423 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2762a-0618-4166-96e9-2e7c2ed96e1c admin admin] PATH_INFO: `/v3/users/b4543538509341ca9f6428538861d990` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:13.678605 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2762a-0618-4166-96e9-2e7c2ed96e1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4543538509341ca9f6428538861d990)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:13.680584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2762a-0618-4166-96e9-2e7c2ed96e1c admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:13.693411 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-bdade285-1725-41d9-8ea3-81b65cc5d837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9a545f03e8749eab32cecbb868b6532', 'request_id': 'req-bdade285-1725-41d9-8ea3-81b65cc5d837'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:13.714822 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-bdade285-1725-41d9-8ea3-81b65cc5d837 admin admin] The token cache is being invalidate because project c9a545f03e8749eab32cecbb868b6532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:13.723338 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-bdade285-1725-41d9-8ea3-81b65cc5d837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:13.723338 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-bdade285-1725-41d9-8ea3-81b65cc5d837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:13.723338 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1040/2075] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:13 2022] DELETE /identity/v3/projects/c9a545f03e8749eab32cecbb868b6532 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:13.723338 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdade285-1725-41d9-8ea3-81b65cc5d837 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:13.725408 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-bdade285-1725-41d9-8ea3-81b65cc5d837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:13.788062 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdade285-1725-41d9-8ea3-81b65cc5d837 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:13.791971 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0be50-5149-4616-84fb-a76147cdb7ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:13.792712 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0be50-5149-4616-84fb-a76147cdb7ce service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:13.792937 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0be50-5149-4616-84fb-a76147cdb7ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:13.793165 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0be50-5149-4616-84fb-a76147cdb7ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:13.794990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-a6c0be50-5149-4616-84fb-a76147cdb7ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:13.807576 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0be50-5149-4616-84fb-a76147cdb7ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:13.809052 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0be50-5149-4616-84fb-a76147cdb7ce service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:13.820338 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1041/2076] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:28:13.821639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c2120-7e5d-4d60-a768-08b64a290356 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:13.821925 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c2120-7e5d-4d60-a768-08b64a290356 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:13.822200 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c2120-7e5d-4d60-a768-08b64a290356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:13.845851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-867c2120-7e5d-4d60-a768-08b64a290356 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:13.847139 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-867c2120-7e5d-4d60-a768-08b64a290356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:13.864514 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1042/2077] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:13.867023 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d2a4f-6b18-49c8-aa86-2bce513d7494 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:13.867482 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d2a4f-6b18-49c8-aa86-2bce513d7494 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:13.867615 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d2a4f-6b18-49c8-aa86-2bce513d7494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:13.893419 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-b54d2a4f-6b18-49c8-aa86-2bce513d7494 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:13.894676 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-b54d2a4f-6b18-49c8-aa86-2bce513d7494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:13.903678 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1043/2078] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:28:13.908067 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d2a4f-6b18-49c8-aa86-2bce513d7494 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:13.918771 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d2a4f-6b18-49c8-aa86-2bce513d7494 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:13.924681 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fd347-62e2-4403-b0d9-61b96e96ebe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:13.925256 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fd347-62e2-4403-b0d9-61b96e96ebe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:13.925532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fd347-62e2-4403-b0d9-61b96e96ebe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:13.925800 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fd347-62e2-4403-b0d9-61b96e96ebe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:13.926589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fd347-62e2-4403-b0d9-61b96e96ebe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:28:13.926894 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fd347-62e2-4403-b0d9-61b96e96ebe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:13.928687 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fd347-62e2-4403-b0d9-61b96e96ebe6 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:13.931063 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c4e2762a-0618-4166-96e9-2e7c2ed96e1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4543538509341ca9f6428538861d990'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:13.938117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:13.943746 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1044/2079] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:28:13.949494 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fd347-62e2-4403-b0d9-61b96e96ebe6 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:13.959327 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fd347-62e2-4403-b0d9-61b96e96ebe6 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:13.965125 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd6500-bbc9-4066-9db1-9b7d98f23372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:13.965875 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd6500-bbc9-4066-9db1-9b7d98f23372 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:13.966156 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd6500-bbc9-4066-9db1-9b7d98f23372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:13.966534 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd6500-bbc9-4066-9db1-9b7d98f23372 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:13.967329 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd6500-bbc9-4066-9db1-9b7d98f23372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:13.969481 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd6500-bbc9-4066-9db1-9b7d98f23372 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:14.019370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c4e2762a-0618-4166-96e9-2e7c2ed96e1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4543538509341ca9f6428538861d990'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:14.032443 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c4e2762a-0618-4166-96e9-2e7c2ed96e1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4543538509341ca9f6428538861d990'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:14.038863 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c4e2762a-0618-4166-96e9-2e7c2ed96e1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4543538509341ca9f6428538861d990'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:14.050806 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c4e2762a-0618-4166-96e9-2e7c2ed96e1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4543538509341ca9f6428538861d990'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:14.061287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1045/2080] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:28:13 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:28:14.064748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd6500-bbc9-4066-9db1-9b7d98f23372 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:14.064748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-c3dd6500-bbc9-4066-9db1-9b7d98f23372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:14.087665 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1036/2081] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:28:13 2022] DELETE /identity/v3/users/b4543538509341ca9f6428538861d990 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:14.170211 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd6500-bbc9-4066-9db1-9b7d98f23372 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:14.249533 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd41109-689c-42f3-a5d0-f4e588833374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:14.251347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd41109-689c-42f3-a5d0-f4e588833374 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:14.251880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd41109-689c-42f3-a5d0-f4e588833374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:14.252368 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd41109-689c-42f3-a5d0-f4e588833374 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:14.253216 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd41109-689c-42f3-a5d0-f4e588833374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:14.256209 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd41109-689c-42f3-a5d0-f4e588833374 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:14.330468 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2762a-0618-4166-96e9-2e7c2ed96e1c admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:14.332022 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c4e2762a-0618-4166-96e9-2e7c2ed96e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:14.339340 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:14.408897 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2762a-0618-4166-96e9-2e7c2ed96e1c admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:14.412678 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1046/2082] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:28:14 2022] POST /identity/v3/users => generated 292 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:14.418094 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd41109-689c-42f3-a5d0-f4e588833374 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:14.418682 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311815e4-d180-47af-90e2-f5c3806a74a4 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded2d677cbb34445ae4a6109ee35e140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c725cd8954a47a9a5263ccd49bbac11', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:14.419344 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311815e4-d180-47af-90e2-f5c3806a74a4 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:14.419647 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311815e4-d180-47af-90e2-f5c3806a74a4 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:14.419922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311815e4-d180-47af-90e2-f5c3806a74a4 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:14.420707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311815e4-d180-47af-90e2-f5c3806a74a4 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:28:14.420959 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311815e4-d180-47af-90e2-f5c3806a74a4 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:14.422568 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311815e4-d180-47af-90e2-f5c3806a74a4 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:14.429577 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd41109-689c-42f3-a5d0-f4e588833374 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:14.434957 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dac918-9fd4-4024-bc7d-4f38e33cee82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:14.435608 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dac918-9fd4-4024-bc7d-4f38e33cee82 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:14.435888 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dac918-9fd4-4024-bc7d-4f38e33cee82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:14.436062 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1037/2083] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:28:14.436463 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dac918-9fd4-4024-bc7d-4f38e33cee82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:14.437139 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dac918-9fd4-4024-bc7d-4f38e33cee82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:14.438759 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dac918-9fd4-4024-bc7d-4f38e33cee82 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:14.440503 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311815e4-d180-47af-90e2-f5c3806a74a4 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:14.449778 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1047/2084] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:28:14.453026 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311815e4-d180-47af-90e2-f5c3806a74a4 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:14.453775 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dac918-9fd4-4024-bc7d-4f38e33cee82 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:14.459681 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a011e-ac43-43e6-b474-c80cdf3cf80e tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded2d677cbb34445ae4a6109ee35e140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c725cd8954a47a9a5263ccd49bbac11', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:14.459681 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a011e-ac43-43e6-b474-c80cdf3cf80e tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:14.459873 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a011e-ac43-43e6-b474-c80cdf3cf80e tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:14.460119 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a011e-ac43-43e6-b474-c80cdf3cf80e tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:14.460765 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a011e-ac43-43e6-b474-c80cdf3cf80e tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:14.463790 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a011e-ac43-43e6-b474-c80cdf3cf80e tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:14.469651 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dac918-9fd4-4024-bc7d-4f38e33cee82 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:14.476287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26858c40-fb0e-4826-8394-83b4c6d6062c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:14.477192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26858c40-fb0e-4826-8394-83b4c6d6062c admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:14.477675 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26858c40-fb0e-4826-8394-83b4c6d6062c admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:14.478891 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26858c40-fb0e-4826-8394-83b4c6d6062c admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:14.482746 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26858c40-fb0e-4826-8394-83b4c6d6062c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:14.488195 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26858c40-fb0e-4826-8394-83b4c6d6062c admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:14.500363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1048/2085] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:28:14.504620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26858c40-fb0e-4826-8394-83b4c6d6062c admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:14.506399 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-26858c40-fb0e-4826-8394-83b4c6d6062c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:14.521544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26858c40-fb0e-4826-8394-83b4c6d6062c admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:14.526479 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afb61c-794d-44bd-88d1-3d4babe5a594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:14.527352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afb61c-794d-44bd-88d1-3d4babe5a594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:14.527778 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afb61c-794d-44bd-88d1-3d4babe5a594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:14.528238 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47afb61c-794d-44bd-88d1-3d4babe5a594 admin admin] PATH_INFO: `/v3/projects/8e9a309515d84d11a9b5dda5676f2941` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:14.529613 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afb61c-794d-44bd-88d1-3d4babe5a594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e9a309515d84d11a9b5dda5676f2941)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:14.531742 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47afb61c-794d-44bd-88d1-3d4babe5a594 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:14.602030 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1038/2086] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:28:14 2022] POST /identity/v3/projects => generated 354 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:28:14.603317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a011e-ac43-43e6-b474-c80cdf3cf80e tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:14.650539 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-47afb61c-794d-44bd-88d1-3d4babe5a594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e9a309515d84d11a9b5dda5676f2941', 'request_id': 'req-47afb61c-794d-44bd-88d1-3d4babe5a594'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:14.657268 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-47afb61c-794d-44bd-88d1-3d4babe5a594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e9a309515d84d11a9b5dda5676f2941', 'request_id': 'req-47afb61c-794d-44bd-88d1-3d4babe5a594'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:14.682541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a011e-ac43-43e6-b474-c80cdf3cf80e tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:14.732310 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-47afb61c-794d-44bd-88d1-3d4babe5a594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e9a309515d84d11a9b5dda5676f2941', 'request_id': 'req-47afb61c-794d-44bd-88d1-3d4babe5a594'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:14.741844 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232b487-f72e-45af-a3de-dc05c4761f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:14.742799 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232b487-f72e-45af-a3de-dc05c4761f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:14.743084 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232b487-f72e-45af-a3de-dc05c4761f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:14.743522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232b487-f72e-45af-a3de-dc05c4761f3d admin admin] PATH_INFO: `/v3/projects/e6854c84d3b04d9ba9f1527f29513b5c/users/9413932ff6c1434cb536c7bf30cb1161/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:14.754582 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-47afb61c-794d-44bd-88d1-3d4babe5a594 admin admin] The token cache is being invalidate because project 8e9a309515d84d11a9b5dda5676f2941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:14.754863 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-47afb61c-794d-44bd-88d1-3d4babe5a594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:14.756276 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-47afb61c-794d-44bd-88d1-3d4babe5a594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:14.757860 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1049/2087] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:14 2022] DELETE /identity/v3/projects/8e9a309515d84d11a9b5dda5676f2941 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:14.758871 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afb61c-794d-44bd-88d1-3d4babe5a594 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:14.760437 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-47afb61c-794d-44bd-88d1-3d4babe5a594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:14.762385 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232b487-f72e-45af-a3de-dc05c4761f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6854c84d3b04d9ba9f1527f29513b5c, user_id=9413932ff6c1434cb536c7bf30cb1161, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:14.765033 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232b487-f72e-45af-a3de-dc05c4761f3d admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:14.777477 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47afb61c-794d-44bd-88d1-3d4babe5a594 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:14.783277 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d97249-18f4-48c6-a6a6-827ad1de9472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:14.784445 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d97249-18f4-48c6-a6a6-827ad1de9472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:14.784910 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d97249-18f4-48c6-a6a6-827ad1de9472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:14.785366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d97249-18f4-48c6-a6a6-827ad1de9472 admin admin] PATH_INFO: `/v3/projects/96089e71564543458dedc2b3de7fe356` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:14.787223 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d97249-18f4-48c6-a6a6-827ad1de9472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96089e71564543458dedc2b3de7fe356)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:14.790191 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d97249-18f4-48c6-a6a6-827ad1de9472 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:14.840459 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1039/2088] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:14 2022] PUT /identity/v3/projects/e6854c84d3b04d9ba9f1527f29513b5c/users/9413932ff6c1434cb536c7bf30cb1161/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:14.841313 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232b487-f72e-45af-a3de-dc05c4761f3d admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:14.842928 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-d232b487-f72e-45af-a3de-dc05c4761f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:14.913200 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232b487-f72e-45af-a3de-dc05c4761f3d admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:14.923317 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-a3d97249-18f4-48c6-a6a6-827ad1de9472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96089e71564543458dedc2b3de7fe356', 'request_id': 'req-a3d97249-18f4-48c6-a6a6-827ad1de9472'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:14.932278 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-a3d97249-18f4-48c6-a6a6-827ad1de9472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96089e71564543458dedc2b3de7fe356', 'request_id': 'req-a3d97249-18f4-48c6-a6a6-827ad1de9472'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:14.981415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bf2dc-8d56-4efd-8f8b-6140aee6af67 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded2d677cbb34445ae4a6109ee35e140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c725cd8954a47a9a5263ccd49bbac11', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:14.982038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bf2dc-8d56-4efd-8f8b-6140aee6af67 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:14.982326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bf2dc-8d56-4efd-8f8b-6140aee6af67 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:14.982602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bf2dc-8d56-4efd-8f8b-6140aee6af67 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:14.983313 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3bf2dc-8d56-4efd-8f8b-6140aee6af67 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:28:14.983657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3bf2dc-8d56-4efd-8f8b-6140aee6af67 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:14.985284 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3bf2dc-8d56-4efd-8f8b-6140aee6af67 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:15.000996 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1040/2089] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:28:15.000996 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bf2dc-8d56-4efd-8f8b-6140aee6af67 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:15.000996 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-4f3bf2dc-8d56-4efd-8f8b-6140aee6af67 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:15.017798 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-a3d97249-18f4-48c6-a6a6-827ad1de9472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96089e71564543458dedc2b3de7fe356', 'request_id': 'req-a3d97249-18f4-48c6-a6a6-827ad1de9472'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:15.030148 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-a3d97249-18f4-48c6-a6a6-827ad1de9472 admin admin] The token cache is being invalidate because project 96089e71564543458dedc2b3de7fe356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:15.030503 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-a3d97249-18f4-48c6-a6a6-827ad1de9472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:15.031506 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-a3d97249-18f4-48c6-a6a6-827ad1de9472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:15.033329 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1050/2090] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:14 2022] DELETE /identity/v3/projects/96089e71564543458dedc2b3de7fe356 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:15.034546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea5c5e-21e9-4d0b-af89-d35d3e2c0a94 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:15.034824 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea5c5e-21e9-4d0b-af89-d35d3e2c0a94 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:15.035241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea5c5e-21e9-4d0b-af89-d35d3e2c0a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:15.067122 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-41ea5c5e-21e9-4d0b-af89-d35d3e2c0a94 None None] MFA Rules not processed for user `9413932ff6c1434cb536c7bf30cb1161`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:15.069220 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-41ea5c5e-21e9-4d0b-af89-d35d3e2c0a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:15.080550 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bf2dc-8d56-4efd-8f8b-6140aee6af67 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:15.086009 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c70000-48e2-4a59-b061-0a13a071f951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:15.086641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c70000-48e2-4a59-b061-0a13a071f951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:15.086915 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c70000-48e2-4a59-b061-0a13a071f951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:15.087223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c70000-48e2-4a59-b061-0a13a071f951 admin admin] PATH_INFO: `/v3/users/55b4e818df334c8ca344ddb8e7f40237` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:15.088409 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c70000-48e2-4a59-b061-0a13a071f951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55b4e818df334c8ca344ddb8e7f40237)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:15.090328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c70000-48e2-4a59-b061-0a13a071f951 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:15.137283 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1051/2091] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:15.138211 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea5c5e-21e9-4d0b-af89-d35d3e2c0a94 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:15.139516 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-41ea5c5e-21e9-4d0b-af89-d35d3e2c0a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:15.153400 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea5c5e-21e9-4d0b-af89-d35d3e2c0a94 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:15.158422 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4a364-e257-4dc0-93f5-96685c386321 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded2d677cbb34445ae4a6109ee35e140', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c725cd8954a47a9a5263ccd49bbac11', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:15.159067 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4a364-e257-4dc0-93f5-96685c386321 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:15.159421 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4a364-e257-4dc0-93f5-96685c386321 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:15.159878 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4a364-e257-4dc0-93f5-96685c386321 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] PATH_INFO: `/v3/projects/01e79259c78d49f0a6153073ac31c66c` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:15.162592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4a364-e257-4dc0-93f5-96685c386321 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] RBAC: Authorizing `identity:delete_project(project_id=01e79259c78d49f0a6153073ac31c66c)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:15.164664 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4a364-e257-4dc0-93f5-96685c386321 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:15.273034 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-40c70000-48e2-4a59-b061-0a13a071f951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55b4e818df334c8ca344ddb8e7f40237'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:15.299030 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-7ad4a364-e257-4dc0-93f5-96685c386321 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01e79259c78d49f0a6153073ac31c66c', 'request_id': 'req-7ad4a364-e257-4dc0-93f5-96685c386321'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:15.306430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-7ad4a364-e257-4dc0-93f5-96685c386321 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01e79259c78d49f0a6153073ac31c66c', 'request_id': 'req-7ad4a364-e257-4dc0-93f5-96685c386321'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:15.350302 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-40c70000-48e2-4a59-b061-0a13a071f951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55b4e818df334c8ca344ddb8e7f40237'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:15.350945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-40c70000-48e2-4a59-b061-0a13a071f951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55b4e818df334c8ca344ddb8e7f40237'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:15.351597 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-40c70000-48e2-4a59-b061-0a13a071f951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55b4e818df334c8ca344ddb8e7f40237'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:15.359257 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-40c70000-48e2-4a59-b061-0a13a071f951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55b4e818df334c8ca344ddb8e7f40237'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:15.377563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1041/2092] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:28:14 2022] DELETE /identity/v3/users/55b4e818df334c8ca344ddb8e7f40237 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:15.378830 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855e885-9a72-4fef-bcfc-65668f430b58 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:15.380059 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855e885-9a72-4fef-bcfc-65668f430b58 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:15.380059 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855e885-9a72-4fef-bcfc-65668f430b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:15.400871 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-5855e885-9a72-4fef-bcfc-65668f430b58 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:15.402124 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-5855e885-9a72-4fef-bcfc-65668f430b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:15.457093 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-7ad4a364-e257-4dc0-93f5-96685c386321 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01e79259c78d49f0a6153073ac31c66c', 'request_id': 'req-7ad4a364-e257-4dc0-93f5-96685c386321'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:15.466716 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1042/2093] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:15.467595 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855e885-9a72-4fef-bcfc-65668f430b58 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:15.469686 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-5855e885-9a72-4fef-bcfc-65668f430b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:15.477816 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-7ad4a364-e257-4dc0-93f5-96685c386321 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] The token cache is being invalidate because project 01e79259c78d49f0a6153073ac31c66c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:15.478110 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-7ad4a364-e257-4dc0-93f5-96685c386321 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:15.478781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-7ad4a364-e257-4dc0-93f5-96685c386321 tempest-VolumeQuotaClassesTest-1391690236 tempest-VolumeQuotaClassesTest-1391690236-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:15.483924 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1052/2094] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:15 2022] DELETE /identity/v3/projects/01e79259c78d49f0a6153073ac31c66c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:15.483924 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c122d-6b55-4c3c-a07d-fc85a790c155 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:15.484711 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855e885-9a72-4fef-bcfc-65668f430b58 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:15.484827 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c122d-6b55-4c3c-a07d-fc85a790c155 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:15.484827 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c122d-6b55-4c3c-a07d-fc85a790c155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:15.489333 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc37e2-3ba9-4cb9-a827-a70b6f427426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:15.507630 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc37e2-3ba9-4cb9-a827-a70b6f427426 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:15.507630 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc37e2-3ba9-4cb9-a827-a70b6f427426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:15.507630 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc37e2-3ba9-4cb9-a827-a70b6f427426 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:15.507630 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc37e2-3ba9-4cb9-a827-a70b6f427426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:15.507630 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc37e2-3ba9-4cb9-a827-a70b6f427426 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:15.508276 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-920c122d-6b55-4c3c-a07d-fc85a790c155 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:15.508276 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-920c122d-6b55-4c3c-a07d-fc85a790c155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:15.516292 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1053/2095] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:15.520503 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c122d-6b55-4c3c-a07d-fc85a790c155 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:15.531375 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c122d-6b55-4c3c-a07d-fc85a790c155 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:15.537021 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae62e2c-09f0-4a4a-9e6c-85891f3f5630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:15.537655 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae62e2c-09f0-4a4a-9e6c-85891f3f5630 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:15.537932 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae62e2c-09f0-4a4a-9e6c-85891f3f5630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:15.538203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae62e2c-09f0-4a4a-9e6c-85891f3f5630 admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:15.538857 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae62e2c-09f0-4a4a-9e6c-85891f3f5630 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:28:15.539618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae62e2c-09f0-4a4a-9e6c-85891f3f5630 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:15.540882 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae62e2c-09f0-4a4a-9e6c-85891f3f5630 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:15.554150 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1054/2096] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:28:15.558871 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae62e2c-09f0-4a4a-9e6c-85891f3f5630 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:15.569613 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae62e2c-09f0-4a4a-9e6c-85891f3f5630 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:15.574594 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78646613-1447-4123-b03f-f5011e2a1142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:15.575207 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78646613-1447-4123-b03f-f5011e2a1142 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:15.575513 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78646613-1447-4123-b03f-f5011e2a1142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:15.575789 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78646613-1447-4123-b03f-f5011e2a1142 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:15.576493 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78646613-1447-4123-b03f-f5011e2a1142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:15.578351 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78646613-1447-4123-b03f-f5011e2a1142 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:15.618308 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1043/2097] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:28:15 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:15.618308 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc37e2-3ba9-4cb9-a827-a70b6f427426 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:15.620168 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-58fc37e2-3ba9-4cb9-a827-a70b6f427426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:15.698822 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1055/2098] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:28:15 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:28:15.704025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78646613-1447-4123-b03f-f5011e2a1142 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:15.704269 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc37e2-3ba9-4cb9-a827-a70b6f427426 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:15.704356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-78646613-1447-4123-b03f-f5011e2a1142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:15.765965 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d10b5c-065f-4376-8b6b-ae7596e75479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:15.766893 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d10b5c-065f-4376-8b6b-ae7596e75479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:15.767168 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d10b5c-065f-4376-8b6b-ae7596e75479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:15.767493 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d10b5c-065f-4376-8b6b-ae7596e75479 admin admin] PATH_INFO: `/v3/users/9312d185e74b49bd99e02af6311a1636` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:15.768690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d10b5c-065f-4376-8b6b-ae7596e75479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9312d185e74b49bd99e02af6311a1636)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:15.770643 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d10b5c-065f-4376-8b6b-ae7596e75479 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:15.778030 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78646613-1447-4123-b03f-f5011e2a1142 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:15.782874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b18d9-2dfc-4779-ac95-172a43bbfc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:15.783522 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b18d9-2dfc-4779-ac95-172a43bbfc00 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:15.783811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b18d9-2dfc-4779-ac95-172a43bbfc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:15.784086 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b18d9-2dfc-4779-ac95-172a43bbfc00 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:15.784778 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b18d9-2dfc-4779-ac95-172a43bbfc00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:15.787312 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b18d9-2dfc-4779-ac95-172a43bbfc00 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:15.914267 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1056/2099] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:28:15 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:15.915166 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b18d9-2dfc-4779-ac95-172a43bbfc00 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:15.928950 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b18d9-2dfc-4779-ac95-172a43bbfc00 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:15.934488 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476be89-86bd-43f7-b72b-9ef194618ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:15.935130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476be89-86bd-43f7-b72b-9ef194618ecb admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:15.935379 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476be89-86bd-43f7-b72b-9ef194618ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:15.935686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476be89-86bd-43f7-b72b-9ef194618ecb admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:15.936316 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476be89-86bd-43f7-b72b-9ef194618ecb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:15.938263 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476be89-86bd-43f7-b72b-9ef194618ecb admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:15.961743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:16.035774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c1d10b5c-065f-4376-8b6b-ae7596e75479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9312d185e74b49bd99e02af6311a1636'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:16.039481 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1057/2100] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:28:15 2022] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:16.039481 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476be89-86bd-43f7-b72b-9ef194618ecb admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:16.040794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-1476be89-86bd-43f7-b72b-9ef194618ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:16.055656 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476be89-86bd-43f7-b72b-9ef194618ecb admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:16.063109 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176cf49-749a-4e38-be36-f90491552d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:16.063109 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176cf49-749a-4e38-be36-f90491552d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:16.063277 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176cf49-749a-4e38-be36-f90491552d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:16.063689 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176cf49-749a-4e38-be36-f90491552d7c admin admin] PATH_INFO: `/v3/projects/679accc8ece245d1a36df4d889982453` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:16.065058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176cf49-749a-4e38-be36-f90491552d7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=679accc8ece245d1a36df4d889982453)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:16.067402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176cf49-749a-4e38-be36-f90491552d7c admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:16.126757 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c1d10b5c-065f-4376-8b6b-ae7596e75479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9312d185e74b49bd99e02af6311a1636'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:16.128421 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c1d10b5c-065f-4376-8b6b-ae7596e75479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9312d185e74b49bd99e02af6311a1636'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:16.129260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c1d10b5c-065f-4376-8b6b-ae7596e75479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9312d185e74b49bd99e02af6311a1636'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:16.139296 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c1d10b5c-065f-4376-8b6b-ae7596e75479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9312d185e74b49bd99e02af6311a1636'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:16.162915 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1044/2101] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:28:15 2022] DELETE /identity/v3/users/9312d185e74b49bd99e02af6311a1636 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:16.164008 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d10b5c-065f-4376-8b6b-ae7596e75479 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:16.167109 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c1d10b5c-065f-4376-8b6b-ae7596e75479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:16.202332 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9176cf49-749a-4e38-be36-f90491552d7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '679accc8ece245d1a36df4d889982453', 'request_id': 'req-9176cf49-749a-4e38-be36-f90491552d7c'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:16.207838 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:16.216478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9176cf49-749a-4e38-be36-f90491552d7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '679accc8ece245d1a36df4d889982453', 'request_id': 'req-9176cf49-749a-4e38-be36-f90491552d7c'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:16.248194 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d10b5c-065f-4376-8b6b-ae7596e75479 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:16.318843 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb1f60-b884-48f5-b830-2779a71fcd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:16.319212 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb1f60-b884-48f5-b830-2779a71fcd5b admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:16.319419 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb1f60-b884-48f5-b830-2779a71fcd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:16.319730 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb1f60-b884-48f5-b830-2779a71fcd5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:16.320380 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb1f60-b884-48f5-b830-2779a71fcd5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:16.322005 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb1f60-b884-48f5-b830-2779a71fcd5b admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:16.329019 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9176cf49-749a-4e38-be36-f90491552d7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '679accc8ece245d1a36df4d889982453', 'request_id': 'req-9176cf49-749a-4e38-be36-f90491552d7c'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:16.334054 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1045/2102] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:16.335083 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb1f60-b884-48f5-b830-2779a71fcd5b admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:16.337718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-4efb1f60-b884-48f5-b830-2779a71fcd5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:16.345976 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9176cf49-749a-4e38-be36-f90491552d7c admin admin] The token cache is being invalidate because project 679accc8ece245d1a36df4d889982453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:16.346269 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9176cf49-749a-4e38-be36-f90491552d7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:16.346937 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9176cf49-749a-4e38-be36-f90491552d7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:16.352627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1058/2103] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:16 2022] DELETE /identity/v3/projects/679accc8ece245d1a36df4d889982453 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:16.352627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb31a96-a873-4947-aa7c-f88fe1497889 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:16.352627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb31a96-a873-4947-aa7c-f88fe1497889 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:16.352627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb31a96-a873-4947-aa7c-f88fe1497889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:16.353034 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb1f60-b884-48f5-b830-2779a71fcd5b admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:16.358329 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12251f96-6073-4da4-ad9c-49c4d57d7643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:16.358955 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12251f96-6073-4da4-ad9c-49c4d57d7643 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:16.359269 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12251f96-6073-4da4-ad9c-49c4d57d7643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:16.359538 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12251f96-6073-4da4-ad9c-49c4d57d7643 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:16.360184 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12251f96-6073-4da4-ad9c-49c4d57d7643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:16.361800 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12251f96-6073-4da4-ad9c-49c4d57d7643 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:16.372477 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-7cb31a96-a873-4947-aa7c-f88fe1497889 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:16.373724 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-7cb31a96-a873-4947-aa7c-f88fe1497889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:16.375492 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1046/2104] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:16.376325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12251f96-6073-4da4-ad9c-49c4d57d7643 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:16.378985 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-12251f96-6073-4da4-ad9c-49c4d57d7643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:16.382190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1059/2105] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:16.383022 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb31a96-a873-4947-aa7c-f88fe1497889 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:16.385172 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-7cb31a96-a873-4947-aa7c-f88fe1497889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:16.394240 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12251f96-6073-4da4-ad9c-49c4d57d7643 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:16.399546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cef52a-3ed3-470d-848f-79561e208604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:16.400281 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cef52a-3ed3-470d-848f-79561e208604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:16.400543 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cef52a-3ed3-470d-848f-79561e208604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:16.400815 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cef52a-3ed3-470d-848f-79561e208604 admin admin] PATH_INFO: `/v3/users/c195aa44405b41459119835210d82d59` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:16.401039 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb31a96-a873-4947-aa7c-f88fe1497889 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:16.402169 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cef52a-3ed3-470d-848f-79561e208604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c195aa44405b41459119835210d82d59)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:16.404146 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cef52a-3ed3-470d-848f-79561e208604 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:16.407103 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc81897-8b0a-4bff-bee7-5c4a61b42338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:16.407756 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc81897-8b0a-4bff-bee7-5c4a61b42338 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:16.408008 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc81897-8b0a-4bff-bee7-5c4a61b42338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:16.408899 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc81897-8b0a-4bff-bee7-5c4a61b42338 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:16.409551 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc81897-8b0a-4bff-bee7-5c4a61b42338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:16.411206 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc81897-8b0a-4bff-bee7-5c4a61b42338 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:16.422430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1060/2106] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:16.431152 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc81897-8b0a-4bff-bee7-5c4a61b42338 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:16.431152 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-2cc81897-8b0a-4bff-bee7-5c4a61b42338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:16.438711 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc81897-8b0a-4bff-bee7-5c4a61b42338 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:16.443782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0458f3-795d-4972-8661-f1db16b90014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:16.444414 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0458f3-795d-4972-8661-f1db16b90014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:16.444691 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0458f3-795d-4972-8661-f1db16b90014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:16.444961 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0458f3-795d-4972-8661-f1db16b90014 admin admin] PATH_INFO: `/v3/users/a9c570fc083843d489edc4a2c0dfca69` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:16.446603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0458f3-795d-4972-8661-f1db16b90014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9c570fc083843d489edc4a2c0dfca69)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:16.448697 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0458f3-795d-4972-8661-f1db16b90014 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:16.655248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-32cef52a-3ed3-470d-848f-79561e208604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c195aa44405b41459119835210d82d59'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:16.766115 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-db0458f3-795d-4972-8661-f1db16b90014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9c570fc083843d489edc4a2c0dfca69'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:16.795259 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-32cef52a-3ed3-470d-848f-79561e208604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c195aa44405b41459119835210d82d59'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:16.796090 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-32cef52a-3ed3-470d-848f-79561e208604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c195aa44405b41459119835210d82d59'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:16.796705 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-32cef52a-3ed3-470d-848f-79561e208604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c195aa44405b41459119835210d82d59'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:16.804579 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-32cef52a-3ed3-470d-848f-79561e208604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c195aa44405b41459119835210d82d59'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:16.823350 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1047/2107] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:28:16 2022] DELETE /identity/v3/users/c195aa44405b41459119835210d82d59 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:16.824217 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cef52a-3ed3-470d-848f-79561e208604 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:16.825571 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-32cef52a-3ed3-470d-848f-79561e208604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:16.894518 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cef52a-3ed3-470d-848f-79561e208604 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:16.903327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd396c-8ad1-4d1b-9cea-da863cc2cf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:16.904110 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd396c-8ad1-4d1b-9cea-da863cc2cf28 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:16.904306 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd396c-8ad1-4d1b-9cea-da863cc2cf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:16.904544 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd396c-8ad1-4d1b-9cea-da863cc2cf28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:16.905191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd396c-8ad1-4d1b-9cea-da863cc2cf28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:16.908565 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd396c-8ad1-4d1b-9cea-da863cc2cf28 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:16.922462 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1048/2108] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:16.922462 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd396c-8ad1-4d1b-9cea-da863cc2cf28 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:16.927187 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f7cd396c-8ad1-4d1b-9cea-da863cc2cf28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:16.944533 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-db0458f3-795d-4972-8661-f1db16b90014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9c570fc083843d489edc4a2c0dfca69'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:16.945307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-db0458f3-795d-4972-8661-f1db16b90014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9c570fc083843d489edc4a2c0dfca69'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:16.946039 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-db0458f3-795d-4972-8661-f1db16b90014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9c570fc083843d489edc4a2c0dfca69'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:16.954895 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-db0458f3-795d-4972-8661-f1db16b90014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9c570fc083843d489edc4a2c0dfca69'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:16.975626 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1061/2109] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:28:16 2022] DELETE /identity/v3/users/a9c570fc083843d489edc4a2c0dfca69 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:16.976587 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0458f3-795d-4972-8661-f1db16b90014 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:16.979632 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-db0458f3-795d-4972-8661-f1db16b90014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:16.991945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd396c-8ad1-4d1b-9cea-da863cc2cf28 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:17.061930 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc3bae-1819-4c17-a929-ce38b13b266a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:17.062716 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc3bae-1819-4c17-a929-ce38b13b266a service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:17.063001 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc3bae-1819-4c17-a929-ce38b13b266a service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:17.063272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc3bae-1819-4c17-a929-ce38b13b266a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:17.065287 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-69bc3bae-1819-4c17-a929-ce38b13b266a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:17.067069 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0458f3-795d-4972-8661-f1db16b90014 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:17.073842 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a56a6-8caa-43c5-95e5-a14054ffa87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:17.074071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a56a6-8caa-43c5-95e5-a14054ffa87b admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:17.074153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a56a6-8caa-43c5-95e5-a14054ffa87b admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:17.074407 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a56a6-8caa-43c5-95e5-a14054ffa87b admin admin] PATH_INFO: `/v3/projects/7dbb3b30525d4b86855e2a5fee70f8fc/users/18415bec9e6049b68da5676264361b52/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:17.080076 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc3bae-1819-4c17-a929-ce38b13b266a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:17.082899 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc3bae-1819-4c17-a929-ce38b13b266a service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:17.093144 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a56a6-8caa-43c5-95e5-a14054ffa87b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dbb3b30525d4b86855e2a5fee70f8fc, user_id=18415bec9e6049b68da5676264361b52, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:17.094351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1049/2110] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:28:17.095643 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7eb20e-e0e5-4b7c-a9bc-d790cb66c964 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:17.095951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a56a6-8caa-43c5-95e5-a14054ffa87b admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:17.096082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7eb20e-e0e5-4b7c-a9bc-d790cb66c964 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:17.096490 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7eb20e-e0e5-4b7c-a9bc-d790cb66c964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:17.116569 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-af7eb20e-e0e5-4b7c-a9bc-d790cb66c964 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:17.117808 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-af7eb20e-e0e5-4b7c-a9bc-d790cb66c964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:17.126112 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1050/2111] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:17.126919 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7eb20e-e0e5-4b7c-a9bc-d790cb66c964 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:17.128581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-af7eb20e-e0e5-4b7c-a9bc-d790cb66c964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:17.141574 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7eb20e-e0e5-4b7c-a9bc-d790cb66c964 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:17.147067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be4fce-cd9e-4115-9f53-fcfd66901f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:17.147552 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be4fce-cd9e-4115-9f53-fcfd66901f66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:17.147920 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be4fce-cd9e-4115-9f53-fcfd66901f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:17.148130 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be4fce-cd9e-4115-9f53-fcfd66901f66 admin admin] PATH_INFO: `/v3/projects/f417682e3dee4b36a017463034b61a3f/users/87d974bb5cf94567b1493fa54e804374/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:17.164707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be4fce-cd9e-4115-9f53-fcfd66901f66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f417682e3dee4b36a017463034b61a3f, user_id=87d974bb5cf94567b1493fa54e804374, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:17.167656 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be4fce-cd9e-4115-9f53-fcfd66901f66 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:17.190611 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1062/2112] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:16 2022] PUT /identity/v3/projects/7dbb3b30525d4b86855e2a5fee70f8fc/users/18415bec9e6049b68da5676264361b52/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:17.190611 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a56a6-8caa-43c5-95e5-a14054ffa87b admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:17.193710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-915a56a6-8caa-43c5-95e5-a14054ffa87b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:17.264448 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a56a6-8caa-43c5-95e5-a14054ffa87b admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:17.268337 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00774b65-07a9-446e-a390-c79ef5ad7c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:17.268957 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00774b65-07a9-446e-a390-c79ef5ad7c9f service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:17.269229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00774b65-07a9-446e-a390-c79ef5ad7c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:17.269499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00774b65-07a9-446e-a390-c79ef5ad7c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:17.283428 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1051/2113] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:17 2022] PUT /identity/v3/projects/f417682e3dee4b36a017463034b61a3f/users/87d974bb5cf94567b1493fa54e804374/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:17.285165 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3525d-e5cf-48df-865b-f5ba24998005 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:17.285605 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3525d-e5cf-48df-865b-f5ba24998005 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:17.287918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3525d-e5cf-48df-865b-f5ba24998005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:17.330762 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-66b3525d-e5cf-48df-865b-f5ba24998005 None None] MFA Rules not processed for user `18415bec9e6049b68da5676264361b52`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:17.332553 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-66b3525d-e5cf-48df-865b-f5ba24998005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:17.351143 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00774b65-07a9-446e-a390-c79ef5ad7c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:17.353624 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00774b65-07a9-446e-a390-c79ef5ad7c9f service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:17.370353 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1063/2114] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:28:17.372231 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a710d-82ea-446b-a302-7d8dfd42173f None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:17.372697 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a710d-82ea-446b-a302-7d8dfd42173f None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:17.380095 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a710d-82ea-446b-a302-7d8dfd42173f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:17.400081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-377a710d-82ea-446b-a302-7d8dfd42173f None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:17.401988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-377a710d-82ea-446b-a302-7d8dfd42173f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:17.427254 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1052/2115] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:17.432351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3525d-e5cf-48df-865b-f5ba24998005 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:17.492973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1064/2116] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:17.513164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a710d-82ea-446b-a302-7d8dfd42173f None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:17.516160 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-377a710d-82ea-446b-a302-7d8dfd42173f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:17.537744 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3525d-e5cf-48df-865b-f5ba24998005 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:17.542680 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94e8c7-983e-42e5-bd62-18dd42a5f130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:17.543308 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94e8c7-983e-42e5-bd62-18dd42a5f130 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:17.543614 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94e8c7-983e-42e5-bd62-18dd42a5f130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:17.543886 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94e8c7-983e-42e5-bd62-18dd42a5f130 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:17.544536 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94e8c7-983e-42e5-bd62-18dd42a5f130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:17.546884 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94e8c7-983e-42e5-bd62-18dd42a5f130 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:17.611213 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a710d-82ea-446b-a302-7d8dfd42173f None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:17.614973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab811b-eef1-410b-acd4-1654dc7fb696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:17.615616 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab811b-eef1-410b-acd4-1654dc7fb696 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:17.615893 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab811b-eef1-410b-acd4-1654dc7fb696 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:17.616163 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab811b-eef1-410b-acd4-1654dc7fb696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:17.625767 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab811b-eef1-410b-acd4-1654dc7fb696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:17.627203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab811b-eef1-410b-acd4-1654dc7fb696 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:17.638062 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1065/2117] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:28:17.690061 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab811b-eef1-410b-acd4-1654dc7fb696 service neutron] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:17.696444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1053/2118] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:28:17 2022] POST /identity/v3/projects => generated 385 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:28:17.696720 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-dfab811b-eef1-410b-acd4-1654dc7fb696 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:17.697674 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94e8c7-983e-42e5-bd62-18dd42a5f130 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:17.725168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab811b-eef1-410b-acd4-1654dc7fb696 service neutron] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:17.785790 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94e8c7-983e-42e5-bd62-18dd42a5f130 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:17.792255 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68496ed-ef5e-4154-bb4a-2420913af64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:17.793093 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68496ed-ef5e-4154-bb4a-2420913af64b admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:17.793384 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68496ed-ef5e-4154-bb4a-2420913af64b admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:17.793663 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68496ed-ef5e-4154-bb4a-2420913af64b admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:17.794422 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68496ed-ef5e-4154-bb4a-2420913af64b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:17.796480 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68496ed-ef5e-4154-bb4a-2420913af64b admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:17.821860 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c0b1a-4284-4e54-b140-90e768010df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:17.822510 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c0b1a-4284-4e54-b140-90e768010df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:17.822785 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c0b1a-4284-4e54-b140-90e768010df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:17.823060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c0b1a-4284-4e54-b140-90e768010df0 admin admin] PATH_INFO: `/v3/projects/05711d4a883d4c509863d73daa90191b` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:17.824280 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c0b1a-4284-4e54-b140-90e768010df0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05711d4a883d4c509863d73daa90191b)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:17.828892 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c0b1a-4284-4e54-b140-90e768010df0 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:17.894215 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:17.927929 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1054/2119] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:28:17 2022] POST /identity/v3/users => generated 299 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:17.928881 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68496ed-ef5e-4154-bb4a-2420913af64b admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:17.930648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-a68496ed-ef5e-4154-bb4a-2420913af64b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:17.945229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68496ed-ef5e-4154-bb4a-2420913af64b admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:17.954922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f5595-bfdf-41f7-b730-a23fe9e6e8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:17.957511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f5595-bfdf-41f7-b730-a23fe9e6e8df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:17.957511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f5595-bfdf-41f7-b730-a23fe9e6e8df admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:17.957511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f5595-bfdf-41f7-b730-a23fe9e6e8df admin admin] PATH_INFO: `/v3/projects/778637a20f3c465495a99e00fe21dc2a` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:17.957511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f5595-bfdf-41f7-b730-a23fe9e6e8df admin admin] RBAC: Authorizing `identity:delete_project(project_id=778637a20f3c465495a99e00fe21dc2a)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:17.966279 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f5595-bfdf-41f7-b730-a23fe9e6e8df admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:18.013588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-7d0c0b1a-4284-4e54-b140-90e768010df0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05711d4a883d4c509863d73daa90191b', 'request_id': 'req-7d0c0b1a-4284-4e54-b140-90e768010df0'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:18.021473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-7d0c0b1a-4284-4e54-b140-90e768010df0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05711d4a883d4c509863d73daa90191b', 'request_id': 'req-7d0c0b1a-4284-4e54-b140-90e768010df0'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:18.189849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-7d0c0b1a-4284-4e54-b140-90e768010df0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05711d4a883d4c509863d73daa90191b', 'request_id': 'req-7d0c0b1a-4284-4e54-b140-90e768010df0'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:18.201916 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-7d0c0b1a-4284-4e54-b140-90e768010df0 admin admin] The token cache is being invalidate because project 05711d4a883d4c509863d73daa90191b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:18.202204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-7d0c0b1a-4284-4e54-b140-90e768010df0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:18.202867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-7d0c0b1a-4284-4e54-b140-90e768010df0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:18.204611 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1066/2120] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:17 2022] DELETE /identity/v3/projects/05711d4a883d4c509863d73daa90191b => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:18.210003 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c0b1a-4284-4e54-b140-90e768010df0 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:18.210608 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-117f5595-bfdf-41f7-b730-a23fe9e6e8df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '778637a20f3c465495a99e00fe21dc2a', 'request_id': 'req-117f5595-bfdf-41f7-b730-a23fe9e6e8df'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:18.211464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-7d0c0b1a-4284-4e54-b140-90e768010df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:18.218441 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-117f5595-bfdf-41f7-b730-a23fe9e6e8df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '778637a20f3c465495a99e00fe21dc2a', 'request_id': 'req-117f5595-bfdf-41f7-b730-a23fe9e6e8df'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:18.279003 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c0b1a-4284-4e54-b140-90e768010df0 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:18.341127 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d61ad-ac75-4634-a321-a460ef1ab191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:18.341857 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d61ad-ac75-4634-a321-a460ef1ab191 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:18.342147 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d61ad-ac75-4634-a321-a460ef1ab191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:18.342425 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d61ad-ac75-4634-a321-a460ef1ab191 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:18.343088 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d61ad-ac75-4634-a321-a460ef1ab191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:18.345037 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d61ad-ac75-4634-a321-a460ef1ab191 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:18.349511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-117f5595-bfdf-41f7-b730-a23fe9e6e8df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '778637a20f3c465495a99e00fe21dc2a', 'request_id': 'req-117f5595-bfdf-41f7-b730-a23fe9e6e8df'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:18.364219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-117f5595-bfdf-41f7-b730-a23fe9e6e8df admin admin] The token cache is being invalidate because project 778637a20f3c465495a99e00fe21dc2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:18.365398 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-117f5595-bfdf-41f7-b730-a23fe9e6e8df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:18.366108 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-117f5595-bfdf-41f7-b730-a23fe9e6e8df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:18.369501 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1067/2121] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:18.369501 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d61ad-ac75-4634-a321-a460ef1ab191 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:18.369501 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-c42d61ad-ac75-4634-a321-a460ef1ab191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:18.371797 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1055/2122] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:17 2022] DELETE /identity/v3/projects/778637a20f3c465495a99e00fe21dc2a => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:18.373062 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e7957-dedb-4211-b7d3-a4a4445a9276 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:18.373358 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e7957-dedb-4211-b7d3-a4a4445a9276 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:18.373628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e7957-dedb-4211-b7d3-a4a4445a9276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:18.386117 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d61ad-ac75-4634-a321-a460ef1ab191 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:18.392038 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87decb9-837f-49d7-b2fd-370af6ab9e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:18.392702 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87decb9-837f-49d7-b2fd-370af6ab9e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:18.392984 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87decb9-837f-49d7-b2fd-370af6ab9e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:18.393386 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87decb9-837f-49d7-b2fd-370af6ab9e8e admin admin] PATH_INFO: `/v3/projects/6e83a468349f48a397a385f3ec241bdb` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:18.394612 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87decb9-837f-49d7-b2fd-370af6ab9e8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e83a468349f48a397a385f3ec241bdb)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:18.396745 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87decb9-837f-49d7-b2fd-370af6ab9e8e admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:18.408976 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-809e7957-dedb-4211-b7d3-a4a4445a9276 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:18.410529 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-809e7957-dedb-4211-b7d3-a4a4445a9276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:18.423229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1056/2123] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:18.424368 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e7957-dedb-4211-b7d3-a4a4445a9276 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:18.426462 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-809e7957-dedb-4211-b7d3-a4a4445a9276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:18.451386 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e7957-dedb-4211-b7d3-a4a4445a9276 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:18.456710 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a190a70-7bbe-4f26-851e-c1e94aff2973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:18.457378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a190a70-7bbe-4f26-851e-c1e94aff2973 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:18.457660 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a190a70-7bbe-4f26-851e-c1e94aff2973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:18.457935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a190a70-7bbe-4f26-851e-c1e94aff2973 admin admin] PATH_INFO: `/v3/projects/0cc614b7910949c09f61bb48305e0db2/users/59f48bceaeb747528a9155fb01d12391/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:18.497531 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a190a70-7bbe-4f26-851e-c1e94aff2973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cc614b7910949c09f61bb48305e0db2, user_id=59f48bceaeb747528a9155fb01d12391, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:18.508232 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a190a70-7bbe-4f26-851e-c1e94aff2973 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:18.524451 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-a87decb9-837f-49d7-b2fd-370af6ab9e8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e83a468349f48a397a385f3ec241bdb', 'request_id': 'req-a87decb9-837f-49d7-b2fd-370af6ab9e8e'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:18.540758 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-a87decb9-837f-49d7-b2fd-370af6ab9e8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e83a468349f48a397a385f3ec241bdb', 'request_id': 'req-a87decb9-837f-49d7-b2fd-370af6ab9e8e'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:18.584554 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:18.612870 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-a87decb9-837f-49d7-b2fd-370af6ab9e8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e83a468349f48a397a385f3ec241bdb', 'request_id': 'req-a87decb9-837f-49d7-b2fd-370af6ab9e8e'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:18.619768 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1057/2124] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:18 2022] PUT /identity/v3/projects/0cc614b7910949c09f61bb48305e0db2/users/59f48bceaeb747528a9155fb01d12391/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:18.624223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a190a70-7bbe-4f26-851e-c1e94aff2973 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:18.628549 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-7a190a70-7bbe-4f26-851e-c1e94aff2973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:18.641533 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-a87decb9-837f-49d7-b2fd-370af6ab9e8e admin admin] The token cache is being invalidate because project 6e83a468349f48a397a385f3ec241bdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:18.645328 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-a87decb9-837f-49d7-b2fd-370af6ab9e8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:18.645328 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-a87decb9-837f-49d7-b2fd-370af6ab9e8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:18.648048 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1068/2125] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:18 2022] DELETE /identity/v3/projects/6e83a468349f48a397a385f3ec241bdb => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:18.648982 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28216d8e-c561-44d3-a088-05d06028f073 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:18.649259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28216d8e-c561-44d3-a088-05d06028f073 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:18.649523 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28216d8e-c561-44d3-a088-05d06028f073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:18.691383 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-28216d8e-c561-44d3-a088-05d06028f073 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:18.691957 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-28216d8e-c561-44d3-a088-05d06028f073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:18.727760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a190a70-7bbe-4f26-851e-c1e94aff2973 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:18.733511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea51310-8dfa-4282-b92f-c8a35e31134c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:18.734157 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea51310-8dfa-4282-b92f-c8a35e31134c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:18.734586 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea51310-8dfa-4282-b92f-c8a35e31134c admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:18.734867 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea51310-8dfa-4282-b92f-c8a35e31134c admin admin] PATH_INFO: `/v3/users/1a2f297d928c4afa9f69814426c6bbdc` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:18.736213 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea51310-8dfa-4282-b92f-c8a35e31134c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a2f297d928c4afa9f69814426c6bbdc)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:18.742923 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea51310-8dfa-4282-b92f-c8a35e31134c admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:18.771894 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1069/2126] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:18.772926 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28216d8e-c561-44d3-a088-05d06028f073 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:18.774270 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-28216d8e-c561-44d3-a088-05d06028f073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:18.786520 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28216d8e-c561-44d3-a088-05d06028f073 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:18.791234 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe9f3f-8718-4687-8fc1-c24efc85def0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:18.791878 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe9f3f-8718-4687-8fc1-c24efc85def0 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:18.792156 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe9f3f-8718-4687-8fc1-c24efc85def0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:18.792425 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe9f3f-8718-4687-8fc1-c24efc85def0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:18.793067 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe9f3f-8718-4687-8fc1-c24efc85def0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:18.794693 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe9f3f-8718-4687-8fc1-c24efc85def0 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:18.806423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1070/2127] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:18.807292 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe9f3f-8718-4687-8fc1-c24efc85def0 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:18.811016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-14fe9f3f-8718-4687-8fc1-c24efc85def0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:18.824381 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe9f3f-8718-4687-8fc1-c24efc85def0 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:18.830103 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6ed20-97c5-465b-aba7-004aa12eeca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:18.830753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6ed20-97c5-465b-aba7-004aa12eeca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:18.834007 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6ed20-97c5-465b-aba7-004aa12eeca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:18.834007 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6ed20-97c5-465b-aba7-004aa12eeca2 admin admin] PATH_INFO: `/v3/users/ded2d677cbb34445ae4a6109ee35e140` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:18.834007 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb6ed20-97c5-465b-aba7-004aa12eeca2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ded2d677cbb34445ae4a6109ee35e140)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:18.834740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb6ed20-97c5-465b-aba7-004aa12eeca2 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:19.033553 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-2ea51310-8dfa-4282-b92f-c8a35e31134c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a2f297d928c4afa9f69814426c6bbdc'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:19.127027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-eeb6ed20-97c5-465b-aba7-004aa12eeca2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ded2d677cbb34445ae4a6109ee35e140'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:19.137945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-2ea51310-8dfa-4282-b92f-c8a35e31134c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a2f297d928c4afa9f69814426c6bbdc'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:19.138574 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-2ea51310-8dfa-4282-b92f-c8a35e31134c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a2f297d928c4afa9f69814426c6bbdc'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:19.139168 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-2ea51310-8dfa-4282-b92f-c8a35e31134c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a2f297d928c4afa9f69814426c6bbdc'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:19.146662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-2ea51310-8dfa-4282-b92f-c8a35e31134c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a2f297d928c4afa9f69814426c6bbdc'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:19.165942 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1058/2128] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:28:18 2022] DELETE /identity/v3/users/1a2f297d928c4afa9f69814426c6bbdc => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:19.166783 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea51310-8dfa-4282-b92f-c8a35e31134c admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:19.168267 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-2ea51310-8dfa-4282-b92f-c8a35e31134c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:19.240089 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-eeb6ed20-97c5-465b-aba7-004aa12eeca2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ded2d677cbb34445ae4a6109ee35e140'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:19.241298 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-eeb6ed20-97c5-465b-aba7-004aa12eeca2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ded2d677cbb34445ae4a6109ee35e140'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:19.242609 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-eeb6ed20-97c5-465b-aba7-004aa12eeca2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ded2d677cbb34445ae4a6109ee35e140'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:19.253062 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea51310-8dfa-4282-b92f-c8a35e31134c admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:19.257661 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-eeb6ed20-97c5-465b-aba7-004aa12eeca2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ded2d677cbb34445ae4a6109ee35e140'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:19.259309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6e033-8f54-4691-8200-5739629a8693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:19.260262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6e033-8f54-4691-8200-5739629a8693 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:19.260493 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6e033-8f54-4691-8200-5739629a8693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:19.261093 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6e033-8f54-4691-8200-5739629a8693 admin admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:19.261871 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6e033-8f54-4691-8200-5739629a8693 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:28:19.262262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6e033-8f54-4691-8200-5739629a8693 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:19.264077 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6e033-8f54-4691-8200-5739629a8693 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:19.279907 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1059/2129] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:28:19.284492 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6e033-8f54-4691-8200-5739629a8693 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:19.287136 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-dcb6e033-8f54-4691-8200-5739629a8693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:19.292734 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1071/2130] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:28:18 2022] DELETE /identity/v3/users/ded2d677cbb34445ae4a6109ee35e140 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:19.293720 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6ed20-97c5-465b-aba7-004aa12eeca2 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:19.296383 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-eeb6ed20-97c5-465b-aba7-004aa12eeca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:19.316266 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6e033-8f54-4691-8200-5739629a8693 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:19.387382 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6ed20-97c5-465b-aba7-004aa12eeca2 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:19.394846 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfced7-31e7-4e11-ba96-e460b217afeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:19.399500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfced7-31e7-4e11-ba96-e460b217afeb admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:19.399500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfced7-31e7-4e11-ba96-e460b217afeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:19.399500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfced7-31e7-4e11-ba96-e460b217afeb admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:19.399500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfced7-31e7-4e11-ba96-e460b217afeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:19.401222 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfced7-31e7-4e11-ba96-e460b217afeb admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:19.432814 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af3321-fb35-4276-b82d-99beb45cd322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:19.433958 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af3321-fb35-4276-b82d-99beb45cd322 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:19.434248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af3321-fb35-4276-b82d-99beb45cd322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:19.434575 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af3321-fb35-4276-b82d-99beb45cd322 admin admin] PATH_INFO: `/v3/projects/0cc614b7910949c09f61bb48305e0db2/users/59f48bceaeb747528a9155fb01d12391/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:19.437282 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af3321-fb35-4276-b82d-99beb45cd322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cc614b7910949c09f61bb48305e0db2, user_id=59f48bceaeb747528a9155fb01d12391, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:19.440961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af3321-fb35-4276-b82d-99beb45cd322 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:19.457029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1060/2131] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:19 2022] PUT /identity/v3/projects/0cc614b7910949c09f61bb48305e0db2/users/59f48bceaeb747528a9155fb01d12391/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:19.479343 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a026f-c91e-4ac0-8e46-ee2efa68a0f5 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:19.479585 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a026f-c91e-4ac0-8e46-ee2efa68a0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:19.479868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a026f-c91e-4ac0-8e46-ee2efa68a0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:19.520496 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-ce7a026f-c91e-4ac0-8e46-ee2efa68a0f5 None None] MFA Rules not processed for user `59f48bceaeb747528a9155fb01d12391`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:19.522383 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-ce7a026f-c91e-4ac0-8e46-ee2efa68a0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:19.580121 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1072/2132] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:28:19 2022] POST /identity/v3/projects => generated 381 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:19.592353 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfced7-31e7-4e11-ba96-e460b217afeb admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:19.656176 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1061/2133] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:19.672631 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a026f-c91e-4ac0-8e46-ee2efa68a0f5 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:19.674060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-ce7a026f-c91e-4ac0-8e46-ee2efa68a0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:19.753161 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfced7-31e7-4e11-ba96-e460b217afeb admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:19.761154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c98cf-d73a-4ebc-88d0-647bbd98b20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:19.763407 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c98cf-d73a-4ebc-88d0-647bbd98b20b admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:19.764478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c98cf-d73a-4ebc-88d0-647bbd98b20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:19.765329 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c98cf-d73a-4ebc-88d0-647bbd98b20b admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:19.766131 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c98cf-d73a-4ebc-88d0-647bbd98b20b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:19.769544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c98cf-d73a-4ebc-88d0-647bbd98b20b admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:19.805374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a026f-c91e-4ac0-8e46-ee2efa68a0f5 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:19.885741 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea6328-19d2-444a-986d-cb561c72ff5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:19.886622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea6328-19d2-444a-986d-cb561c72ff5a service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:19.886969 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea6328-19d2-444a-986d-cb561c72ff5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:19.887268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea6328-19d2-444a-986d-cb561c72ff5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:19.889583 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-bbea6328-19d2-444a-986d-cb561c72ff5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:19.962000 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea6328-19d2-444a-986d-cb561c72ff5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:19.963941 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea6328-19d2-444a-986d-cb561c72ff5a service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:19.975104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1062/2134] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:28:20.042152 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea6328-19d2-444a-986d-cb561c72ff5a service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:20.044790 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-bbea6328-19d2-444a-986d-cb561c72ff5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:20.050286 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1073/2135] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:28:19 2022] POST /identity/v3/users => generated 291 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:20.053338 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c98cf-d73a-4ebc-88d0-647bbd98b20b admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:20.076659 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c98cf-d73a-4ebc-88d0-647bbd98b20b admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:20.084437 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33bb5d-9c37-44b4-9cb5-8e17979b689b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:20.085352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33bb5d-9c37-44b4-9cb5-8e17979b689b admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:20.085778 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33bb5d-9c37-44b4-9cb5-8e17979b689b admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:20.086197 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33bb5d-9c37-44b4-9cb5-8e17979b689b admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:20.087006 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33bb5d-9c37-44b4-9cb5-8e17979b689b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:20.088393 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea6328-19d2-444a-986d-cb561c72ff5a service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:20.089133 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33bb5d-9c37-44b4-9cb5-8e17979b689b admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:20.105418 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1074/2136] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:20.106682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33bb5d-9c37-44b4-9cb5-8e17979b689b admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:20.116083 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25aeec-ac34-4e5c-b007-f808d2e14dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:20.117976 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25aeec-ac34-4e5c-b007-f808d2e14dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:20.118221 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25aeec-ac34-4e5c-b007-f808d2e14dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:20.119299 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25aeec-ac34-4e5c-b007-f808d2e14dc0 admin admin] PATH_INFO: `/v3/projects/8c725cd8954a47a9a5263ccd49bbac11` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:20.121062 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33bb5d-9c37-44b4-9cb5-8e17979b689b admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:20.123652 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25aeec-ac34-4e5c-b007-f808d2e14dc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c725cd8954a47a9a5263ccd49bbac11)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:20.136946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88a0ff-ad99-43f2-a901-1e7ac9f4f609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:20.141086 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88a0ff-ad99-43f2-a901-1e7ac9f4f609 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:20.141086 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88a0ff-ad99-43f2-a901-1e7ac9f4f609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:20.141086 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88a0ff-ad99-43f2-a901-1e7ac9f4f609 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:20.141086 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88a0ff-ad99-43f2-a901-1e7ac9f4f609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:20.141558 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25aeec-ac34-4e5c-b007-f808d2e14dc0 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:20.141701 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88a0ff-ad99-43f2-a901-1e7ac9f4f609 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:20.160366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1075/2137] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:20.161175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88a0ff-ad99-43f2-a901-1e7ac9f4f609 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:20.172375 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88a0ff-ad99-43f2-a901-1e7ac9f4f609 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:20.181768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab49749-fcce-4aea-9bd3-8af607fef79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:20.181930 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab49749-fcce-4aea-9bd3-8af607fef79b admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:20.182160 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab49749-fcce-4aea-9bd3-8af607fef79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:20.182445 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab49749-fcce-4aea-9bd3-8af607fef79b admin admin] PATH_INFO: `/v3/projects/3fb582d089de4ae6b26b132017a60751/users/0d2f2297b750418bb5a1a4afb785eede/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:20.205918 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab49749-fcce-4aea-9bd3-8af607fef79b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fb582d089de4ae6b26b132017a60751, user_id=0d2f2297b750418bb5a1a4afb785eede, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:20.209924 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab49749-fcce-4aea-9bd3-8af607fef79b admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:20.262685 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:20.315375 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1076/2138] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:20 2022] PUT /identity/v3/projects/3fb582d089de4ae6b26b132017a60751/users/0d2f2297b750418bb5a1a4afb785eede/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:20.316430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab49749-fcce-4aea-9bd3-8af607fef79b admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:20.328454 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-eab49749-fcce-4aea-9bd3-8af607fef79b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:20.343328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-aa25aeec-ac34-4e5c-b007-f808d2e14dc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c725cd8954a47a9a5263ccd49bbac11', 'request_id': 'req-aa25aeec-ac34-4e5c-b007-f808d2e14dc0'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:20.351318 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-aa25aeec-ac34-4e5c-b007-f808d2e14dc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c725cd8954a47a9a5263ccd49bbac11', 'request_id': 'req-aa25aeec-ac34-4e5c-b007-f808d2e14dc0'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:20.416568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab49749-fcce-4aea-9bd3-8af607fef79b admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:20.463404 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-aa25aeec-ac34-4e5c-b007-f808d2e14dc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c725cd8954a47a9a5263ccd49bbac11', 'request_id': 'req-aa25aeec-ac34-4e5c-b007-f808d2e14dc0'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:20.477324 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-aa25aeec-ac34-4e5c-b007-f808d2e14dc0 admin admin] The token cache is being invalidate because project 8c725cd8954a47a9a5263ccd49bbac11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:20.477678 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-aa25aeec-ac34-4e5c-b007-f808d2e14dc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:20.478403 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-aa25aeec-ac34-4e5c-b007-f808d2e14dc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:20.480594 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1063/2139] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:20 2022] DELETE /identity/v3/projects/8c725cd8954a47a9a5263ccd49bbac11 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:20.481851 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b75a7-edaa-45bd-bc64-1023f45929dd None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:20.482132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b75a7-edaa-45bd-bc64-1023f45929dd None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:20.482409 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b75a7-edaa-45bd-bc64-1023f45929dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:20.496946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e548e6-ec15-49cc-9cac-2a205182fc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:20.497612 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e548e6-ec15-49cc-9cac-2a205182fc8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:20.497886 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e548e6-ec15-49cc-9cac-2a205182fc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:20.503499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e548e6-ec15-49cc-9cac-2a205182fc8b admin admin] PATH_INFO: `/v3/projects/22e5a4d483174e4aae6912da2e51a72c` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:20.503499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e548e6-ec15-49cc-9cac-2a205182fc8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=22e5a4d483174e4aae6912da2e51a72c)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:20.503499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e548e6-ec15-49cc-9cac-2a205182fc8b admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:20.512692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-f41b75a7-edaa-45bd-bc64-1023f45929dd None None] MFA Rules not processed for user `0d2f2297b750418bb5a1a4afb785eede`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:20.513924 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f41b75a7-edaa-45bd-bc64-1023f45929dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:20.531656 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:20.615518 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1064/2140] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:20.617955 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98bee7-0df1-4b12-b5a9-af006ed9a5ed None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:20.617955 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98bee7-0df1-4b12-b5a9-af006ed9a5ed None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:20.617955 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98bee7-0df1-4b12-b5a9-af006ed9a5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:20.646767 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-8a98bee7-0df1-4b12-b5a9-af006ed9a5ed None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:20.648134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-8a98bee7-0df1-4b12-b5a9-af006ed9a5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:20.658708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1065/2141] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:20.666856 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98bee7-0df1-4b12-b5a9-af006ed9a5ed None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:20.668618 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-8a98bee7-0df1-4b12-b5a9-af006ed9a5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:20.682788 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98bee7-0df1-4b12-b5a9-af006ed9a5ed None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:20.698706 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-16e548e6-ec15-49cc-9cac-2a205182fc8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22e5a4d483174e4aae6912da2e51a72c', 'request_id': 'req-16e548e6-ec15-49cc-9cac-2a205182fc8b'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:20.712027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-16e548e6-ec15-49cc-9cac-2a205182fc8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22e5a4d483174e4aae6912da2e51a72c', 'request_id': 'req-16e548e6-ec15-49cc-9cac-2a205182fc8b'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:20.812766 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-16e548e6-ec15-49cc-9cac-2a205182fc8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22e5a4d483174e4aae6912da2e51a72c', 'request_id': 'req-16e548e6-ec15-49cc-9cac-2a205182fc8b'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:20.840818 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-16e548e6-ec15-49cc-9cac-2a205182fc8b admin admin] The token cache is being invalidate because project 22e5a4d483174e4aae6912da2e51a72c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:20.841147 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-16e548e6-ec15-49cc-9cac-2a205182fc8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:20.842893 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-16e548e6-ec15-49cc-9cac-2a205182fc8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:20.846429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1077/2142] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:20 2022] DELETE /identity/v3/projects/22e5a4d483174e4aae6912da2e51a72c => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:20.848402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3c870-d8a7-4c92-8af9-98fe12cf6ff5 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:20.853767 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3c870-d8a7-4c92-8af9-98fe12cf6ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:20.853767 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3c870-d8a7-4c92-8af9-98fe12cf6ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:20.860852 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb55be-4c00-4c09-ad75-72bf8f19180c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:20.861708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb55be-4c00-4c09-ad75-72bf8f19180c admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:20.862125 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb55be-4c00-4c09-ad75-72bf8f19180c admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:20.862409 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb55be-4c00-4c09-ad75-72bf8f19180c admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:20.863185 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb55be-4c00-4c09-ad75-72bf8f19180c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:20.866609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb55be-4c00-4c09-ad75-72bf8f19180c admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:20.909694 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-c9c3c870-d8a7-4c92-8af9-98fe12cf6ff5 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:20.911074 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-c9c3c870-d8a7-4c92-8af9-98fe12cf6ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:20.959319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1078/2143] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:20.965042 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcf08e-c9e3-4495-9301-16d67af3e303 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:20.966163 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcf08e-c9e3-4495-9301-16d67af3e303 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:20.967118 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcf08e-c9e3-4495-9301-16d67af3e303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:21.006201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-a6bcf08e-c9e3-4495-9301-16d67af3e303 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:21.010258 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-a6bcf08e-c9e3-4495-9301-16d67af3e303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:21.025415 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1079/2144] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:21.027579 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcf08e-c9e3-4495-9301-16d67af3e303 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:21.040706 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcf08e-c9e3-4495-9301-16d67af3e303 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:21.055236 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4d6b5-7831-4ed7-9e36-9d13c1a58c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:21.056353 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4d6b5-7831-4ed7-9e36-9d13c1a58c79 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:21.056815 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4d6b5-7831-4ed7-9e36-9d13c1a58c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:21.057279 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4d6b5-7831-4ed7-9e36-9d13c1a58c79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:21.058096 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4d6b5-7831-4ed7-9e36-9d13c1a58c79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:28:21.058798 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4d6b5-7831-4ed7-9e36-9d13c1a58c79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:21.061589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4d6b5-7831-4ed7-9e36-9d13c1a58c79 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:21.068106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1066/2145] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:28:20 2022] POST /identity/v3/projects => generated 383 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:21.076552 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d83acd-0fb5-4107-b22b-90635320fd64 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:21.079339 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d83acd-0fb5-4107-b22b-90635320fd64 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:21.082001 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d83acd-0fb5-4107-b22b-90635320fd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:21.082641 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1080/2146] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:28:21.084542 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4d6b5-7831-4ed7-9e36-9d13c1a58c79 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:21.088091 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-e1d4d6b5-7831-4ed7-9e36-9d13c1a58c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:21.118455 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4d6b5-7831-4ed7-9e36-9d13c1a58c79 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:21.132289 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-34d83acd-0fb5-4107-b22b-90635320fd64 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:21.134358 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-34d83acd-0fb5-4107-b22b-90635320fd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:21.252521 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1067/2147] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:21.253740 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d83acd-0fb5-4107-b22b-90635320fd64 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:21.267304 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d83acd-0fb5-4107-b22b-90635320fd64 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:21.278570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52111f3a-9bed-489c-81d5-bc4f7f851871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:21.279498 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52111f3a-9bed-489c-81d5-bc4f7f851871 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:21.279694 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52111f3a-9bed-489c-81d5-bc4f7f851871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:21.280142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52111f3a-9bed-489c-81d5-bc4f7f851871 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:21.285838 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52111f3a-9bed-489c-81d5-bc4f7f851871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:21.285838 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52111f3a-9bed-489c-81d5-bc4f7f851871 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:21.287757 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eebc46-7d36-4fee-a3cb-a102e67fddce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:21.289137 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eebc46-7d36-4fee-a3cb-a102e67fddce admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:21.289137 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eebc46-7d36-4fee-a3cb-a102e67fddce admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:21.289137 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eebc46-7d36-4fee-a3cb-a102e67fddce admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:21.289686 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eebc46-7d36-4fee-a3cb-a102e67fddce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:21.292108 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eebc46-7d36-4fee-a3cb-a102e67fddce admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:21.449394 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1081/2148] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:28:21 2022] POST /identity/v3/users => generated 298 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:21.450695 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52111f3a-9bed-489c-81d5-bc4f7f851871 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:21.453784 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1068/2149] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:28:21 2022] POST /identity/v3/projects => generated 373 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:21.453784 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eebc46-7d36-4fee-a3cb-a102e67fddce admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:21.473667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52111f3a-9bed-489c-81d5-bc4f7f851871 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:21.563382 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85593dc-b419-49ce-a1a6-d5521e292675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:21.564202 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85593dc-b419-49ce-a1a6-d5521e292675 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:21.564482 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85593dc-b419-49ce-a1a6-d5521e292675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:21.564753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85593dc-b419-49ce-a1a6-d5521e292675 admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:21.565640 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85593dc-b419-49ce-a1a6-d5521e292675 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:28:21.565947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85593dc-b419-49ce-a1a6-d5521e292675 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:21.568298 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85593dc-b419-49ce-a1a6-d5521e292675 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:21.586898 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eebc46-7d36-4fee-a3cb-a102e67fddce admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:21.597254 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d07b4f-d036-4456-9524-955578dedc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:21.598273 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d07b4f-d036-4456-9524-955578dedc7c admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:21.598830 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d07b4f-d036-4456-9524-955578dedc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:21.599290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d07b4f-d036-4456-9524-955578dedc7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:21.600508 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d07b4f-d036-4456-9524-955578dedc7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:21.602625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d07b4f-d036-4456-9524-955578dedc7c admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:21.604649 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1082/2150] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:28:21.605565 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85593dc-b419-49ce-a1a6-d5521e292675 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:21.624070 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1069/2151] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:21.625420 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85593dc-b419-49ce-a1a6-d5521e292675 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:21.626631 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d07b4f-d036-4456-9524-955578dedc7c admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:21.641100 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb86ae3-75f6-477c-ac86-f7b5048b536c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:21.641746 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb86ae3-75f6-477c-ac86-f7b5048b536c admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:21.642028 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb86ae3-75f6-477c-ac86-f7b5048b536c admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:21.642455 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb86ae3-75f6-477c-ac86-f7b5048b536c admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:21.644392 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb86ae3-75f6-477c-ac86-f7b5048b536c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:21.647300 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb86ae3-75f6-477c-ac86-f7b5048b536c admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:21.658905 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d07b4f-d036-4456-9524-955578dedc7c admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:21.666739 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a5062-71e2-46f5-b586-971ec369a695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:21.667531 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a5062-71e2-46f5-b586-971ec369a695 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:21.668896 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a5062-71e2-46f5-b586-971ec369a695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:21.668896 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a5062-71e2-46f5-b586-971ec369a695 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:21.669160 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a5062-71e2-46f5-b586-971ec369a695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:21.671302 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a5062-71e2-46f5-b586-971ec369a695 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:21.764157 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1083/2152] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:28:21 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:21.765441 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb86ae3-75f6-477c-ac86-f7b5048b536c admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:21.778394 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb86ae3-75f6-477c-ac86-f7b5048b536c admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:21.787306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44662a64-7846-4485-b2d6-6ceb8c589362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:21.788221 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44662a64-7846-4485-b2d6-6ceb8c589362 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:21.788502 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44662a64-7846-4485-b2d6-6ceb8c589362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:21.788779 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44662a64-7846-4485-b2d6-6ceb8c589362 admin admin] PATH_INFO: `/v3/projects/5f220e47d65a41fbbfae16eee69df085/users/5868bc807759466cadc9d79243200a0a/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:21.791771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1070/2153] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:28:21 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:21.792714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a5062-71e2-46f5-b586-971ec369a695 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:21.810619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44662a64-7846-4485-b2d6-6ceb8c589362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f220e47d65a41fbbfae16eee69df085, user_id=5868bc807759466cadc9d79243200a0a, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:21.814427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44662a64-7846-4485-b2d6-6ceb8c589362 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:21.892583 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a5062-71e2-46f5-b586-971ec369a695 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:21.899394 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200c262-d865-452f-9517-6656a14993d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:21.900075 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200c262-d865-452f-9517-6656a14993d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:21.900330 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200c262-d865-452f-9517-6656a14993d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:21.900607 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200c262-d865-452f-9517-6656a14993d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:21.901271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200c262-d865-452f-9517-6656a14993d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:21.904572 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200c262-d865-452f-9517-6656a14993d1 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:21.917674 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1071/2154] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:21.924521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1084/2155] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:21 2022] PUT /identity/v3/projects/5f220e47d65a41fbbfae16eee69df085/users/5868bc807759466cadc9d79243200a0a/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:21.925036 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200c262-d865-452f-9517-6656a14993d1 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:21.925131 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44662a64-7846-4485-b2d6-6ceb8c589362 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:21.934237 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200c262-d865-452f-9517-6656a14993d1 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:22.016774 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44662a64-7846-4485-b2d6-6ceb8c589362 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:22.025901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c776d-b443-4927-8c4b-f746270ea5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:22.037242 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d8d11-012a-4198-afae-8823e2bffce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:22.037413 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c776d-b443-4927-8c4b-f746270ea5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:22.037413 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c776d-b443-4927-8c4b-f746270ea5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:22.037563 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d8d11-012a-4198-afae-8823e2bffce9 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:22.037636 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c776d-b443-4927-8c4b-f746270ea5a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:22.037716 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d8d11-012a-4198-afae-8823e2bffce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:22.037716 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d8d11-012a-4198-afae-8823e2bffce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:22.037929 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c776d-b443-4927-8c4b-f746270ea5a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:22.038019 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d8d11-012a-4198-afae-8823e2bffce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:22.038096 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c776d-b443-4927-8c4b-f746270ea5a4 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:22.038240 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d8d11-012a-4198-afae-8823e2bffce9 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:22.049106 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1085/2156] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:22.050464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d8d11-012a-4198-afae-8823e2bffce9 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:22.066197 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d8d11-012a-4198-afae-8823e2bffce9 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:22.072297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9b0e1-1b7c-4b94-9ceb-63a8de33388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:22.073265 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9b0e1-1b7c-4b94-9ceb-63a8de33388a admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:22.073556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9b0e1-1b7c-4b94-9ceb-63a8de33388a admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:22.073831 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9b0e1-1b7c-4b94-9ceb-63a8de33388a admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:22.074482 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9b0e1-1b7c-4b94-9ceb-63a8de33388a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:22.076522 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9b0e1-1b7c-4b94-9ceb-63a8de33388a admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:22.088786 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1086/2157] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:22.096907 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9b0e1-1b7c-4b94-9ceb-63a8de33388a admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:22.104486 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9b0e1-1b7c-4b94-9ceb-63a8de33388a admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:22.110149 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e1952-0d29-46df-80d2-4aa700e86ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:22.110831 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e1952-0d29-46df-80d2-4aa700e86ae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:22.111113 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e1952-0d29-46df-80d2-4aa700e86ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:22.111392 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e1952-0d29-46df-80d2-4aa700e86ae3 admin admin] PATH_INFO: `/v3/projects/6c9f159e62914185ba951b327575acf7/users/4ac11f3b8171438e8301e84959a37345/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:22.128855 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1072/2158] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:28:21 2022] POST /identity/v3/users => generated 286 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:22.131350 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c776d-b443-4927-8c4b-f746270ea5a4 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:22.133427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e1952-0d29-46df-80d2-4aa700e86ae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c9f159e62914185ba951b327575acf7, user_id=4ac11f3b8171438e8301e84959a37345, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:22.136629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e1952-0d29-46df-80d2-4aa700e86ae3 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:22.146657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c776d-b443-4927-8c4b-f746270ea5a4 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:22.161089 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a469b62-bde8-451f-81e2-9042a7cc8e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:22.168288 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a469b62-bde8-451f-81e2-9042a7cc8e52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:22.168288 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a469b62-bde8-451f-81e2-9042a7cc8e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:22.168288 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a469b62-bde8-451f-81e2-9042a7cc8e52 admin admin] PATH_INFO: `/v3/projects/5f220e47d65a41fbbfae16eee69df085/users/5868bc807759466cadc9d79243200a0a/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:22.168288 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a469b62-bde8-451f-81e2-9042a7cc8e52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f220e47d65a41fbbfae16eee69df085, user_id=5868bc807759466cadc9d79243200a0a, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:22.170026 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a469b62-bde8-451f-81e2-9042a7cc8e52 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:22.186210 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1073/2159] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:22 2022] PUT /identity/v3/projects/5f220e47d65a41fbbfae16eee69df085/users/5868bc807759466cadc9d79243200a0a/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:22.191252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a469b62-bde8-451f-81e2-9042a7cc8e52 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:22.232562 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1087/2160] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:22 2022] PUT /identity/v3/projects/6c9f159e62914185ba951b327575acf7/users/4ac11f3b8171438e8301e84959a37345/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:22.232562 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee6a60-2a1d-4902-8f05-b567316ae7cc None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:22.232562 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee6a60-2a1d-4902-8f05-b567316ae7cc None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:22.232562 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee6a60-2a1d-4902-8f05-b567316ae7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:22.283714 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-00ee6a60-2a1d-4902-8f05-b567316ae7cc None None] MFA Rules not processed for user `5868bc807759466cadc9d79243200a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:22.287935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-00ee6a60-2a1d-4902-8f05-b567316ae7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:22.306811 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a469b62-bde8-451f-81e2-9042a7cc8e52 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:22.374851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:22.398482 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2cbfda-088c-4d02-b2c2-52b57472678e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:22.399203 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cbfda-088c-4d02-b2c2-52b57472678e admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:22.399546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cbfda-088c-4d02-b2c2-52b57472678e admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:22.400310 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cbfda-088c-4d02-b2c2-52b57472678e admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:22.405558 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2cbfda-088c-4d02-b2c2-52b57472678e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:22.405698 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1088/2161] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:22.405795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2cbfda-088c-4d02-b2c2-52b57472678e admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:22.405891 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bdb5a-6393-4c89-99df-5005074ddf4e None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:22.405891 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bdb5a-6393-4c89-99df-5005074ddf4e None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:22.405891 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bdb5a-6393-4c89-99df-5005074ddf4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:22.419735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1074/2162] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:22.420846 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2cbfda-088c-4d02-b2c2-52b57472678e admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:22.435706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2cbfda-088c-4d02-b2c2-52b57472678e admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:22.450310 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0e318-b29b-4ce1-8138-2670204aa4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:22.450310 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0e318-b29b-4ce1-8138-2670204aa4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:22.450310 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0e318-b29b-4ce1-8138-2670204aa4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:22.450310 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0e318-b29b-4ce1-8138-2670204aa4f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:22.450666 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0e318-b29b-4ce1-8138-2670204aa4f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:22.450666 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0e318-b29b-4ce1-8138-2670204aa4f1 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:22.452746 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-e34bdb5a-6393-4c89-99df-5005074ddf4e None None] MFA Rules not processed for user `4ac11f3b8171438e8301e84959a37345`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:22.453980 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-e34bdb5a-6393-4c89-99df-5005074ddf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:22.457001 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1075/2163] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:28:22.458920 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0e318-b29b-4ce1-8138-2670204aa4f1 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:22.460751 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f8d0e318-b29b-4ce1-8138-2670204aa4f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:22.528976 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0e318-b29b-4ce1-8138-2670204aa4f1 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:22.529569 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1089/2164] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:22.530547 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bdb5a-6393-4c89-99df-5005074ddf4e None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:22.538010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acefc8b-281b-4aa4-bd3b-4ea6b8ab0baf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:22.539512 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acefc8b-281b-4aa4-bd3b-4ea6b8ab0baf service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:22.540212 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acefc8b-281b-4aa4-bd3b-4ea6b8ab0baf service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:22.540779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acefc8b-281b-4aa4-bd3b-4ea6b8ab0baf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:22.543487 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bdb5a-6393-4c89-99df-5005074ddf4e None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:22.548118 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7ae6c-cf5a-44c0-9076-3e5b72fce024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:22.549276 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7ae6c-cf5a-44c0-9076-3e5b72fce024 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:22.549563 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7ae6c-cf5a-44c0-9076-3e5b72fce024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:22.549837 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7ae6c-cf5a-44c0-9076-3e5b72fce024 admin admin] PATH_INFO: `/v3/projects/87f4679c1f4b49d58df47e20201e465a/users/c1d558f1f2f443e18d95a7cff604c691/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:22.567338 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acefc8b-281b-4aa4-bd3b-4ea6b8ab0baf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:22.569467 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acefc8b-281b-4aa4-bd3b-4ea6b8ab0baf service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:22.580117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1076/2165] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:28:22.580820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acefc8b-281b-4aa4-bd3b-4ea6b8ab0baf service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:22.582178 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-4acefc8b-281b-4aa4-bd3b-4ea6b8ab0baf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:22.583966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7ae6c-cf5a-44c0-9076-3e5b72fce024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87f4679c1f4b49d58df47e20201e465a, user_id=c1d558f1f2f443e18d95a7cff604c691, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:22.588167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7ae6c-cf5a-44c0-9076-3e5b72fce024 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:22.595241 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acefc8b-281b-4aa4-bd3b-4ea6b8ab0baf service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:22.599594 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b657aa-e16c-482b-a601-cbe3deb211ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:22.600239 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b657aa-e16c-482b-a601-cbe3deb211ba service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:22.600514 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b657aa-e16c-482b-a601-cbe3deb211ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:22.600779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b657aa-e16c-482b-a601-cbe3deb211ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:22.619671 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b657aa-e16c-482b-a601-cbe3deb211ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:22.621632 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b657aa-e16c-482b-a601-cbe3deb211ba service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:22.632524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1077/2166] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:28:22.655980 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b657aa-e16c-482b-a601-cbe3deb211ba service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:22.672738 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b657aa-e16c-482b-a601-cbe3deb211ba service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:22.691121 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9d3f9-f0d5-4bf4-ac41-18f865ac00d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:22.715623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9d3f9-f0d5-4bf4-ac41-18f865ac00d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:22.715623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9d3f9-f0d5-4bf4-ac41-18f865ac00d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:22.715623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9d3f9-f0d5-4bf4-ac41-18f865ac00d7 admin admin] PATH_INFO: `/v3/users/4ac11f3b8171438e8301e84959a37345` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:22.715623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9d3f9-f0d5-4bf4-ac41-18f865ac00d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ac11f3b8171438e8301e84959a37345)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:22.715623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9d3f9-f0d5-4bf4-ac41-18f865ac00d7 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:22.770355 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1090/2167] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:22 2022] PUT /identity/v3/projects/87f4679c1f4b49d58df47e20201e465a/users/c1d558f1f2f443e18d95a7cff604c691/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:22.777072 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ed103-8392-488a-95bc-da9e6fed8b54 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:22.782232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ed103-8392-488a-95bc-da9e6fed8b54 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:22.782232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ed103-8392-488a-95bc-da9e6fed8b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:22.810999 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-6b2ed103-8392-488a-95bc-da9e6fed8b54 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:22.812490 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-6b2ed103-8392-488a-95bc-da9e6fed8b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:22.917036 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1091/2168] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:28:22.920445 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ed103-8392-488a-95bc-da9e6fed8b54 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:22.991848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ed103-8392-488a-95bc-da9e6fed8b54 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:22.995969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26d1bb-d111-4619-a969-44558ac0438f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:22.996716 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26d1bb-d111-4619-a969-44558ac0438f service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:22.997005 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26d1bb-d111-4619-a969-44558ac0438f service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:22.997280 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26d1bb-d111-4619-a969-44558ac0438f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:22.999302 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-2a26d1bb-d111-4619-a969-44558ac0438f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:23.079870 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-66a9d3f9-f0d5-4bf4-ac41-18f865ac00d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ac11f3b8171438e8301e84959a37345'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:23.084750 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a26d1bb-d111-4619-a969-44558ac0438f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:23.087120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a26d1bb-d111-4619-a969-44558ac0438f service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:23.099699 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1092/2169] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:28:23.100586 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26d1bb-d111-4619-a969-44558ac0438f service cinder] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:23.111479 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26d1bb-d111-4619-a969-44558ac0438f service cinder] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:23.119789 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d6000-7f0e-4127-afc2-e0819adfdb20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:23.121131 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d6000-7f0e-4127-afc2-e0819adfdb20 service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:23.121468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d6000-7f0e-4127-afc2-e0819adfdb20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:23.121835 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d6000-7f0e-4127-afc2-e0819adfdb20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:23.129252 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-665d6000-7f0e-4127-afc2-e0819adfdb20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:23.229639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-66a9d3f9-f0d5-4bf4-ac41-18f865ac00d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ac11f3b8171438e8301e84959a37345'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:23.230304 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-66a9d3f9-f0d5-4bf4-ac41-18f865ac00d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ac11f3b8171438e8301e84959a37345'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:23.231428 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-66a9d3f9-f0d5-4bf4-ac41-18f865ac00d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ac11f3b8171438e8301e84959a37345'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:23.243012 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-66a9d3f9-f0d5-4bf4-ac41-18f865ac00d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ac11f3b8171438e8301e84959a37345'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:23.271953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d6000-7f0e-4127-afc2-e0819adfdb20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:23.274291 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d6000-7f0e-4127-afc2-e0819adfdb20 service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:23.290736 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1078/2170] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:28:22 2022] DELETE /identity/v3/users/4ac11f3b8171438e8301e84959a37345 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:28:23.290736 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9d3f9-f0d5-4bf4-ac41-18f865ac00d7 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:23.293886 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-66a9d3f9-f0d5-4bf4-ac41-18f865ac00d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:23.302811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1093/2171] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:28:23.304847 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e8cb9-dc2c-4f9d-accf-4589edaab59e None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:23.310185 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e8cb9-dc2c-4f9d-accf-4589edaab59e None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:23.310893 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e8cb9-dc2c-4f9d-accf-4589edaab59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:23.364822 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-440e8cb9-dc2c-4f9d-accf-4589edaab59e None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:23.370949 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-440e8cb9-dc2c-4f9d-accf-4589edaab59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:23.397751 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9d3f9-f0d5-4bf4-ac41-18f865ac00d7 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:23.403281 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff038506-0508-4566-a36c-a58b6f241933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:23.404459 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff038506-0508-4566-a36c-a58b6f241933 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:23.404575 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff038506-0508-4566-a36c-a58b6f241933 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:23.405252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff038506-0508-4566-a36c-a58b6f241933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:23.407388 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-ff038506-0508-4566-a36c-a58b6f241933 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:23.505508 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1094/2172] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:23.509773 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:23.517245 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e8cb9-dc2c-4f9d-accf-4589edaab59e None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:23.519685 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-440e8cb9-dc2c-4f9d-accf-4589edaab59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:23.536162 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e8cb9-dc2c-4f9d-accf-4589edaab59e None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:23.542657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d676445-b03d-4157-b61a-1bc3257da063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:23.543699 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d676445-b03d-4157-b61a-1bc3257da063 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:23.544186 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d676445-b03d-4157-b61a-1bc3257da063 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:23.548155 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d676445-b03d-4157-b61a-1bc3257da063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:23.548277 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff038506-0508-4566-a36c-a58b6f241933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:23.549587 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff038506-0508-4566-a36c-a58b6f241933 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:23.557973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d676445-b03d-4157-b61a-1bc3257da063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:23.559950 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d676445-b03d-4157-b61a-1bc3257da063 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:23.573522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1079/2173] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:28:23.582675 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1095/2174] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:28:24.109346 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff038506-0508-4566-a36c-a58b6f241933 service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:24.111787 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-ff038506-0508-4566-a36c-a58b6f241933 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:24.134489 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff038506-0508-4566-a36c-a58b6f241933 service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:24.142434 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9bbe0-42c2-46a5-9329-6da9d59badb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:24.143181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9bbe0-42c2-46a5-9329-6da9d59badb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:24.143611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9bbe0-42c2-46a5-9329-6da9d59badb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:24.143957 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9bbe0-42c2-46a5-9329-6da9d59badb7 admin admin] PATH_INFO: `/v3/projects/6c9f159e62914185ba951b327575acf7` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:24.146718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9bbe0-42c2-46a5-9329-6da9d59badb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c9f159e62914185ba951b327575acf7)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:24.148935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9bbe0-42c2-46a5-9329-6da9d59badb7 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:24.180793 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:24.332623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f2e9bbe0-42c2-46a5-9329-6da9d59badb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c9f159e62914185ba951b327575acf7', 'request_id': 'req-f2e9bbe0-42c2-46a5-9329-6da9d59badb7'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:24.347678 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f2e9bbe0-42c2-46a5-9329-6da9d59badb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c9f159e62914185ba951b327575acf7', 'request_id': 'req-f2e9bbe0-42c2-46a5-9329-6da9d59badb7'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:24.506609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f2e9bbe0-42c2-46a5-9329-6da9d59badb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c9f159e62914185ba951b327575acf7', 'request_id': 'req-f2e9bbe0-42c2-46a5-9329-6da9d59badb7'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:24.523210 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f2e9bbe0-42c2-46a5-9329-6da9d59badb7 admin admin] The token cache is being invalidate because project 6c9f159e62914185ba951b327575acf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:24.523977 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f2e9bbe0-42c2-46a5-9329-6da9d59badb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:24.525679 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f2e9bbe0-42c2-46a5-9329-6da9d59badb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:24.527368 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1080/2175] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:24 2022] DELETE /identity/v3/projects/6c9f159e62914185ba951b327575acf7 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:24.532501 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f615a6-d88b-463b-bbd2-1f8bcc4032da None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:24.533047 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f615a6-d88b-463b-bbd2-1f8bcc4032da None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:24.533128 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f615a6-d88b-463b-bbd2-1f8bcc4032da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:24.558687 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-f2f615a6-d88b-463b-bbd2-1f8bcc4032da None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:24.560149 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-f2f615a6-d88b-463b-bbd2-1f8bcc4032da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:24.639685 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1096/2176] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:24.649659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad15c3-8d10-4fc4-98bd-bedb7631e5ca None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:24.650011 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad15c3-8d10-4fc4-98bd-bedb7631e5ca None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:24.650456 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad15c3-8d10-4fc4-98bd-bedb7631e5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:24.688128 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-d6ad15c3-8d10-4fc4-98bd-bedb7631e5ca None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:24.689394 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-d6ad15c3-8d10-4fc4-98bd-bedb7631e5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:24.703183 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1081/2177] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:24.704551 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f615a6-d88b-463b-bbd2-1f8bcc4032da None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:24.718079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f615a6-d88b-463b-bbd2-1f8bcc4032da None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:24.724109 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d157eb-f55f-4cb2-8eb6-c8771ba0a2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:24.725154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d157eb-f55f-4cb2-8eb6-c8771ba0a2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:24.725442 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d157eb-f55f-4cb2-8eb6-c8771ba0a2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:24.725718 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d157eb-f55f-4cb2-8eb6-c8771ba0a2a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:24.726478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d157eb-f55f-4cb2-8eb6-c8771ba0a2a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:28:24.726783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d157eb-f55f-4cb2-8eb6-c8771ba0a2a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:24.728759 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d157eb-f55f-4cb2-8eb6-c8771ba0a2a6 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:24.749010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad15c3-8d10-4fc4-98bd-bedb7631e5ca None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:24.749177 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1097/2178] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:28:24.763636 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad15c3-8d10-4fc4-98bd-bedb7631e5ca None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:24.785662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022a7eb-0614-46b8-92cb-676df989521f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:24.786354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022a7eb-0614-46b8-92cb-676df989521f admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:24.786635 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022a7eb-0614-46b8-92cb-676df989521f admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:24.786900 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022a7eb-0614-46b8-92cb-676df989521f admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:24.787642 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022a7eb-0614-46b8-92cb-676df989521f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:24.793605 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022a7eb-0614-46b8-92cb-676df989521f admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:24.972001 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1082/2179] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:28:24 2022] POST /identity/v3/projects => generated 375 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:28:24.976108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d157eb-f55f-4cb2-8eb6-c8771ba0a2a6 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:24.987978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d157eb-f55f-4cb2-8eb6-c8771ba0a2a6 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:25.073399 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403845b6-67b0-4292-97de-61a176c8d307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:25.074306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403845b6-67b0-4292-97de-61a176c8d307 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:25.074775 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403845b6-67b0-4292-97de-61a176c8d307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:25.075196 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403845b6-67b0-4292-97de-61a176c8d307 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:25.076054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403845b6-67b0-4292-97de-61a176c8d307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:25.078437 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403845b6-67b0-4292-97de-61a176c8d307 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:25.163701 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1098/2180] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:28:24 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:25.169409 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022a7eb-0614-46b8-92cb-676df989521f admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:25.189361 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022a7eb-0614-46b8-92cb-676df989521f admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:25.199680 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bd2f3-2226-4eaa-aa3c-f7edcd2f0201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:25.199680 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bd2f3-2226-4eaa-aa3c-f7edcd2f0201 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:25.199680 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bd2f3-2226-4eaa-aa3c-f7edcd2f0201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:25.199680 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bd2f3-2226-4eaa-aa3c-f7edcd2f0201 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:25.207665 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9bd2f3-2226-4eaa-aa3c-f7edcd2f0201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:25.207665 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9bd2f3-2226-4eaa-aa3c-f7edcd2f0201 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:25.228478 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1083/2181] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:25.233886 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403845b6-67b0-4292-97de-61a176c8d307 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:25.255652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403845b6-67b0-4292-97de-61a176c8d307 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:25.262965 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a874d1-19fc-4e6e-b49f-7c4d1b80ff5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:25.264082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a874d1-19fc-4e6e-b49f-7c4d1b80ff5e admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:25.264586 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a874d1-19fc-4e6e-b49f-7c4d1b80ff5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:25.265011 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a874d1-19fc-4e6e-b49f-7c4d1b80ff5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:25.266370 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a874d1-19fc-4e6e-b49f-7c4d1b80ff5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:25.280329 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a874d1-19fc-4e6e-b49f-7c4d1b80ff5e admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:25.312236 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1099/2182] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:25.316337 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bd2f3-2226-4eaa-aa3c-f7edcd2f0201 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:25.342955 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bd2f3-2226-4eaa-aa3c-f7edcd2f0201 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:25.355617 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842674bd-dffe-496e-a0af-535add9277aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:25.357709 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842674bd-dffe-496e-a0af-535add9277aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:25.358175 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842674bd-dffe-496e-a0af-535add9277aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:25.358623 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842674bd-dffe-496e-a0af-535add9277aa admin admin] PATH_INFO: `/v3/projects/69dd864de54b4950a63052b7a876a948/users/ced17f9d617e4a80854fd6745ca100dd/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:25.415011 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842674bd-dffe-496e-a0af-535add9277aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=69dd864de54b4950a63052b7a876a948, user_id=ced17f9d617e4a80854fd6745ca100dd, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:25.421142 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842674bd-dffe-496e-a0af-535add9277aa admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:25.496651 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:25.558939 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1084/2183] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:25 2022] PUT /identity/v3/projects/69dd864de54b4950a63052b7a876a948/users/ced17f9d617e4a80854fd6745ca100dd/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:25.576753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292579c1-db6f-467a-88a9-40d379cd3eb1 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:25.577215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292579c1-db6f-467a-88a9-40d379cd3eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:25.577684 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292579c1-db6f-467a-88a9-40d379cd3eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:25.681081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-292579c1-db6f-467a-88a9-40d379cd3eb1 None None] MFA Rules not processed for user `ced17f9d617e4a80854fd6745ca100dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:25.682967 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-292579c1-db6f-467a-88a9-40d379cd3eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:25.690984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842674bd-dffe-496e-a0af-535add9277aa admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:25.697033 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-842674bd-dffe-496e-a0af-535add9277aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:25.845850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1100/2184] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:25.849736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc0fd2-ba92-41af-82c8-4c697f72c466 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:25.850386 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc0fd2-ba92-41af-82c8-4c697f72c466 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:25.856705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc0fd2-ba92-41af-82c8-4c697f72c466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:25.871820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842674bd-dffe-496e-a0af-535add9277aa admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:25.890553 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cc9ed-92b0-4288-bf7f-8318e7403fe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:25.891478 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cc9ed-92b0-4288-bf7f-8318e7403fe2 service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:25.891926 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cc9ed-92b0-4288-bf7f-8318e7403fe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:25.898567 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cc9ed-92b0-4288-bf7f-8318e7403fe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:25.901892 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-447cc9ed-92b0-4288-bf7f-8318e7403fe2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:25.918689 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-8fcc0fd2-ba92-41af-82c8-4c697f72c466 None None] MFA Rules not processed for user `c1d558f1f2f443e18d95a7cff604c691`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:25.920547 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-8fcc0fd2-ba92-41af-82c8-4c697f72c466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:26.057388 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cc9ed-92b0-4288-bf7f-8318e7403fe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:26.059103 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cc9ed-92b0-4288-bf7f-8318e7403fe2 service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:26.089572 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1085/2185] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:28:26.090616 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cc9ed-92b0-4288-bf7f-8318e7403fe2 service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:26.105013 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1101/2186] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:26.120439 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc0fd2-ba92-41af-82c8-4c697f72c466 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:26.122334 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-8fcc0fd2-ba92-41af-82c8-4c697f72c466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:26.138677 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc0fd2-ba92-41af-82c8-4c697f72c466 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:26.148495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c587c-47ad-403f-8690-2e934e27cc80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:26.148495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c587c-47ad-403f-8690-2e934e27cc80 service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:26.148495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c587c-47ad-403f-8690-2e934e27cc80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:26.148495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c587c-47ad-403f-8690-2e934e27cc80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:26.160776 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c587c-47ad-403f-8690-2e934e27cc80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:26.163670 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c587c-47ad-403f-8690-2e934e27cc80 service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:26.194820 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1102/2187] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:28:26.271173 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cc9ed-92b0-4288-bf7f-8318e7403fe2 service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:26.279901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661831ce-7fc8-45ba-a8df-edcf0f15eba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:26.279901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661831ce-7fc8-45ba-a8df-edcf0f15eba3 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:26.280173 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661831ce-7fc8-45ba-a8df-edcf0f15eba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:26.280462 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661831ce-7fc8-45ba-a8df-edcf0f15eba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:26.281403 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661831ce-7fc8-45ba-a8df-edcf0f15eba3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:26.285741 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661831ce-7fc8-45ba-a8df-edcf0f15eba3 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:26.305437 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6832b3-238a-4679-a2da-154b9613568e None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:26.305755 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6832b3-238a-4679-a2da-154b9613568e None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:26.306005 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6832b3-238a-4679-a2da-154b9613568e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:26.352267 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-ec6832b3-238a-4679-a2da-154b9613568e None None] MFA Rules not processed for user `87d974bb5cf94567b1493fa54e804374`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:26.353771 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ec6832b3-238a-4679-a2da-154b9613568e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:26.379845 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:26.436964 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1103/2188] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:26.449080 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1086/2189] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:28:26 2022] POST /identity/v3/projects => generated 375 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:26.450848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6832b3-238a-4679-a2da-154b9613568e None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:26.453068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661831ce-7fc8-45ba-a8df-edcf0f15eba3 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:26.453898 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ec6832b3-238a-4679-a2da-154b9613568e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:26.543076 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661831ce-7fc8-45ba-a8df-edcf0f15eba3 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:26.548169 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d6c05-3eb6-4ed9-a849-ceafa46a2295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:26.548797 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d6c05-3eb6-4ed9-a849-ceafa46a2295 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:26.549079 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d6c05-3eb6-4ed9-a849-ceafa46a2295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:26.549352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d6c05-3eb6-4ed9-a849-ceafa46a2295 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:26.549990 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d6c05-3eb6-4ed9-a849-ceafa46a2295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:26.551975 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d6c05-3eb6-4ed9-a849-ceafa46a2295 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:26.556998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6832b3-238a-4679-a2da-154b9613568e None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:26.649517 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75ac97-e8d6-458a-873e-3053cbf6a196 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:26.650278 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75ac97-e8d6-458a-873e-3053cbf6a196 service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:26.650682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75ac97-e8d6-458a-873e-3053cbf6a196 service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:26.651061 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75ac97-e8d6-458a-873e-3053cbf6a196 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:26.691635 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1087/2190] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:28:26 2022] POST /identity/v3/users => generated 288 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:26.693528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d6c05-3eb6-4ed9-a849-ceafa46a2295 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:26.705941 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d6c05-3eb6-4ed9-a849-ceafa46a2295 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:26.711899 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08db4f0-2ae4-4b55-9b59-eddaea6c75db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:26.712542 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08db4f0-2ae4-4b55-9b59-eddaea6c75db admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:26.718960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08db4f0-2ae4-4b55-9b59-eddaea6c75db admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:26.718960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08db4f0-2ae4-4b55-9b59-eddaea6c75db admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:26.718960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08db4f0-2ae4-4b55-9b59-eddaea6c75db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:26.718960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08db4f0-2ae4-4b55-9b59-eddaea6c75db admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:26.727752 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75ac97-e8d6-458a-873e-3053cbf6a196 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:26.729368 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75ac97-e8d6-458a-873e-3053cbf6a196 service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:26.733789 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1088/2191] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:28:26.734890 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08db4f0-2ae4-4b55-9b59-eddaea6c75db admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:26.740056 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1104/2192] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:28:26.746122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08db4f0-2ae4-4b55-9b59-eddaea6c75db admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:26.751227 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fddc9f-0dbe-4d9e-b30d-3cd344829783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:26.751880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fddc9f-0dbe-4d9e-b30d-3cd344829783 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:26.752158 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fddc9f-0dbe-4d9e-b30d-3cd344829783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:26.752430 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fddc9f-0dbe-4d9e-b30d-3cd344829783 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:26.753201 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fddc9f-0dbe-4d9e-b30d-3cd344829783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:26.754725 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fddc9f-0dbe-4d9e-b30d-3cd344829783 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:26.765537 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1089/2193] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:26.770106 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75ac97-e8d6-458a-873e-3053cbf6a196 service nova] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:26.782435 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75ac97-e8d6-458a-873e-3053cbf6a196 service nova] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:26.788526 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f4ad0-7f3e-4009-b5d1-a7f6836a6e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:26.793338 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f4ad0-7f3e-4009-b5d1-a7f6836a6e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:26.793338 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f4ad0-7f3e-4009-b5d1-a7f6836a6e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:26.793338 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f4ad0-7f3e-4009-b5d1-a7f6836a6e49 admin admin] PATH_INFO: `/v3/projects/57e956a54b234e44849d29a00a108091/users/751930437595467981a5bb3494974944/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:26.815559 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f4ad0-7f3e-4009-b5d1-a7f6836a6e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e956a54b234e44849d29a00a108091, user_id=751930437595467981a5bb3494974944, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:26.820283 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f4ad0-7f3e-4009-b5d1-a7f6836a6e49 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:26.978843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1105/2194] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:26 2022] PUT /identity/v3/projects/57e956a54b234e44849d29a00a108091/users/751930437595467981a5bb3494974944/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:26.993267 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3376f77-b1f2-48fd-aca6-a9455d1aead0 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:26.994908 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3376f77-b1f2-48fd-aca6-a9455d1aead0 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:26.995355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3376f77-b1f2-48fd-aca6-a9455d1aead0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:27.041901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-b3376f77-b1f2-48fd-aca6-a9455d1aead0 None None] MFA Rules not processed for user `751930437595467981a5bb3494974944`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:27.043407 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-b3376f77-b1f2-48fd-aca6-a9455d1aead0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:27.127850 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1090/2195] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:27.132541 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f4ad0-7f3e-4009-b5d1-a7f6836a6e49 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:27.226683 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f4ad0-7f3e-4009-b5d1-a7f6836a6e49 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:27.231964 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80027133-6ba1-43d8-b35a-1cfbba76505e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:27.232612 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80027133-6ba1-43d8-b35a-1cfbba76505e admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:27.232896 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80027133-6ba1-43d8-b35a-1cfbba76505e admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:27.233175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80027133-6ba1-43d8-b35a-1cfbba76505e admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:27.233834 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80027133-6ba1-43d8-b35a-1cfbba76505e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:27.235826 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80027133-6ba1-43d8-b35a-1cfbba76505e admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:27.336099 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3376f77-b1f2-48fd-aca6-a9455d1aead0 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:27.337839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-b3376f77-b1f2-48fd-aca6-a9455d1aead0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:27.365725 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3376f77-b1f2-48fd-aca6-a9455d1aead0 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:27.371100 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460adca9-e3d8-48f9-a89a-6e9afe3fc162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:27.371805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460adca9-e3d8-48f9-a89a-6e9afe3fc162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:27.372088 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460adca9-e3d8-48f9-a89a-6e9afe3fc162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:27.372361 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460adca9-e3d8-48f9-a89a-6e9afe3fc162 admin admin] PATH_INFO: `/v3/users/0d2f2297b750418bb5a1a4afb785eede` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:27.373593 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460adca9-e3d8-48f9-a89a-6e9afe3fc162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d2f2297b750418bb5a1a4afb785eede)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:27.379078 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460adca9-e3d8-48f9-a89a-6e9afe3fc162 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:27.411113 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1106/2196] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:28:27 2022] POST /identity/v3/projects => generated 377 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:27.412099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80027133-6ba1-43d8-b35a-1cfbba76505e admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:27.499552 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80027133-6ba1-43d8-b35a-1cfbba76505e admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:27.506530 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f42a1-33f7-41f7-9546-82872a919a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:27.515770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f42a1-33f7-41f7-9546-82872a919a45 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:27.515770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f42a1-33f7-41f7-9546-82872a919a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:27.515770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f42a1-33f7-41f7-9546-82872a919a45 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:27.515770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f42a1-33f7-41f7-9546-82872a919a45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:27.515770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f42a1-33f7-41f7-9546-82872a919a45 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:27.674593 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1107/2197] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:28:27 2022] POST /identity/v3/users => generated 295 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:27.683782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f42a1-33f7-41f7-9546-82872a919a45 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:27.699148 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f42a1-33f7-41f7-9546-82872a919a45 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:27.701342 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:INSERT=5,keystone:SELECT=94,keystone:DELETE=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:27.704951 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-460adca9-e3d8-48f9-a89a-6e9afe3fc162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d2f2297b750418bb5a1a4afb785eede'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:27.705725 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78577a56-c6b0-4334-ba5b-22f862b5e59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:27.706412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78577a56-c6b0-4334-ba5b-22f862b5e59b admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:27.706692 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78577a56-c6b0-4334-ba5b-22f862b5e59b admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:27.707024 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78577a56-c6b0-4334-ba5b-22f862b5e59b admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:27.708124 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78577a56-c6b0-4334-ba5b-22f862b5e59b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:27.710502 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78577a56-c6b0-4334-ba5b-22f862b5e59b admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:27.725957 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1108/2198] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:28:27.730538 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78577a56-c6b0-4334-ba5b-22f862b5e59b admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:27.749465 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78577a56-c6b0-4334-ba5b-22f862b5e59b admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:27.759484 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce25fa9-0bff-4eeb-8e9a-1642004ee9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:27.759484 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce25fa9-0bff-4eeb-8e9a-1642004ee9c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:27.759484 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce25fa9-0bff-4eeb-8e9a-1642004ee9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:27.759484 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce25fa9-0bff-4eeb-8e9a-1642004ee9c7 admin admin] PATH_INFO: `/v3/projects/923284f6c80545408355501bbe6b1db7/users/aa705c6779a34c1e94b5325492079a63/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:27.778516 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce25fa9-0bff-4eeb-8e9a-1642004ee9c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=923284f6c80545408355501bbe6b1db7, user_id=aa705c6779a34c1e94b5325492079a63, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:27.781637 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce25fa9-0bff-4eeb-8e9a-1642004ee9c7 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:27.994782 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-460adca9-e3d8-48f9-a89a-6e9afe3fc162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d2f2297b750418bb5a1a4afb785eede'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:27.995921 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-460adca9-e3d8-48f9-a89a-6e9afe3fc162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d2f2297b750418bb5a1a4afb785eede'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:27.996598 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-460adca9-e3d8-48f9-a89a-6e9afe3fc162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d2f2297b750418bb5a1a4afb785eede'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:28.007798 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-460adca9-e3d8-48f9-a89a-6e9afe3fc162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d2f2297b750418bb5a1a4afb785eede'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:28.021579 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1109/2199] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:27 2022] PUT /identity/v3/projects/923284f6c80545408355501bbe6b1db7/users/aa705c6779a34c1e94b5325492079a63/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:28.026350 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce25fa9-0bff-4eeb-8e9a-1642004ee9c7 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:28.029118 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-8ce25fa9-0bff-4eeb-8e9a-1642004ee9c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:28.040831 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1091/2200] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:28:27 2022] DELETE /identity/v3/users/0d2f2297b750418bb5a1a4afb785eede => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:28.045608 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce926ef5-f4a6-4a75-a5ce-4fc343a449a9 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:28.045898 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce926ef5-f4a6-4a75-a5ce-4fc343a449a9 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:28.046182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce926ef5-f4a6-4a75-a5ce-4fc343a449a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:28.068613 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-ce926ef5-f4a6-4a75-a5ce-4fc343a449a9 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:28.070010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-ce926ef5-f4a6-4a75-a5ce-4fc343a449a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:28.109365 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce25fa9-0bff-4eeb-8e9a-1642004ee9c7 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:28.156127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1092/2201] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:28:28.168526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce926ef5-f4a6-4a75-a5ce-4fc343a449a9 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:28.172226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-ce926ef5-f4a6-4a75-a5ce-4fc343a449a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:28.202242 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf02f7-0459-44e4-baf7-800bc940071a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:28.203171 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf02f7-0459-44e4-baf7-800bc940071a admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:28.203651 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf02f7-0459-44e4-baf7-800bc940071a admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:28.204098 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf02f7-0459-44e4-baf7-800bc940071a admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:28.204979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf02f7-0459-44e4-baf7-800bc940071a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:28.207062 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf02f7-0459-44e4-baf7-800bc940071a admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:28.220985 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1110/2202] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:28:28.227945 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf02f7-0459-44e4-baf7-800bc940071a admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:28.248095 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce926ef5-f4a6-4a75-a5ce-4fc343a449a9 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:28.250985 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf02f7-0459-44e4-baf7-800bc940071a admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:28.253618 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857f813-3ae7-4281-b1f3-fe877c38d15c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:28.254718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857f813-3ae7-4281-b1f3-fe877c38d15c service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:28.254844 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857f813-3ae7-4281-b1f3-fe877c38d15c service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:28.255082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857f813-3ae7-4281-b1f3-fe877c38d15c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:28.258306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf93918-b4dc-44c8-93c0-d31165d5e691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:28.259202 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf93918-b4dc-44c8-93c0-d31165d5e691 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:28.259516 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf93918-b4dc-44c8-93c0-d31165d5e691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:28.259838 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf93918-b4dc-44c8-93c0-d31165d5e691 admin admin] PATH_INFO: `/v3/projects/923284f6c80545408355501bbe6b1db7/users/aa705c6779a34c1e94b5325492079a63/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:28.261893 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf93918-b4dc-44c8-93c0-d31165d5e691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=923284f6c80545408355501bbe6b1db7, user_id=aa705c6779a34c1e94b5325492079a63, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:28.265690 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf93918-b4dc-44c8-93c0-d31165d5e691 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:28.267893 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857f813-3ae7-4281-b1f3-fe877c38d15c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:28.269375 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857f813-3ae7-4281-b1f3-fe877c38d15c service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:28.278462 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1111/2203] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:28 2022] PUT /identity/v3/projects/923284f6c80545408355501bbe6b1db7/users/aa705c6779a34c1e94b5325492079a63/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:28.280952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1093/2204] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:28:28.289644 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f97c1-289d-4c24-8452-71c0bcd15d7a None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:28.290513 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f97c1-289d-4c24-8452-71c0bcd15d7a None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:28.291482 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f97c1-289d-4c24-8452-71c0bcd15d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:28.344565 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-f64f97c1-289d-4c24-8452-71c0bcd15d7a None None] MFA Rules not processed for user `aa705c6779a34c1e94b5325492079a63`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:28.346571 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-f64f97c1-289d-4c24-8452-71c0bcd15d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:28.483485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1112/2205] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:28.632890 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857f813-3ae7-4281-b1f3-fe877c38d15c service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:28.634953 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-7857f813-3ae7-4281-b1f3-fe877c38d15c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:28.639051 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb6dd7-78a3-4ea8-86a1-a07eeff8ded7 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:28.639654 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb6dd7-78a3-4ea8-86a1-a07eeff8ded7 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:28.640072 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb6dd7-78a3-4ea8-86a1-a07eeff8ded7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:28.673079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-73fb6dd7-78a3-4ea8-86a1-a07eeff8ded7 None None] MFA Rules not processed for user `c1d558f1f2f443e18d95a7cff604c691`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:28.674119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-73fb6dd7-78a3-4ea8-86a1-a07eeff8ded7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:28.733949 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857f813-3ae7-4281-b1f3-fe877c38d15c service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:28.781659 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1113/2206] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 06 20:28:28.820776 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08dbd7a-f529-4836-91a8-10cd1d8aec52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:28.822018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08dbd7a-f529-4836-91a8-10cd1d8aec52 service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:28.822377 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08dbd7a-f529-4836-91a8-10cd1d8aec52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:28.825112 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08dbd7a-f529-4836-91a8-10cd1d8aec52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:28.825112 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f08dbd7a-f529-4836-91a8-10cd1d8aec52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:28.973013 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08dbd7a-f529-4836-91a8-10cd1d8aec52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:28.975405 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08dbd7a-f529-4836-91a8-10cd1d8aec52 service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:28.987366 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1094/2207] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:28:29.057023 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb6dd7-78a3-4ea8-86a1-a07eeff8ded7 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:29.058968 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-73fb6dd7-78a3-4ea8-86a1-a07eeff8ded7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:29.249078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb6dd7-78a3-4ea8-86a1-a07eeff8ded7 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:29.275805 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:29.277650 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b505f-0f02-44d3-ac1e-6954fb94abd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:29.278393 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b505f-0f02-44d3-ac1e-6954fb94abd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:29.279831 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b505f-0f02-44d3-ac1e-6954fb94abd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:29.287742 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b505f-0f02-44d3-ac1e-6954fb94abd8 admin admin] PATH_INFO: `/v3/projects/3fb582d089de4ae6b26b132017a60751` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:29.287742 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b505f-0f02-44d3-ac1e-6954fb94abd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fb582d089de4ae6b26b132017a60751)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:29.287742 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b505f-0f02-44d3-ac1e-6954fb94abd8 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:29.455752 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-992b505f-0f02-44d3-ac1e-6954fb94abd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fb582d089de4ae6b26b132017a60751', 'request_id': 'req-992b505f-0f02-44d3-ac1e-6954fb94abd8'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:29.464313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-992b505f-0f02-44d3-ac1e-6954fb94abd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fb582d089de4ae6b26b132017a60751', 'request_id': 'req-992b505f-0f02-44d3-ac1e-6954fb94abd8'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:29.555813 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-992b505f-0f02-44d3-ac1e-6954fb94abd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fb582d089de4ae6b26b132017a60751', 'request_id': 'req-992b505f-0f02-44d3-ac1e-6954fb94abd8'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:29.582618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-992b505f-0f02-44d3-ac1e-6954fb94abd8 admin admin] The token cache is being invalidate because project 3fb582d089de4ae6b26b132017a60751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:29.584257 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-992b505f-0f02-44d3-ac1e-6954fb94abd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:29.585322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-992b505f-0f02-44d3-ac1e-6954fb94abd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:29.588179 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1114/2208] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:29 2022] DELETE /identity/v3/projects/3fb582d089de4ae6b26b132017a60751 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:29.593214 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08dbd7a-f529-4836-91a8-10cd1d8aec52 service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:29.612780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08dbd7a-f529-4836-91a8-10cd1d8aec52 service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:29.814090 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74320278-22a4-411c-892d-dc2ccc55e553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:29.814894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74320278-22a4-411c-892d-dc2ccc55e553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:29.815363 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74320278-22a4-411c-892d-dc2ccc55e553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:29.816724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74320278-22a4-411c-892d-dc2ccc55e553 admin admin] PATH_INFO: `/v3/users/5868bc807759466cadc9d79243200a0a` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:29.818402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74320278-22a4-411c-892d-dc2ccc55e553 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5868bc807759466cadc9d79243200a0a)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:29.820804 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74320278-22a4-411c-892d-dc2ccc55e553 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:30.138628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-74320278-22a4-411c-892d-dc2ccc55e553 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5868bc807759466cadc9d79243200a0a'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:30.249832 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-74320278-22a4-411c-892d-dc2ccc55e553 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5868bc807759466cadc9d79243200a0a'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:30.250728 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-74320278-22a4-411c-892d-dc2ccc55e553 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5868bc807759466cadc9d79243200a0a'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:30.251542 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-74320278-22a4-411c-892d-dc2ccc55e553 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5868bc807759466cadc9d79243200a0a'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:30.276896 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-74320278-22a4-411c-892d-dc2ccc55e553 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5868bc807759466cadc9d79243200a0a'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:30.297076 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1095/2209] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:28:29 2022] DELETE /identity/v3/users/5868bc807759466cadc9d79243200a0a => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:31.390471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:31.418210 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1aa4c-0586-4e85-9106-186b055f0ea3 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:31.418849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1aa4c-0586-4e85-9106-186b055f0ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:31.419313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1aa4c-0586-4e85-9106-186b055f0ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:31.460057 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-75c1aa4c-0586-4e85-9106-186b055f0ea3 None None] MFA Rules not processed for user `87d974bb5cf94567b1493fa54e804374`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:31.461672 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-75c1aa4c-0586-4e85-9106-186b055f0ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:31.528505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1115/2210] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:31.598198 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74320278-22a4-411c-892d-dc2ccc55e553 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:31.601150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-74320278-22a4-411c-892d-dc2ccc55e553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:31.718211 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74320278-22a4-411c-892d-dc2ccc55e553 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:31.723316 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93bc9b-6958-4e15-ad82-2d249bddc1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:31.724578 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93bc9b-6958-4e15-ad82-2d249bddc1aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:31.725043 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93bc9b-6958-4e15-ad82-2d249bddc1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:31.725290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93bc9b-6958-4e15-ad82-2d249bddc1aa admin admin] PATH_INFO: `/v3/projects/5f220e47d65a41fbbfae16eee69df085` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:31.727088 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c93bc9b-6958-4e15-ad82-2d249bddc1aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f220e47d65a41fbbfae16eee69df085)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:31.729180 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c93bc9b-6958-4e15-ad82-2d249bddc1aa admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:31.752664 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1aa4c-0586-4e85-9106-186b055f0ea3 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:31.754779 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-75c1aa4c-0586-4e85-9106-186b055f0ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:31.822743 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1aa4c-0586-4e85-9106-186b055f0ea3 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:31.826772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225367a-ca91-4d17-8a13-99fa583b3671 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:31.827471 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225367a-ca91-4d17-8a13-99fa583b3671 service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:31.827751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225367a-ca91-4d17-8a13-99fa583b3671 service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:31.828021 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225367a-ca91-4d17-8a13-99fa583b3671 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:31.829825 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-3225367a-ca91-4d17-8a13-99fa583b3671 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:31.904983 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225367a-ca91-4d17-8a13-99fa583b3671 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:31.906441 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225367a-ca91-4d17-8a13-99fa583b3671 service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:31.917051 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1116/2211] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:28:31.989075 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-3c93bc9b-6958-4e15-ad82-2d249bddc1aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f220e47d65a41fbbfae16eee69df085', 'request_id': 'req-3c93bc9b-6958-4e15-ad82-2d249bddc1aa'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:31.998059 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-3c93bc9b-6958-4e15-ad82-2d249bddc1aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f220e47d65a41fbbfae16eee69df085', 'request_id': 'req-3c93bc9b-6958-4e15-ad82-2d249bddc1aa'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:32.134040 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-3c93bc9b-6958-4e15-ad82-2d249bddc1aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f220e47d65a41fbbfae16eee69df085', 'request_id': 'req-3c93bc9b-6958-4e15-ad82-2d249bddc1aa'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:32.149360 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-3c93bc9b-6958-4e15-ad82-2d249bddc1aa admin admin] The token cache is being invalidate because project 5f220e47d65a41fbbfae16eee69df085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:32.161640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-3c93bc9b-6958-4e15-ad82-2d249bddc1aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:32.161640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-3c93bc9b-6958-4e15-ad82-2d249bddc1aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:32.161640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1096/2212] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:31 2022] DELETE /identity/v3/projects/5f220e47d65a41fbbfae16eee69df085 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:32.163228 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20902de-c24d-470c-9be8-5c30a69c50dc None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:32.163545 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20902de-c24d-470c-9be8-5c30a69c50dc None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:32.163816 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20902de-c24d-470c-9be8-5c30a69c50dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:32.187083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-c20902de-c24d-470c-9be8-5c30a69c50dc None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:32.189005 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-c20902de-c24d-470c-9be8-5c30a69c50dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:32.213365 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:32.290011 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1117/2213] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:32.304852 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c27b1f-3de9-4f9d-8ab5-3411d7f38b56 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:32.305158 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c27b1f-3de9-4f9d-8ab5-3411d7f38b56 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:32.305437 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c27b1f-3de9-4f9d-8ab5-3411d7f38b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:32.344348 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-49c27b1f-3de9-4f9d-8ab5-3411d7f38b56 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:32.345066 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-49c27b1f-3de9-4f9d-8ab5-3411d7f38b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:32.361557 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1097/2214] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:32.365624 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20902de-c24d-470c-9be8-5c30a69c50dc None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:32.380188 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20902de-c24d-470c-9be8-5c30a69c50dc None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:32.388401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7570b6-d127-4fde-b9ab-12146c4cb6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:32.395478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7570b6-d127-4fde-b9ab-12146c4cb6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:32.395478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7570b6-d127-4fde-b9ab-12146c4cb6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:32.395478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7570b6-d127-4fde-b9ab-12146c4cb6b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:32.395478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7570b6-d127-4fde-b9ab-12146c4cb6b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:28:32.395478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7570b6-d127-4fde-b9ab-12146c4cb6b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:32.395478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7570b6-d127-4fde-b9ab-12146c4cb6b2 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:32.434064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c27b1f-3de9-4f9d-8ab5-3411d7f38b56 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:32.434610 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1118/2215] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:28:32.451608 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c27b1f-3de9-4f9d-8ab5-3411d7f38b56 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:32.480702 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd44c1-b590-4989-9161-2de84c147370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:32.484522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd44c1-b590-4989-9161-2de84c147370 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:32.484522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd44c1-b590-4989-9161-2de84c147370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:32.484522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd44c1-b590-4989-9161-2de84c147370 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:32.484522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd44c1-b590-4989-9161-2de84c147370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:32.490944 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd44c1-b590-4989-9161-2de84c147370 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:32.597588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7570b6-d127-4fde-b9ab-12146c4cb6b2 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:32.600094 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ff7570b6-d127-4fde-b9ab-12146c4cb6b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:32.614759 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7570b6-d127-4fde-b9ab-12146c4cb6b2 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:32.619904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e7ee7-2006-45d6-8858-b9276e4dce26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:32.620571 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e7ee7-2006-45d6-8858-b9276e4dce26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:32.620913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e7ee7-2006-45d6-8858-b9276e4dce26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:32.621183 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e7ee7-2006-45d6-8858-b9276e4dce26 admin admin] PATH_INFO: `/v3/users/9413932ff6c1434cb536c7bf30cb1161` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:32.622402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e7ee7-2006-45d6-8858-b9276e4dce26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9413932ff6c1434cb536c7bf30cb1161)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:32.624402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e7ee7-2006-45d6-8858-b9276e4dce26 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:32.672200 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1098/2216] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:28:32 2022] POST /identity/v3/projects => generated 385 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:32.677251 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd44c1-b590-4989-9161-2de84c147370 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:32.744752 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd44c1-b590-4989-9161-2de84c147370 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:32.749864 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9f52e-66e8-4652-83d5-fbc917c35142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:32.750493 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9f52e-66e8-4652-83d5-fbc917c35142 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:32.750764 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9f52e-66e8-4652-83d5-fbc917c35142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:32.751041 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9f52e-66e8-4652-83d5-fbc917c35142 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:32.751706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9f52e-66e8-4652-83d5-fbc917c35142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:32.753789 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9f52e-66e8-4652-83d5-fbc917c35142 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:32.921140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1099/2217] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:28:32 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:32.925357 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9f52e-66e8-4652-83d5-fbc917c35142 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:32.936487 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9f52e-66e8-4652-83d5-fbc917c35142 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:32.949155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d237ab7-e36b-4554-921b-a7a62ec18685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:32.949782 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d237ab7-e36b-4554-921b-a7a62ec18685 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:32.950067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d237ab7-e36b-4554-921b-a7a62ec18685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:32.950340 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d237ab7-e36b-4554-921b-a7a62ec18685 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:32.950999 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d237ab7-e36b-4554-921b-a7a62ec18685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:32.952644 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d237ab7-e36b-4554-921b-a7a62ec18685 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:32.964969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-581e7ee7-2006-45d6-8858-b9276e4dce26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9413932ff6c1434cb536c7bf30cb1161'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:32.968139 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1100/2218] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:32.969099 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d237ab7-e36b-4554-921b-a7a62ec18685 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:32.981981 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d237ab7-e36b-4554-921b-a7a62ec18685 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:32.987235 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a477a9f-a844-477f-9b27-45f802dd82b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:32.988032 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a477a9f-a844-477f-9b27-45f802dd82b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:32.988326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a477a9f-a844-477f-9b27-45f802dd82b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:32.988609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a477a9f-a844-477f-9b27-45f802dd82b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:32.989263 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a477a9f-a844-477f-9b27-45f802dd82b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:32.990874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a477a9f-a844-477f-9b27-45f802dd82b9 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:33.002146 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1101/2219] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:33.008098 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a477a9f-a844-477f-9b27-45f802dd82b9 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:33.019346 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a477a9f-a844-477f-9b27-45f802dd82b9 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:33.030501 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb22c12-6f26-4028-91b6-e67394504d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:33.031294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb22c12-6f26-4028-91b6-e67394504d63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:33.031617 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb22c12-6f26-4028-91b6-e67394504d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:33.031893 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb22c12-6f26-4028-91b6-e67394504d63 admin admin] PATH_INFO: `/v3/projects/19e7288648a84e7a9fa15b30f75861f2/users/b422c66adfec4d309ffecf0704ec0ff6/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:33.049205 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb22c12-6f26-4028-91b6-e67394504d63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19e7288648a84e7a9fa15b30f75861f2, user_id=b422c66adfec4d309ffecf0704ec0ff6, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:33.051994 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb22c12-6f26-4028-91b6-e67394504d63 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:33.068124 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-581e7ee7-2006-45d6-8858-b9276e4dce26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9413932ff6c1434cb536c7bf30cb1161'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:33.068767 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-581e7ee7-2006-45d6-8858-b9276e4dce26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9413932ff6c1434cb536c7bf30cb1161'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:33.069469 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-581e7ee7-2006-45d6-8858-b9276e4dce26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9413932ff6c1434cb536c7bf30cb1161'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:33.078443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-581e7ee7-2006-45d6-8858-b9276e4dce26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9413932ff6c1434cb536c7bf30cb1161'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:33.097147 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1119/2220] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:28:32 2022] DELETE /identity/v3/users/9413932ff6c1434cb536c7bf30cb1161 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:28:33.102092 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96382c-7dc8-4cdf-8701-a6f602f38111 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:33.102384 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96382c-7dc8-4cdf-8701-a6f602f38111 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:33.102664 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96382c-7dc8-4cdf-8701-a6f602f38111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:33.122076 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-3d96382c-7dc8-4cdf-8701-a6f602f38111 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:33.123251 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-3d96382c-7dc8-4cdf-8701-a6f602f38111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:33.162329 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1102/2221] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:33 2022] PUT /identity/v3/projects/19e7288648a84e7a9fa15b30f75861f2/users/b422c66adfec4d309ffecf0704ec0ff6/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:28:33.174532 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce323e7f-af49-4a9e-98bf-5a1102a06b2d None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:33.174819 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce323e7f-af49-4a9e-98bf-5a1102a06b2d None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:33.199780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce323e7f-af49-4a9e-98bf-5a1102a06b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:33.204854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1120/2222] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:28:33.217526 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96382c-7dc8-4cdf-8701-a6f602f38111 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:33.219261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-3d96382c-7dc8-4cdf-8701-a6f602f38111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:33.229727 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-ce323e7f-af49-4a9e-98bf-5a1102a06b2d None None] MFA Rules not processed for user `b422c66adfec4d309ffecf0704ec0ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:33.232416 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-ce323e7f-af49-4a9e-98bf-5a1102a06b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:33.292595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96382c-7dc8-4cdf-8701-a6f602f38111 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:33.370553 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77461955-40b4-463b-9f85-d5350723ef1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:33.371406 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77461955-40b4-463b-9f85-d5350723ef1d service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:33.371808 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1103/2223] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:33.372284 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77461955-40b4-463b-9f85-d5350723ef1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:33.372880 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77461955-40b4-463b-9f85-d5350723ef1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:33.376159 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce323e7f-af49-4a9e-98bf-5a1102a06b2d None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:33.377940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-ce323e7f-af49-4a9e-98bf-5a1102a06b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:33.474301 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77461955-40b4-463b-9f85-d5350723ef1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:33.475790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77461955-40b4-463b-9f85-d5350723ef1d service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:33.484652 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce323e7f-af49-4a9e-98bf-5a1102a06b2d None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:33.490671 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3fcad-d6a7-4679-95e9-b224b259824f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:33.491304 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3fcad-d6a7-4679-95e9-b224b259824f admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:33.491794 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3fcad-d6a7-4679-95e9-b224b259824f admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:33.492069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3fcad-d6a7-4679-95e9-b224b259824f admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:33.492830 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3fcad-d6a7-4679-95e9-b224b259824f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:33.494917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3fcad-d6a7-4679-95e9-b224b259824f admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:33.499771 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1121/2224] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:28:33.613569 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1104/2225] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:28:33 2022] POST /identity/v3/projects => generated 387 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:28:33.617697 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77461955-40b4-463b-9f85-d5350723ef1d service neutron] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:33.633140 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77461955-40b4-463b-9f85-d5350723ef1d service neutron] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:33.726124 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35a2db-f2aa-4b8f-879f-004838b2a672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:33.726483 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35a2db-f2aa-4b8f-879f-004838b2a672 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:33.728442 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35a2db-f2aa-4b8f-879f-004838b2a672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:33.728442 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35a2db-f2aa-4b8f-879f-004838b2a672 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:33.730907 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35a2db-f2aa-4b8f-879f-004838b2a672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:33.736722 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35a2db-f2aa-4b8f-879f-004838b2a672 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:33.869584 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1122/2226] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:28:33 2022] POST /identity/v3/users => generated 300 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:33.875412 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3fcad-d6a7-4679-95e9-b224b259824f admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:33.897297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3fcad-d6a7-4679-95e9-b224b259824f admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:33.901536 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35a2db-f2aa-4b8f-879f-004838b2a672 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:33.903248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46f8b2-7628-47b7-aa09-408b2bffe0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:33.904001 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46f8b2-7628-47b7-aa09-408b2bffe0e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:33.904144 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-6e35a2db-f2aa-4b8f-879f-004838b2a672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:33.904335 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46f8b2-7628-47b7-aa09-408b2bffe0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:33.904767 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46f8b2-7628-47b7-aa09-408b2bffe0e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:33.905457 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46f8b2-7628-47b7-aa09-408b2bffe0e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:33.907610 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46f8b2-7628-47b7-aa09-408b2bffe0e7 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:33.923494 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1105/2227] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:33.927316 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46f8b2-7628-47b7-aa09-408b2bffe0e7 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:33.943186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46f8b2-7628-47b7-aa09-408b2bffe0e7 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:33.952555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a956be4-fdad-4a44-b3d0-bc0f4db73568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:33.954317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a956be4-fdad-4a44-b3d0-bc0f4db73568 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:33.954317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a956be4-fdad-4a44-b3d0-bc0f4db73568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:33.955060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a956be4-fdad-4a44-b3d0-bc0f4db73568 admin admin] PATH_INFO: `/v3/projects/5d745dfbc44248cfa234ffc74ffec8e7/users/62b3061eeab648a9b5cb78f0a4466113/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:33.982569 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a956be4-fdad-4a44-b3d0-bc0f4db73568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d745dfbc44248cfa234ffc74ffec8e7, user_id=62b3061eeab648a9b5cb78f0a4466113, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:33.985766 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a956be4-fdad-4a44-b3d0-bc0f4db73568 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:34.008995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35a2db-f2aa-4b8f-879f-004838b2a672 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:34.015256 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bdfe6-e8ba-4a8c-9591-c2697ff75dc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:34.015256 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bdfe6-e8ba-4a8c-9591-c2697ff75dc7 service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:34.015256 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bdfe6-e8ba-4a8c-9591-c2697ff75dc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:34.015256 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bdfe6-e8ba-4a8c-9591-c2697ff75dc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:34.015932 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-c10bdfe6-e8ba-4a8c-9591-c2697ff75dc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:34.090330 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bdfe6-e8ba-4a8c-9591-c2697ff75dc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:34.092917 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bdfe6-e8ba-4a8c-9591-c2697ff75dc7 service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:34.097218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1106/2228] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:33 2022] PUT /identity/v3/projects/5d745dfbc44248cfa234ffc74ffec8e7/users/62b3061eeab648a9b5cb78f0a4466113/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:34.099083 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a956be4-fdad-4a44-b3d0-bc0f4db73568 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:34.101316 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-9a956be4-fdad-4a44-b3d0-bc0f4db73568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:34.111530 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1123/2229] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:28:34.112980 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bdfe6-e8ba-4a8c-9591-c2697ff75dc7 service cinder] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:34.125815 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bdfe6-e8ba-4a8c-9591-c2697ff75dc7 service cinder] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:34.187687 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a956be4-fdad-4a44-b3d0-bc0f4db73568 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:34.193124 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd3aa8-ee5d-4119-b0bc-bdd94cbaac63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:34.194216 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd3aa8-ee5d-4119-b0bc-bdd94cbaac63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:34.195218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd3aa8-ee5d-4119-b0bc-bdd94cbaac63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:34.195611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd3aa8-ee5d-4119-b0bc-bdd94cbaac63 admin admin] PATH_INFO: `/v3/projects/e6854c84d3b04d9ba9f1527f29513b5c` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:34.196939 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd3aa8-ee5d-4119-b0bc-bdd94cbaac63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6854c84d3b04d9ba9f1527f29513b5c)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:34.199112 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd3aa8-ee5d-4119-b0bc-bdd94cbaac63 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:34.203037 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa404448-c622-44cf-aa58-77e902a5d493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:34.203973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa404448-c622-44cf-aa58-77e902a5d493 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:34.204321 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa404448-c622-44cf-aa58-77e902a5d493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:34.204475 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa404448-c622-44cf-aa58-77e902a5d493 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:34.205118 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa404448-c622-44cf-aa58-77e902a5d493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:34.206811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa404448-c622-44cf-aa58-77e902a5d493 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:34.217951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1124/2230] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:34.222392 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa404448-c622-44cf-aa58-77e902a5d493 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:34.234402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa404448-c622-44cf-aa58-77e902a5d493 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:34.240510 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d8cf8-8e96-4d52-bc23-3926466eb97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:34.241212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d8cf8-8e96-4d52-bc23-3926466eb97c admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:34.241492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d8cf8-8e96-4d52-bc23-3926466eb97c admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:34.241765 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d8cf8-8e96-4d52-bc23-3926466eb97c admin admin] PATH_INFO: `/v3/projects/5d745dfbc44248cfa234ffc74ffec8e7/users/62b3061eeab648a9b5cb78f0a4466113/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:34.243814 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d8cf8-8e96-4d52-bc23-3926466eb97c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d745dfbc44248cfa234ffc74ffec8e7, user_id=62b3061eeab648a9b5cb78f0a4466113, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:34.246625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d8cf8-8e96-4d52-bc23-3926466eb97c admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:34.259160 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1125/2231] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:34 2022] PUT /identity/v3/projects/5d745dfbc44248cfa234ffc74ffec8e7/users/62b3061eeab648a9b5cb78f0a4466113/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:34.269425 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e9792-8a11-42c1-aded-b887d55611fb None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:34.269713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e9792-8a11-42c1-aded-b887d55611fb None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:34.269991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e9792-8a11-42c1-aded-b887d55611fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:34.302820 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-257e9792-8a11-42c1-aded-b887d55611fb None None] MFA Rules not processed for user `62b3061eeab648a9b5cb78f0a4466113`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:34.305044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-257e9792-8a11-42c1-aded-b887d55611fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:34.322276 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-cbbd3aa8-ee5d-4119-b0bc-bdd94cbaac63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6854c84d3b04d9ba9f1527f29513b5c', 'request_id': 'req-cbbd3aa8-ee5d-4119-b0bc-bdd94cbaac63'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:34.328964 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-cbbd3aa8-ee5d-4119-b0bc-bdd94cbaac63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6854c84d3b04d9ba9f1527f29513b5c', 'request_id': 'req-cbbd3aa8-ee5d-4119-b0bc-bdd94cbaac63'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:34.398030 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1126/2232] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:34 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:28:34.408720 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e9792-8a11-42c1-aded-b887d55611fb None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:34.441740 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-cbbd3aa8-ee5d-4119-b0bc-bdd94cbaac63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6854c84d3b04d9ba9f1527f29513b5c', 'request_id': 'req-cbbd3aa8-ee5d-4119-b0bc-bdd94cbaac63'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:34.454230 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-cbbd3aa8-ee5d-4119-b0bc-bdd94cbaac63 admin admin] The token cache is being invalidate because project e6854c84d3b04d9ba9f1527f29513b5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:34.454555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-cbbd3aa8-ee5d-4119-b0bc-bdd94cbaac63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:34.455356 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-cbbd3aa8-ee5d-4119-b0bc-bdd94cbaac63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:34.457208 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1107/2233] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:34 2022] DELETE /identity/v3/projects/e6854c84d3b04d9ba9f1527f29513b5c => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:34.459888 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:34.463321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd3aa8-ee5d-4119-b0bc-bdd94cbaac63 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:34.464815 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-cbbd3aa8-ee5d-4119-b0bc-bdd94cbaac63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:34.489419 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e9792-8a11-42c1-aded-b887d55611fb None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:34.551546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e376ac5-c3ec-4a9f-b626-87576713c693 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:34.552212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e376ac5-c3ec-4a9f-b626-87576713c693 service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:34.552585 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e376ac5-c3ec-4a9f-b626-87576713c693 service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:34.552873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e376ac5-c3ec-4a9f-b626-87576713c693 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:34.555118 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-9e376ac5-c3ec-4a9f-b626-87576713c693 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:34.559595 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd3aa8-ee5d-4119-b0bc-bdd94cbaac63 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:34.565247 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac19e2e-ce35-419d-8c7b-97016ad4a226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:34.565910 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac19e2e-ce35-419d-8c7b-97016ad4a226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:34.567527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac19e2e-ce35-419d-8c7b-97016ad4a226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:34.568190 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac19e2e-ce35-419d-8c7b-97016ad4a226 admin admin] PATH_INFO: `/v3/users/18415bec9e6049b68da5676264361b52` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:34.569500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac19e2e-ce35-419d-8c7b-97016ad4a226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18415bec9e6049b68da5676264361b52)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:34.571483 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac19e2e-ce35-419d-8c7b-97016ad4a226 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:34.641693 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e376ac5-c3ec-4a9f-b626-87576713c693 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:34.643922 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e376ac5-c3ec-4a9f-b626-87576713c693 service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:34.661814 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1127/2234] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:34 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:28:34.826463 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:34.857184 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-fac19e2e-ce35-419d-8c7b-97016ad4a226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18415bec9e6049b68da5676264361b52'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:34.995208 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-fac19e2e-ce35-419d-8c7b-97016ad4a226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18415bec9e6049b68da5676264361b52'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:34.995872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-fac19e2e-ce35-419d-8c7b-97016ad4a226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18415bec9e6049b68da5676264361b52'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:34.996601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-fac19e2e-ce35-419d-8c7b-97016ad4a226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18415bec9e6049b68da5676264361b52'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:35.005435 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-fac19e2e-ce35-419d-8c7b-97016ad4a226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18415bec9e6049b68da5676264361b52'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:35.028903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1108/2235] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:28:34 2022] DELETE /identity/v3/users/18415bec9e6049b68da5676264361b52 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:35.619784 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e376ac5-c3ec-4a9f-b626-87576713c693 service cinder] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:35.630732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac19e2e-ce35-419d-8c7b-97016ad4a226 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:35.637175 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-fac19e2e-ce35-419d-8c7b-97016ad4a226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:35.639774 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e376ac5-c3ec-4a9f-b626-87576713c693 service cinder] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:35.800507 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c47ecd-3817-45d3-a8f4-f73277d74acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:35.802271 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c47ecd-3817-45d3-a8f4-f73277d74acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:35.805440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c47ecd-3817-45d3-a8f4-f73277d74acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:35.808902 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c47ecd-3817-45d3-a8f4-f73277d74acf admin admin] PATH_INFO: `/v3/projects/7dbb3b30525d4b86855e2a5fee70f8fc` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:35.810444 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c47ecd-3817-45d3-a8f4-f73277d74acf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dbb3b30525d4b86855e2a5fee70f8fc)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:35.821348 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c47ecd-3817-45d3-a8f4-f73277d74acf admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:35.829291 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac19e2e-ce35-419d-8c7b-97016ad4a226 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:35.836550 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f70efb-fae3-4b3f-a4e0-8648de90176f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:35.838644 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f70efb-fae3-4b3f-a4e0-8648de90176f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:35.839069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f70efb-fae3-4b3f-a4e0-8648de90176f admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:35.839615 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f70efb-fae3-4b3f-a4e0-8648de90176f admin admin] PATH_INFO: `/v3/users/e52d4965209b4351b3c4feb76517e897` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:35.842169 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f70efb-fae3-4b3f-a4e0-8648de90176f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e52d4965209b4351b3c4feb76517e897)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:35.846105 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f70efb-fae3-4b3f-a4e0-8648de90176f admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:35.949802 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:36.156818 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c2f70efb-fae3-4b3f-a4e0-8648de90176f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e52d4965209b4351b3c4feb76517e897'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:36.157071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-18c47ecd-3817-45d3-a8f4-f73277d74acf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dbb3b30525d4b86855e2a5fee70f8fc', 'request_id': 'req-18c47ecd-3817-45d3-a8f4-f73277d74acf'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:36.167413 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-18c47ecd-3817-45d3-a8f4-f73277d74acf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dbb3b30525d4b86855e2a5fee70f8fc', 'request_id': 'req-18c47ecd-3817-45d3-a8f4-f73277d74acf'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:36.298569 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c2f70efb-fae3-4b3f-a4e0-8648de90176f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e52d4965209b4351b3c4feb76517e897'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:36.300266 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c2f70efb-fae3-4b3f-a4e0-8648de90176f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e52d4965209b4351b3c4feb76517e897'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:36.300889 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c2f70efb-fae3-4b3f-a4e0-8648de90176f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e52d4965209b4351b3c4feb76517e897'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:36.309869 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c2f70efb-fae3-4b3f-a4e0-8648de90176f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e52d4965209b4351b3c4feb76517e897'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:36.341037 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1109/2236] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:28:35 2022] DELETE /identity/v3/users/e52d4965209b4351b3c4feb76517e897 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:28:36.347575 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941ca39-6d5d-4f7d-891b-e48514494311 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:36.347842 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941ca39-6d5d-4f7d-891b-e48514494311 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:36.348153 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941ca39-6d5d-4f7d-891b-e48514494311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:36.372534 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-6941ca39-6d5d-4f7d-891b-e48514494311 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:36.373848 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6941ca39-6d5d-4f7d-891b-e48514494311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:36.422848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-18c47ecd-3817-45d3-a8f4-f73277d74acf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dbb3b30525d4b86855e2a5fee70f8fc', 'request_id': 'req-18c47ecd-3817-45d3-a8f4-f73277d74acf'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:36.443326 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-18c47ecd-3817-45d3-a8f4-f73277d74acf admin admin] The token cache is being invalidate because project 7dbb3b30525d4b86855e2a5fee70f8fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:36.444606 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-18c47ecd-3817-45d3-a8f4-f73277d74acf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:36.448299 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-18c47ecd-3817-45d3-a8f4-f73277d74acf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:36.458573 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1128/2237] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:35 2022] DELETE /identity/v3/projects/7dbb3b30525d4b86855e2a5fee70f8fc => generated 0 bytes in 840 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:36.471067 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c47ecd-3817-45d3-a8f4-f73277d74acf admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:36.472908 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-18c47ecd-3817-45d3-a8f4-f73277d74acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:36.510657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1110/2238] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:28:36.522603 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941ca39-6d5d-4f7d-891b-e48514494311 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:36.526762 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6941ca39-6d5d-4f7d-891b-e48514494311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:36.594594 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c47ecd-3817-45d3-a8f4-f73277d74acf admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:36.610076 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9a569-9eca-472d-a3b4-c99ca36d7ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:36.610867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9a569-9eca-472d-a3b4-c99ca36d7ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:36.611273 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9a569-9eca-472d-a3b4-c99ca36d7ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:36.611637 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9a569-9eca-472d-a3b4-c99ca36d7ed5 admin admin] PATH_INFO: `/v3/users/59f48bceaeb747528a9155fb01d12391` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:36.612914 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9a569-9eca-472d-a3b4-c99ca36d7ed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59f48bceaeb747528a9155fb01d12391)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:36.616639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9a569-9eca-472d-a3b4-c99ca36d7ed5 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:36.629013 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941ca39-6d5d-4f7d-891b-e48514494311 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:36.634317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c3de6-7f5f-4a99-b83f-abf83ce34b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:36.634962 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c3de6-7f5f-4a99-b83f-abf83ce34b10 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:36.636779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c3de6-7f5f-4a99-b83f-abf83ce34b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:36.636779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c3de6-7f5f-4a99-b83f-abf83ce34b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:36.649764 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c3de6-7f5f-4a99-b83f-abf83ce34b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:36.651454 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c3de6-7f5f-4a99-b83f-abf83ce34b10 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:36.664647 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1111/2239] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:28:36.665690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c3de6-7f5f-4a99-b83f-abf83ce34b10 service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:36.671714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-265c3de6-7f5f-4a99-b83f-abf83ce34b10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:36.688355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c3de6-7f5f-4a99-b83f-abf83ce34b10 service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:36.704046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a685780-f2cd-4eb6-bfd4-1b3cfbe198e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:36.704866 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a685780-f2cd-4eb6-bfd4-1b3cfbe198e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:36.705207 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a685780-f2cd-4eb6-bfd4-1b3cfbe198e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:36.705998 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a685780-f2cd-4eb6-bfd4-1b3cfbe198e4 admin admin] PATH_INFO: `/v3/users/b422c66adfec4d309ffecf0704ec0ff6` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:36.706886 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a685780-f2cd-4eb6-bfd4-1b3cfbe198e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b422c66adfec4d309ffecf0704ec0ff6)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:36.709413 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a685780-f2cd-4eb6-bfd4-1b3cfbe198e4 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:36.850526 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-e5d9a569-9eca-472d-a3b4-c99ca36d7ed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59f48bceaeb747528a9155fb01d12391'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:36.953371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-e5d9a569-9eca-472d-a3b4-c99ca36d7ed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59f48bceaeb747528a9155fb01d12391'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:36.955697 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-e5d9a569-9eca-472d-a3b4-c99ca36d7ed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59f48bceaeb747528a9155fb01d12391'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:36.959158 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-e5d9a569-9eca-472d-a3b4-c99ca36d7ed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59f48bceaeb747528a9155fb01d12391'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:36.973975 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-8a685780-f2cd-4eb6-bfd4-1b3cfbe198e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b422c66adfec4d309ffecf0704ec0ff6'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:36.980514 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-e5d9a569-9eca-472d-a3b4-c99ca36d7ed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59f48bceaeb747528a9155fb01d12391'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:37.019893 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1129/2240] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:28:36 2022] DELETE /identity/v3/users/59f48bceaeb747528a9155fb01d12391 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:37.025436 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-8a685780-f2cd-4eb6-bfd4-1b3cfbe198e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b422c66adfec4d309ffecf0704ec0ff6'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:37.026363 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-8a685780-f2cd-4eb6-bfd4-1b3cfbe198e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b422c66adfec4d309ffecf0704ec0ff6'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:37.027292 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-8a685780-f2cd-4eb6-bfd4-1b3cfbe198e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b422c66adfec4d309ffecf0704ec0ff6'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:37.028871 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:37.037264 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-8a685780-f2cd-4eb6-bfd4-1b3cfbe198e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b422c66adfec4d309ffecf0704ec0ff6'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:37.072010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1112/2241] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:28:36 2022] DELETE /identity/v3/users/b422c66adfec4d309ffecf0704ec0ff6 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:37.077224 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27818333-7f97-4454-b737-69c560e6ee61 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:37.077416 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27818333-7f97-4454-b737-69c560e6ee61 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:37.078935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27818333-7f97-4454-b737-69c560e6ee61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:37.108883 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-27818333-7f97-4454-b737-69c560e6ee61 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:37.114769 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-27818333-7f97-4454-b737-69c560e6ee61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:37.201516 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1130/2242] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:37.219821 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a685780-f2cd-4eb6-bfd4-1b3cfbe198e4 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:37.222403 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-8a685780-f2cd-4eb6-bfd4-1b3cfbe198e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:37.328239 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a685780-f2cd-4eb6-bfd4-1b3cfbe198e4 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:37.332013 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c62e4-3c3b-4f4d-90c9-eb1bd28b89b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:37.333732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c62e4-3c3b-4f4d-90c9-eb1bd28b89b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:37.334014 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c62e4-3c3b-4f4d-90c9-eb1bd28b89b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:37.334307 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c62e4-3c3b-4f4d-90c9-eb1bd28b89b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:37.345062 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c62e4-3c3b-4f4d-90c9-eb1bd28b89b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:37.346609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c62e4-3c3b-4f4d-90c9-eb1bd28b89b0 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:37.359934 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1113/2243] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:28:38.036048 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27818333-7f97-4454-b737-69c560e6ee61 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:38.039944 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-27818333-7f97-4454-b737-69c560e6ee61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:38.060436 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27818333-7f97-4454-b737-69c560e6ee61 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:38.098390 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d1fdb-ef56-4c69-8d68-ac3efae456f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:38.098639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d1fdb-ef56-4c69-8d68-ac3efae456f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:38.099086 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d1fdb-ef56-4c69-8d68-ac3efae456f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:38.099519 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d1fdb-ef56-4c69-8d68-ac3efae456f7 admin admin] PATH_INFO: `/v3/projects/01a52b767c284d72bf5e5b1fb0a2c75f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:38.101145 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d1fdb-ef56-4c69-8d68-ac3efae456f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01a52b767c284d72bf5e5b1fb0a2c75f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:38.104548 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d1fdb-ef56-4c69-8d68-ac3efae456f7 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:38.109492 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:38.289959 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f86d1fdb-ef56-4c69-8d68-ac3efae456f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01a52b767c284d72bf5e5b1fb0a2c75f', 'request_id': 'req-f86d1fdb-ef56-4c69-8d68-ac3efae456f7'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:38.299421 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f86d1fdb-ef56-4c69-8d68-ac3efae456f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01a52b767c284d72bf5e5b1fb0a2c75f', 'request_id': 'req-f86d1fdb-ef56-4c69-8d68-ac3efae456f7'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:38.347160 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c62e4-3c3b-4f4d-90c9-eb1bd28b89b0 service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:38.349189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-7b2c62e4-3c3b-4f4d-90c9-eb1bd28b89b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:38.368136 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f86d1fdb-ef56-4c69-8d68-ac3efae456f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01a52b767c284d72bf5e5b1fb0a2c75f', 'request_id': 'req-f86d1fdb-ef56-4c69-8d68-ac3efae456f7'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:38.373467 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c62e4-3c3b-4f4d-90c9-eb1bd28b89b0 service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:38.394360 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f86d1fdb-ef56-4c69-8d68-ac3efae456f7 admin admin] The token cache is being invalidate because project 01a52b767c284d72bf5e5b1fb0a2c75f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:38.397008 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f86d1fdb-ef56-4c69-8d68-ac3efae456f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:38.400215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f86d1fdb-ef56-4c69-8d68-ac3efae456f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:38.403672 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1131/2244] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:38 2022] DELETE /identity/v3/projects/01a52b767c284d72bf5e5b1fb0a2c75f => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:38.483175 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd4e10-2bf9-4ac5-b0a2-ae180fcc45f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:38.485045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd4e10-2bf9-4ac5-b0a2-ae180fcc45f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:38.486118 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd4e10-2bf9-4ac5-b0a2-ae180fcc45f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:38.487002 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd4e10-2bf9-4ac5-b0a2-ae180fcc45f8 admin admin] PATH_INFO: `/v3/projects/19e7288648a84e7a9fa15b30f75861f2` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:38.490337 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd4e10-2bf9-4ac5-b0a2-ae180fcc45f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19e7288648a84e7a9fa15b30f75861f2)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:38.496166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd4e10-2bf9-4ac5-b0a2-ae180fcc45f8 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:38.527810 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d1fdb-ef56-4c69-8d68-ac3efae456f7 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:38.530019 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-f86d1fdb-ef56-4c69-8d68-ac3efae456f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:38.555804 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d1fdb-ef56-4c69-8d68-ac3efae456f7 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:38.589231 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373b969-ada8-4822-9d66-221754793a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:38.590002 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373b969-ada8-4822-9d66-221754793a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:38.590353 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373b969-ada8-4822-9d66-221754793a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:38.590693 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373b969-ada8-4822-9d66-221754793a46 admin admin] PATH_INFO: `/v3/projects/0cc614b7910949c09f61bb48305e0db2` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:38.592048 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373b969-ada8-4822-9d66-221754793a46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cc614b7910949c09f61bb48305e0db2)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:38.594994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373b969-ada8-4822-9d66-221754793a46 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:38.702865 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-eecd4e10-2bf9-4ac5-b0a2-ae180fcc45f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19e7288648a84e7a9fa15b30f75861f2', 'request_id': 'req-eecd4e10-2bf9-4ac5-b0a2-ae180fcc45f8'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:38.724780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-eecd4e10-2bf9-4ac5-b0a2-ae180fcc45f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19e7288648a84e7a9fa15b30f75861f2', 'request_id': 'req-eecd4e10-2bf9-4ac5-b0a2-ae180fcc45f8'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:38.764999 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-5373b969-ada8-4822-9d66-221754793a46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cc614b7910949c09f61bb48305e0db2', 'request_id': 'req-5373b969-ada8-4822-9d66-221754793a46'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:38.775830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-5373b969-ada8-4822-9d66-221754793a46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cc614b7910949c09f61bb48305e0db2', 'request_id': 'req-5373b969-ada8-4822-9d66-221754793a46'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:38.867060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-eecd4e10-2bf9-4ac5-b0a2-ae180fcc45f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19e7288648a84e7a9fa15b30f75861f2', 'request_id': 'req-eecd4e10-2bf9-4ac5-b0a2-ae180fcc45f8'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:38.896081 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-eecd4e10-2bf9-4ac5-b0a2-ae180fcc45f8 admin admin] The token cache is being invalidate because project 19e7288648a84e7a9fa15b30f75861f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:38.897284 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-eecd4e10-2bf9-4ac5-b0a2-ae180fcc45f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:38.898245 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-eecd4e10-2bf9-4ac5-b0a2-ae180fcc45f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:38.900417 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1114/2245] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:38 2022] DELETE /identity/v3/projects/19e7288648a84e7a9fa15b30f75861f2 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:38.904348 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd4e10-2bf9-4ac5-b0a2-ae180fcc45f8 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:38.905740 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-eecd4e10-2bf9-4ac5-b0a2-ae180fcc45f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:38.954924 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-5373b969-ada8-4822-9d66-221754793a46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cc614b7910949c09f61bb48305e0db2', 'request_id': 'req-5373b969-ada8-4822-9d66-221754793a46'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:38.969398 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-5373b969-ada8-4822-9d66-221754793a46 admin admin] The token cache is being invalidate because project 0cc614b7910949c09f61bb48305e0db2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:38.971567 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-5373b969-ada8-4822-9d66-221754793a46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:38.974991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-5373b969-ada8-4822-9d66-221754793a46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:38.976927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1132/2246] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:38 2022] DELETE /identity/v3/projects/0cc614b7910949c09f61bb48305e0db2 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:28:38.982963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785011a-cd01-422d-afee-57081f154194 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:38.983251 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785011a-cd01-422d-afee-57081f154194 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:38.983552 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785011a-cd01-422d-afee-57081f154194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:38.992912 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd4e10-2bf9-4ac5-b0a2-ae180fcc45f8 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:39.039384 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-2785011a-cd01-422d-afee-57081f154194 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:39.040656 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-2785011a-cd01-422d-afee-57081f154194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:39.070303 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2e21f-8c6f-47b6-b965-5e67606531ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:39.073499 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2e21f-8c6f-47b6-b965-5e67606531ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:39.073788 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2e21f-8c6f-47b6-b965-5e67606531ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:39.074067 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2e21f-8c6f-47b6-b965-5e67606531ae admin admin] PATH_INFO: `/v3/users/62b3061eeab648a9b5cb78f0a4466113` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:39.075463 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2e21f-8c6f-47b6-b965-5e67606531ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=62b3061eeab648a9b5cb78f0a4466113)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:39.077423 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2e21f-8c6f-47b6-b965-5e67606531ae admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:39.123760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:39.140156 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1133/2247] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:39.149329 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fc2fb-c678-4129-887f-a1c09d9ef92f None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:39.149751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fc2fb-c678-4129-887f-a1c09d9ef92f None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:39.150043 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fc2fb-c678-4129-887f-a1c09d9ef92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:39.174009 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-f72fc2fb-c678-4129-887f-a1c09d9ef92f None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:39.175331 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-f72fc2fb-c678-4129-887f-a1c09d9ef92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:39.187401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1134/2248] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:39.191632 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fc2fb-c678-4129-887f-a1c09d9ef92f None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:39.208858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fc2fb-c678-4129-887f-a1c09d9ef92f None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:39.217776 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce8b8e-629e-49cf-be69-7d92bc648d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:39.218934 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce8b8e-629e-49cf-be69-7d92bc648d63 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:39.219352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce8b8e-629e-49cf-be69-7d92bc648d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:39.221417 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce8b8e-629e-49cf-be69-7d92bc648d63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:39.221417 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce8b8e-629e-49cf-be69-7d92bc648d63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:28:39.221417 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce8b8e-629e-49cf-be69-7d92bc648d63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:39.224253 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce8b8e-629e-49cf-be69-7d92bc648d63 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:39.240872 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1135/2249] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:28:39.245168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce8b8e-629e-49cf-be69-7d92bc648d63 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:39.259337 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce8b8e-629e-49cf-be69-7d92bc648d63 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:39.265216 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3668a8-2ff3-43fb-abd0-242906369cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:39.266100 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3668a8-2ff3-43fb-abd0-242906369cfe admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:39.266535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3668a8-2ff3-43fb-abd0-242906369cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:39.266809 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3668a8-2ff3-43fb-abd0-242906369cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:39.267797 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3668a8-2ff3-43fb-abd0-242906369cfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:39.270006 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3668a8-2ff3-43fb-abd0-242906369cfe admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:39.319860 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-34c2e21f-8c6f-47b6-b965-5e67606531ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62b3061eeab648a9b5cb78f0a4466113'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:39.356575 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1136/2250] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:28:39 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:39.362207 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3668a8-2ff3-43fb-abd0-242906369cfe admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:39.434330 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-34c2e21f-8c6f-47b6-b965-5e67606531ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62b3061eeab648a9b5cb78f0a4466113'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:39.435287 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-34c2e21f-8c6f-47b6-b965-5e67606531ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62b3061eeab648a9b5cb78f0a4466113'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:39.435837 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-34c2e21f-8c6f-47b6-b965-5e67606531ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62b3061eeab648a9b5cb78f0a4466113'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:39.446410 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-34c2e21f-8c6f-47b6-b965-5e67606531ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62b3061eeab648a9b5cb78f0a4466113'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:39.459904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3668a8-2ff3-43fb-abd0-242906369cfe admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:39.465392 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f0a4e-3c6d-4a7a-b178-447c9dda7ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:39.466107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f0a4e-3c6d-4a7a-b178-447c9dda7ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:39.466462 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f0a4e-3c6d-4a7a-b178-447c9dda7ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:39.467018 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f0a4e-3c6d-4a7a-b178-447c9dda7ad2 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:39.467757 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f0a4e-3c6d-4a7a-b178-447c9dda7ad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:39.469371 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:39.469655 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f0a4e-3c6d-4a7a-b178-447c9dda7ad2 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:39.474753 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1115/2251] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:28:38 2022] DELETE /identity/v3/users/62b3061eeab648a9b5cb78f0a4466113 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:39.541390 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1137/2252] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:28:39 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:39.542637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2e21f-8c6f-47b6-b965-5e67606531ae admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:39.544126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-34c2e21f-8c6f-47b6-b965-5e67606531ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:39.624316 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2e21f-8c6f-47b6-b965-5e67606531ae admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:39.629338 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b774aa-6d7e-4ab8-91db-7d82ac313c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:39.629967 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b774aa-6d7e-4ab8-91db-7d82ac313c95 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:39.630244 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b774aa-6d7e-4ab8-91db-7d82ac313c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:39.630534 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b774aa-6d7e-4ab8-91db-7d82ac313c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:39.631180 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b774aa-6d7e-4ab8-91db-7d82ac313c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:39.633225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b774aa-6d7e-4ab8-91db-7d82ac313c95 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:39.646615 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1116/2253] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:28:39.655482 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f0a4e-3c6d-4a7a-b178-447c9dda7ad2 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:39.674196 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f0a4e-3c6d-4a7a-b178-447c9dda7ad2 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:39.674196 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775c278-c6b3-497a-af21-9d642b1a7167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:39.674196 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775c278-c6b3-497a-af21-9d642b1a7167 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:39.674196 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775c278-c6b3-497a-af21-9d642b1a7167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:39.674529 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775c278-c6b3-497a-af21-9d642b1a7167 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:39.674602 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775c278-c6b3-497a-af21-9d642b1a7167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:39.677417 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775c278-c6b3-497a-af21-9d642b1a7167 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:39.688713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1138/2254] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:39.694007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b774aa-6d7e-4ab8-91db-7d82ac313c95 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:39.706536 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b774aa-6d7e-4ab8-91db-7d82ac313c95 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:39.714112 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f4cee-219d-4ee0-8cea-d6ca87d52af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:39.714112 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f4cee-219d-4ee0-8cea-d6ca87d52af3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:39.714112 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f4cee-219d-4ee0-8cea-d6ca87d52af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:39.714112 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f4cee-219d-4ee0-8cea-d6ca87d52af3 admin admin] PATH_INFO: `/v3/projects/9c3b26e36af24c2dbb3b4a74cd193ce1/users/1e2dc22123214bedb5f8f419b32d8eb6/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:39.732655 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f4cee-219d-4ee0-8cea-d6ca87d52af3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c3b26e36af24c2dbb3b4a74cd193ce1, user_id=1e2dc22123214bedb5f8f419b32d8eb6, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:39.736031 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f4cee-219d-4ee0-8cea-d6ca87d52af3 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:39.739199 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775c278-c6b3-497a-af21-9d642b1a7167 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:39.741799 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-0775c278-c6b3-497a-af21-9d642b1a7167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:39.762697 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775c278-c6b3-497a-af21-9d642b1a7167 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:39.769440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609a3e8-ea7e-48dc-a686-9328600e3889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:39.771196 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609a3e8-ea7e-48dc-a686-9328600e3889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:39.772670 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609a3e8-ea7e-48dc-a686-9328600e3889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:39.772670 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609a3e8-ea7e-48dc-a686-9328600e3889 admin admin] PATH_INFO: `/v3/users/ced17f9d617e4a80854fd6745ca100dd` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:39.773027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609a3e8-ea7e-48dc-a686-9328600e3889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ced17f9d617e4a80854fd6745ca100dd)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:39.775531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609a3e8-ea7e-48dc-a686-9328600e3889 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:39.803497 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:39.853233 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1117/2255] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:39 2022] PUT /identity/v3/projects/9c3b26e36af24c2dbb3b4a74cd193ce1/users/1e2dc22123214bedb5f8f419b32d8eb6/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:39.864965 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b74893-e067-42dc-90ae-8a5d71e4c924 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:39.865678 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b74893-e067-42dc-90ae-8a5d71e4c924 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:39.865678 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b74893-e067-42dc-90ae-8a5d71e4c924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:39.897310 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-87b74893-e067-42dc-90ae-8a5d71e4c924 None None] MFA Rules not processed for user `1e2dc22123214bedb5f8f419b32d8eb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:39.898771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-87b74893-e067-42dc-90ae-8a5d71e4c924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:39.984931 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1118/2256] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:28:39.996842 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b74893-e067-42dc-90ae-8a5d71e4c924 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:39.998298 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-87b74893-e067-42dc-90ae-8a5d71e4c924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:40.034212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1609a3e8-ea7e-48dc-a686-9328600e3889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ced17f9d617e4a80854fd6745ca100dd'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:40.067796 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b74893-e067-42dc-90ae-8a5d71e4c924 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:40.071728 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e2517-1452-4a38-a9e1-f83412fc9917 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:40.072660 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e2517-1452-4a38-a9e1-f83412fc9917 service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:40.072660 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e2517-1452-4a38-a9e1-f83412fc9917 service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:40.073222 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e2517-1452-4a38-a9e1-f83412fc9917 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:40.085740 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e2517-1452-4a38-a9e1-f83412fc9917 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:40.089009 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e2517-1452-4a38-a9e1-f83412fc9917 service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:40.101521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1609a3e8-ea7e-48dc-a686-9328600e3889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ced17f9d617e4a80854fd6745ca100dd'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:40.102192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1609a3e8-ea7e-48dc-a686-9328600e3889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ced17f9d617e4a80854fd6745ca100dd'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:40.102950 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1609a3e8-ea7e-48dc-a686-9328600e3889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ced17f9d617e4a80854fd6745ca100dd'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:40.110464 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1119/2257] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:28:40.117378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1609a3e8-ea7e-48dc-a686-9328600e3889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ced17f9d617e4a80854fd6745ca100dd'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:40.125429 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e2517-1452-4a38-a9e1-f83412fc9917 service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:40.128138 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-7b0e2517-1452-4a38-a9e1-f83412fc9917 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:40.167306 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1139/2258] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:28:39 2022] DELETE /identity/v3/users/ced17f9d617e4a80854fd6745ca100dd => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:28:40.173934 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea76b70-c639-43b9-9fda-66f9c26940d9 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:40.175084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea76b70-c639-43b9-9fda-66f9c26940d9 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:40.175605 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea76b70-c639-43b9-9fda-66f9c26940d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:40.199285 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-2ea76b70-c639-43b9-9fda-66f9c26940d9 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:40.200559 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-2ea76b70-c639-43b9-9fda-66f9c26940d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:40.262959 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e2517-1452-4a38-a9e1-f83412fc9917 service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:40.274195 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1140/2259] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:28:40.285012 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea76b70-c639-43b9-9fda-66f9c26940d9 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:40.290229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-2ea76b70-c639-43b9-9fda-66f9c26940d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:40.358686 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6037ac-853b-4219-9a7e-b6ff66026323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:40.359468 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6037ac-853b-4219-9a7e-b6ff66026323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:40.359852 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6037ac-853b-4219-9a7e-b6ff66026323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:40.360215 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6037ac-853b-4219-9a7e-b6ff66026323 admin admin] PATH_INFO: `/v3/projects/5d745dfbc44248cfa234ffc74ffec8e7` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:40.361574 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6037ac-853b-4219-9a7e-b6ff66026323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d745dfbc44248cfa234ffc74ffec8e7)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:40.364484 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6037ac-853b-4219-9a7e-b6ff66026323 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:40.394434 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea76b70-c639-43b9-9fda-66f9c26940d9 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:40.404822 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59223a70-f429-4e88-908f-e2c0782bfd13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:40.405692 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59223a70-f429-4e88-908f-e2c0782bfd13 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:40.405692 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59223a70-f429-4e88-908f-e2c0782bfd13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:40.405987 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59223a70-f429-4e88-908f-e2c0782bfd13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:40.433832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59223a70-f429-4e88-908f-e2c0782bfd13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:40.436005 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59223a70-f429-4e88-908f-e2c0782bfd13 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:40.454356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1141/2260] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:28:40.507966 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-cd6037ac-853b-4219-9a7e-b6ff66026323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d745dfbc44248cfa234ffc74ffec8e7', 'request_id': 'req-cd6037ac-853b-4219-9a7e-b6ff66026323'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:40.521355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-cd6037ac-853b-4219-9a7e-b6ff66026323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d745dfbc44248cfa234ffc74ffec8e7', 'request_id': 'req-cd6037ac-853b-4219-9a7e-b6ff66026323'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:40.617011 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-cd6037ac-853b-4219-9a7e-b6ff66026323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d745dfbc44248cfa234ffc74ffec8e7', 'request_id': 'req-cd6037ac-853b-4219-9a7e-b6ff66026323'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:40.629409 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-cd6037ac-853b-4219-9a7e-b6ff66026323 admin admin] The token cache is being invalidate because project 5d745dfbc44248cfa234ffc74ffec8e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:40.629698 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-cd6037ac-853b-4219-9a7e-b6ff66026323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:40.630381 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-cd6037ac-853b-4219-9a7e-b6ff66026323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:40.631936 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1120/2261] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:40 2022] DELETE /identity/v3/projects/5d745dfbc44248cfa234ffc74ffec8e7 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:40.637604 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413af8f-b8e8-4917-9e01-e349eb599dea None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:40.637888 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413af8f-b8e8-4917-9e01-e349eb599dea None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:40.638391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413af8f-b8e8-4917-9e01-e349eb599dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:40.659571 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-b413af8f-b8e8-4917-9e01-e349eb599dea None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:40.661359 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-b413af8f-b8e8-4917-9e01-e349eb599dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:40.727119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1142/2262] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:40.735223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa81d72-6069-4a83-bd4b-d1224b43b391 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:40.735578 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa81d72-6069-4a83-bd4b-d1224b43b391 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:40.735858 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa81d72-6069-4a83-bd4b-d1224b43b391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:40.758639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-7fa81d72-6069-4a83-bd4b-d1224b43b391 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:40.761529 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-7fa81d72-6069-4a83-bd4b-d1224b43b391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:40.773628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1121/2263] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:40.778241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413af8f-b8e8-4917-9e01-e349eb599dea None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:40.801331 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413af8f-b8e8-4917-9e01-e349eb599dea None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:40.807301 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fba9d-ff89-45e2-ad44-052ebc0a9799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:40.807795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fba9d-ff89-45e2-ad44-052ebc0a9799 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:40.808129 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fba9d-ff89-45e2-ad44-052ebc0a9799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:40.808494 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fba9d-ff89-45e2-ad44-052ebc0a9799 admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:40.809136 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fba9d-ff89-45e2-ad44-052ebc0a9799 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:28:40.809486 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fba9d-ff89-45e2-ad44-052ebc0a9799 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:40.811294 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fba9d-ff89-45e2-ad44-052ebc0a9799 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:40.828714 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1143/2264] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:28:40.836548 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa81d72-6069-4a83-bd4b-d1224b43b391 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:40.848675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa81d72-6069-4a83-bd4b-d1224b43b391 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:40.856665 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcccdb-c45d-456c-b91e-1e72564cb7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:40.857638 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcccdb-c45d-456c-b91e-1e72564cb7c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:40.858128 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcccdb-c45d-456c-b91e-1e72564cb7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:40.858768 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcccdb-c45d-456c-b91e-1e72564cb7c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:40.859895 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcccdb-c45d-456c-b91e-1e72564cb7c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:40.862925 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcccdb-c45d-456c-b91e-1e72564cb7c6 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:41.018913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:41.033173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fba9d-ff89-45e2-ad44-052ebc0a9799 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:41.038614 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1122/2265] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:28:40 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:41.045056 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fba9d-ff89-45e2-ad44-052ebc0a9799 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:41.153329 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe30420-a5b8-4724-a5ed-f564a2c2b950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:41.154980 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe30420-a5b8-4724-a5ed-f564a2c2b950 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:41.155708 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe30420-a5b8-4724-a5ed-f564a2c2b950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:41.156386 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe30420-a5b8-4724-a5ed-f564a2c2b950 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:41.157878 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe30420-a5b8-4724-a5ed-f564a2c2b950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:41.162024 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe30420-a5b8-4724-a5ed-f564a2c2b950 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:41.286600 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:41.297577 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1144/2266] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:28:41 2022] POST /identity/v3/users => generated 287 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:41.300299 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcccdb-c45d-456c-b91e-1e72564cb7c6 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:41.317757 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcccdb-c45d-456c-b91e-1e72564cb7c6 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:41.324501 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0557bd-8594-41cc-ab18-3fec8817364d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:41.325531 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0557bd-8594-41cc-ab18-3fec8817364d admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:41.325973 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0557bd-8594-41cc-ab18-3fec8817364d admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:41.326264 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0557bd-8594-41cc-ab18-3fec8817364d admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:41.326995 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0557bd-8594-41cc-ab18-3fec8817364d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:41.329123 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0557bd-8594-41cc-ab18-3fec8817364d admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:41.346573 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1123/2267] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:41.347543 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe30420-a5b8-4724-a5ed-f564a2c2b950 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:41.360043 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe30420-a5b8-4724-a5ed-f564a2c2b950 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:41.368821 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0b2b7-ea6b-4b53-9727-fbe69ba2c0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:41.369084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0b2b7-ea6b-4b53-9727-fbe69ba2c0be admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:41.369167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0b2b7-ea6b-4b53-9727-fbe69ba2c0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:41.370993 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0b2b7-ea6b-4b53-9727-fbe69ba2c0be admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:41.370993 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0b2b7-ea6b-4b53-9727-fbe69ba2c0be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:41.372194 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0b2b7-ea6b-4b53-9727-fbe69ba2c0be admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:41.389790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1145/2268] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:41.391922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0557bd-8594-41cc-ab18-3fec8817364d admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:41.411035 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0557bd-8594-41cc-ab18-3fec8817364d admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:41.422043 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fab4be-8a24-4a21-be74-6b8af0b37d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:41.422819 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fab4be-8a24-4a21-be74-6b8af0b37d20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:41.423104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fab4be-8a24-4a21-be74-6b8af0b37d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:41.423378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fab4be-8a24-4a21-be74-6b8af0b37d20 admin admin] PATH_INFO: `/v3/projects/6dc9e830028247ac92803be144bc9666/users/341ecd2c87f74f9fa81f2a861e560d87/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:41.451043 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fab4be-8a24-4a21-be74-6b8af0b37d20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc9e830028247ac92803be144bc9666, user_id=341ecd2c87f74f9fa81f2a861e560d87, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:41.454073 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fab4be-8a24-4a21-be74-6b8af0b37d20 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:41.560849 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1124/2269] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:41 2022] PUT /identity/v3/projects/6dc9e830028247ac92803be144bc9666/users/341ecd2c87f74f9fa81f2a861e560d87/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:41.563284 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f77a4a-26ef-46f3-bbae-75e81cef4b49 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:41.563606 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f77a4a-26ef-46f3-bbae-75e81cef4b49 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:41.563875 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f77a4a-26ef-46f3-bbae-75e81cef4b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:41.589035 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fab4be-8a24-4a21-be74-6b8af0b37d20 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:41.592662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-04fab4be-8a24-4a21-be74-6b8af0b37d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:41.593135 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-11f77a4a-26ef-46f3-bbae-75e81cef4b49 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:41.596126 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-11f77a4a-26ef-46f3-bbae-75e81cef4b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:41.698478 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fab4be-8a24-4a21-be74-6b8af0b37d20 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:41.704530 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17224393-3555-4ee7-a124-080cfcb0cd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:41.705720 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17224393-3555-4ee7-a124-080cfcb0cd08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:41.706130 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17224393-3555-4ee7-a124-080cfcb0cd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:41.706552 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17224393-3555-4ee7-a124-080cfcb0cd08 admin admin] PATH_INFO: `/v3/projects/69dd864de54b4950a63052b7a876a948` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:41.709318 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17224393-3555-4ee7-a124-080cfcb0cd08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69dd864de54b4950a63052b7a876a948)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:41.711935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17224393-3555-4ee7-a124-080cfcb0cd08 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:41.717146 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1146/2270] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:41.738815 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f77a4a-26ef-46f3-bbae-75e81cef4b49 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:41.740537 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-11f77a4a-26ef-46f3-bbae-75e81cef4b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:41.822329 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f77a4a-26ef-46f3-bbae-75e81cef4b49 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:41.827609 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0a1b3-11a6-4fd1-b76a-a79bce3f44ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:41.828583 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0a1b3-11a6-4fd1-b76a-a79bce3f44ab service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:41.828973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0a1b3-11a6-4fd1-b76a-a79bce3f44ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:41.829342 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0a1b3-11a6-4fd1-b76a-a79bce3f44ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:41.850276 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0a1b3-11a6-4fd1-b76a-a79bce3f44ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:41.851825 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0a1b3-11a6-4fd1-b76a-a79bce3f44ab service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:41.865704 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1147/2271] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:28:41.871969 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-17224393-3555-4ee7-a124-080cfcb0cd08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69dd864de54b4950a63052b7a876a948', 'request_id': 'req-17224393-3555-4ee7-a124-080cfcb0cd08'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:41.880811 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-17224393-3555-4ee7-a124-080cfcb0cd08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69dd864de54b4950a63052b7a876a948', 'request_id': 'req-17224393-3555-4ee7-a124-080cfcb0cd08'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:41.971764 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-17224393-3555-4ee7-a124-080cfcb0cd08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69dd864de54b4950a63052b7a876a948', 'request_id': 'req-17224393-3555-4ee7-a124-080cfcb0cd08'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:41.983700 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-17224393-3555-4ee7-a124-080cfcb0cd08 admin admin] The token cache is being invalidate because project 69dd864de54b4950a63052b7a876a948 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:41.984020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-17224393-3555-4ee7-a124-080cfcb0cd08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:41.984746 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-17224393-3555-4ee7-a124-080cfcb0cd08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:41.986619 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1125/2272] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:41 2022] DELETE /identity/v3/projects/69dd864de54b4950a63052b7a876a948 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:41.991007 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0a1b3-11a6-4fd1-b76a-a79bce3f44ab service neutron] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:42.001104 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0a1b3-11a6-4fd1-b76a-a79bce3f44ab service neutron] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:42.080835 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94530efd-2485-47f6-8f43-a4ffe717accb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:42.081162 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94530efd-2485-47f6-8f43-a4ffe717accb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:42.081379 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94530efd-2485-47f6-8f43-a4ffe717accb admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:42.081647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94530efd-2485-47f6-8f43-a4ffe717accb admin admin] PATH_INFO: `/v3/users/751930437595467981a5bb3494974944` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:42.083300 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94530efd-2485-47f6-8f43-a4ffe717accb admin admin] RBAC: Authorizing `identity:delete_user(user_id=751930437595467981a5bb3494974944)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:42.085714 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94530efd-2485-47f6-8f43-a4ffe717accb admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:42.345939 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:42.429120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-94530efd-2485-47f6-8f43-a4ffe717accb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '751930437595467981a5bb3494974944'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:42.566690 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-94530efd-2485-47f6-8f43-a4ffe717accb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '751930437595467981a5bb3494974944'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:42.567475 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-94530efd-2485-47f6-8f43-a4ffe717accb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '751930437595467981a5bb3494974944'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:42.573732 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-94530efd-2485-47f6-8f43-a4ffe717accb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '751930437595467981a5bb3494974944'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:42.584614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-94530efd-2485-47f6-8f43-a4ffe717accb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '751930437595467981a5bb3494974944'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:42.640349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1148/2273] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:28:41 2022] DELETE /identity/v3/users/751930437595467981a5bb3494974944 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:42.692460 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:43.533306 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17224393-3555-4ee7-a124-080cfcb0cd08 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:43.534761 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-17224393-3555-4ee7-a124-080cfcb0cd08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:43.558926 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17224393-3555-4ee7-a124-080cfcb0cd08 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:43.624949 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6656cde-be41-4f72-86ff-dc7abcb6270a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:43.625638 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6656cde-be41-4f72-86ff-dc7abcb6270a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:43.625916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6656cde-be41-4f72-86ff-dc7abcb6270a admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:43.626221 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6656cde-be41-4f72-86ff-dc7abcb6270a admin admin] PATH_INFO: `/v3/projects/57e956a54b234e44849d29a00a108091` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:43.627620 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6656cde-be41-4f72-86ff-dc7abcb6270a admin admin] RBAC: Authorizing `identity:delete_project(project_id=57e956a54b234e44849d29a00a108091)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:43.630329 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6656cde-be41-4f72-86ff-dc7abcb6270a admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:43.835097 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:43.927847 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63e1f9-52b0-46eb-957d-fe0a2fd8d35a None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:43.957468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63e1f9-52b0-46eb-957d-fe0a2fd8d35a None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:43.957468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63e1f9-52b0-46eb-957d-fe0a2fd8d35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:43.958291 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f6656cde-be41-4f72-86ff-dc7abcb6270a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57e956a54b234e44849d29a00a108091', 'request_id': 'req-f6656cde-be41-4f72-86ff-dc7abcb6270a'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:43.958291 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f6656cde-be41-4f72-86ff-dc7abcb6270a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57e956a54b234e44849d29a00a108091', 'request_id': 'req-f6656cde-be41-4f72-86ff-dc7abcb6270a'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:43.963742 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-fe63e1f9-52b0-46eb-957d-fe0a2fd8d35a None None] MFA Rules not processed for user `341ecd2c87f74f9fa81f2a861e560d87`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:43.965008 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-fe63e1f9-52b0-46eb-957d-fe0a2fd8d35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:44.041100 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1149/2274] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:44.045554 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63e1f9-52b0-46eb-957d-fe0a2fd8d35a None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:44.046923 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-fe63e1f9-52b0-46eb-957d-fe0a2fd8d35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:44.137681 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63e1f9-52b0-46eb-957d-fe0a2fd8d35a None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:44.149378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab9f01-6b17-4ce9-94e5-245d9d2443a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:44.151882 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab9f01-6b17-4ce9-94e5-245d9d2443a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:44.151882 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab9f01-6b17-4ce9-94e5-245d9d2443a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:44.151882 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab9f01-6b17-4ce9-94e5-245d9d2443a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:44.151882 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab9f01-6b17-4ce9-94e5-245d9d2443a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:44.153957 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ab9f01-6b17-4ce9-94e5-245d9d2443a3 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:44.245384 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f6656cde-be41-4f72-86ff-dc7abcb6270a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57e956a54b234e44849d29a00a108091', 'request_id': 'req-f6656cde-be41-4f72-86ff-dc7abcb6270a'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:44.256714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f6656cde-be41-4f72-86ff-dc7abcb6270a admin admin] The token cache is being invalidate because project 57e956a54b234e44849d29a00a108091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:44.258898 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f6656cde-be41-4f72-86ff-dc7abcb6270a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:44.258898 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-f6656cde-be41-4f72-86ff-dc7abcb6270a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:44.259211 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1126/2275] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:43 2022] DELETE /identity/v3/projects/57e956a54b234e44849d29a00a108091 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:44.263027 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6656cde-be41-4f72-86ff-dc7abcb6270a admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:44.264860 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f6656cde-be41-4f72-86ff-dc7abcb6270a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:44.278930 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6656cde-be41-4f72-86ff-dc7abcb6270a admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:44.285163 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2caab90-822e-4f8b-8ca2-4006c83df626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:44.289193 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2caab90-822e-4f8b-8ca2-4006c83df626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:44.289193 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2caab90-822e-4f8b-8ca2-4006c83df626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:44.289193 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2caab90-822e-4f8b-8ca2-4006c83df626 admin admin] PATH_INFO: `/v3/users/aa705c6779a34c1e94b5325492079a63` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:44.289193 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2caab90-822e-4f8b-8ca2-4006c83df626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa705c6779a34c1e94b5325492079a63)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:44.290677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2caab90-822e-4f8b-8ca2-4006c83df626 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:44.323508 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1150/2276] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:28:44 2022] POST /identity/v3/projects => generated 371 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:28:44.327714 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab9f01-6b17-4ce9-94e5-245d9d2443a3 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:44.329706 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-51ab9f01-6b17-4ce9-94e5-245d9d2443a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:44.412044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab9f01-6b17-4ce9-94e5-245d9d2443a3 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:44.418774 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dec1d9-c507-4944-b7f2-b4349a9e918c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:44.419411 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dec1d9-c507-4944-b7f2-b4349a9e918c admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:44.424696 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dec1d9-c507-4944-b7f2-b4349a9e918c admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:44.425152 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dec1d9-c507-4944-b7f2-b4349a9e918c admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:44.426254 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dec1d9-c507-4944-b7f2-b4349a9e918c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:44.428022 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dec1d9-c507-4944-b7f2-b4349a9e918c admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:44.566315 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1151/2277] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:28:44 2022] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:44.577381 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dec1d9-c507-4944-b7f2-b4349a9e918c admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:44.588564 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dec1d9-c507-4944-b7f2-b4349a9e918c admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:44.593454 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b80394-a5f5-45bd-be15-fb6f83ad1b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:44.594100 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b80394-a5f5-45bd-be15-fb6f83ad1b13 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:44.594449 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b80394-a5f5-45bd-be15-fb6f83ad1b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:44.594729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b80394-a5f5-45bd-be15-fb6f83ad1b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:44.595431 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b80394-a5f5-45bd-be15-fb6f83ad1b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:44.597085 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b80394-a5f5-45bd-be15-fb6f83ad1b13 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:44.608449 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1152/2278] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:28:44.609498 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-d2caab90-822e-4f8b-8ca2-4006c83df626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa705c6779a34c1e94b5325492079a63'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:44.612482 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b80394-a5f5-45bd-be15-fb6f83ad1b13 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:44.622739 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b80394-a5f5-45bd-be15-fb6f83ad1b13 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:44.627709 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce434b8d-faf3-4b9c-bd3c-22f864884a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:44.628386 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce434b8d-faf3-4b9c-bd3c-22f864884a6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:44.628670 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce434b8d-faf3-4b9c-bd3c-22f864884a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:44.628951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce434b8d-faf3-4b9c-bd3c-22f864884a6f admin admin] PATH_INFO: `/v3/projects/497c9229a2ac4fe79d35c941368040f2/users/6f2e383c506d41f3ba12112f363cf3a1/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:44.646122 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce434b8d-faf3-4b9c-bd3c-22f864884a6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=497c9229a2ac4fe79d35c941368040f2, user_id=6f2e383c506d41f3ba12112f363cf3a1, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:44.648899 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce434b8d-faf3-4b9c-bd3c-22f864884a6f admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:44.680019 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-d2caab90-822e-4f8b-8ca2-4006c83df626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa705c6779a34c1e94b5325492079a63'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:44.680672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-d2caab90-822e-4f8b-8ca2-4006c83df626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa705c6779a34c1e94b5325492079a63'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:44.681278 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-d2caab90-822e-4f8b-8ca2-4006c83df626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa705c6779a34c1e94b5325492079a63'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:44.689326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-d2caab90-822e-4f8b-8ca2-4006c83df626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa705c6779a34c1e94b5325492079a63'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:44.709723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1127/2279] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:28:44 2022] DELETE /identity/v3/users/aa705c6779a34c1e94b5325492079a63 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:28:44.710172 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1153/2280] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:44 2022] PUT /identity/v3/projects/497c9229a2ac4fe79d35c941368040f2/users/6f2e383c506d41f3ba12112f363cf3a1/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:44.714443 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2caab90-822e-4f8b-8ca2-4006c83df626 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:44.715996 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-d2caab90-822e-4f8b-8ca2-4006c83df626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:44.796807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2caab90-822e-4f8b-8ca2-4006c83df626 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:44.801853 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29065282-374d-4234-935d-1a7a48a6bb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:44.802524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29065282-374d-4234-935d-1a7a48a6bb2b admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:44.802897 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29065282-374d-4234-935d-1a7a48a6bb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:44.803286 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29065282-374d-4234-935d-1a7a48a6bb2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:44.803848 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29065282-374d-4234-935d-1a7a48a6bb2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:44.805581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29065282-374d-4234-935d-1a7a48a6bb2b admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:44.819921 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1128/2281] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:44.821424 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce434b8d-faf3-4b9c-bd3c-22f864884a6f admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:44.888581 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce434b8d-faf3-4b9c-bd3c-22f864884a6f admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:44.893965 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64706b72-7969-4f14-aca1-b966ac484b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:44.894725 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64706b72-7969-4f14-aca1-b966ac484b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:44.895553 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64706b72-7969-4f14-aca1-b966ac484b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:44.895826 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64706b72-7969-4f14-aca1-b966ac484b7e admin admin] PATH_INFO: `/v3/projects/497c9229a2ac4fe79d35c941368040f2/users/6f2e383c506d41f3ba12112f363cf3a1/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:44.898486 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64706b72-7969-4f14-aca1-b966ac484b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=497c9229a2ac4fe79d35c941368040f2, user_id=6f2e383c506d41f3ba12112f363cf3a1, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:44.901249 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64706b72-7969-4f14-aca1-b966ac484b7e admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:44.913812 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1154/2282] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:44 2022] PUT /identity/v3/projects/497c9229a2ac4fe79d35c941368040f2/users/6f2e383c506d41f3ba12112f363cf3a1/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:45.153885 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29065282-374d-4234-935d-1a7a48a6bb2b admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:45.154604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-29065282-374d-4234-935d-1a7a48a6bb2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:45.171581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29065282-374d-4234-935d-1a7a48a6bb2b admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:45.255572 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4545c-1fb5-4419-a453-c290013789a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:45.256505 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4545c-1fb5-4419-a453-c290013789a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:45.256947 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4545c-1fb5-4419-a453-c290013789a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:45.257234 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4545c-1fb5-4419-a453-c290013789a2 admin admin] PATH_INFO: `/v3/projects/923284f6c80545408355501bbe6b1db7` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:45.258490 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4545c-1fb5-4419-a453-c290013789a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=923284f6c80545408355501bbe6b1db7)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:45.260513 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4545c-1fb5-4419-a453-c290013789a2 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:45.377535 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-18b4545c-1fb5-4419-a453-c290013789a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '923284f6c80545408355501bbe6b1db7', 'request_id': 'req-18b4545c-1fb5-4419-a453-c290013789a2'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:45.387374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-18b4545c-1fb5-4419-a453-c290013789a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '923284f6c80545408355501bbe6b1db7', 'request_id': 'req-18b4545c-1fb5-4419-a453-c290013789a2'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:45.462696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-18b4545c-1fb5-4419-a453-c290013789a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '923284f6c80545408355501bbe6b1db7', 'request_id': 'req-18b4545c-1fb5-4419-a453-c290013789a2'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:45.482648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-18b4545c-1fb5-4419-a453-c290013789a2 admin admin] The token cache is being invalidate because project 923284f6c80545408355501bbe6b1db7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:45.483011 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-18b4545c-1fb5-4419-a453-c290013789a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:45.484038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-18b4545c-1fb5-4419-a453-c290013789a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:45.489894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1129/2283] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:45 2022] DELETE /identity/v3/projects/923284f6c80545408355501bbe6b1db7 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:45.491645 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74c33c-bbd9-409f-b8f6-beb91652c53c None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:45.492125 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74c33c-bbd9-409f-b8f6-beb91652c53c None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:45.492228 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74c33c-bbd9-409f-b8f6-beb91652c53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:45.522109 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-8c74c33c-bbd9-409f-b8f6-beb91652c53c None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:45.526352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-8c74c33c-bbd9-409f-b8f6-beb91652c53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:45.656988 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f67fb0-83c9-47d6-aa47-6aefb6eb05fa None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:45.657276 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f67fb0-83c9-47d6-aa47-6aefb6eb05fa None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:45.657557 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f67fb0-83c9-47d6-aa47-6aefb6eb05fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:45.670795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1155/2284] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:28:45.699591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-c4f67fb0-83c9-47d6-aa47-6aefb6eb05fa None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:45.704377 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c4f67fb0-83c9-47d6-aa47-6aefb6eb05fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:45.723491 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1130/2285] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:28:45.728217 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74c33c-bbd9-409f-b8f6-beb91652c53c None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:45.743469 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74c33c-bbd9-409f-b8f6-beb91652c53c None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:45.752188 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715e8e9-25ce-4b2d-b9b8-9f9c2a66f2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:45.752188 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715e8e9-25ce-4b2d-b9b8-9f9c2a66f2af admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:45.752188 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715e8e9-25ce-4b2d-b9b8-9f9c2a66f2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:45.752188 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715e8e9-25ce-4b2d-b9b8-9f9c2a66f2af admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:45.754672 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715e8e9-25ce-4b2d-b9b8-9f9c2a66f2af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:28:45.754672 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715e8e9-25ce-4b2d-b9b8-9f9c2a66f2af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:45.756380 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715e8e9-25ce-4b2d-b9b8-9f9c2a66f2af admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:45.778434 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f67fb0-83c9-47d6-aa47-6aefb6eb05fa None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:45.785400 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1156/2286] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:28:45.790620 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f67fb0-83c9-47d6-aa47-6aefb6eb05fa None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:45.801964 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae76b8-271f-4a6b-a6ec-33f4442e5768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:45.802599 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae76b8-271f-4a6b-a6ec-33f4442e5768 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:45.803191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae76b8-271f-4a6b-a6ec-33f4442e5768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:45.803502 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae76b8-271f-4a6b-a6ec-33f4442e5768 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:45.804321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae76b8-271f-4a6b-a6ec-33f4442e5768 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:45.807834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae76b8-271f-4a6b-a6ec-33f4442e5768 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:45.908579 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:45.939846 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715e8e9-25ce-4b2d-b9b8-9f9c2a66f2af admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:45.940390 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1131/2287] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:28:45 2022] POST /identity/v3/projects => generated 371 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:45.953895 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715e8e9-25ce-4b2d-b9b8-9f9c2a66f2af admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:46.047789 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da8278-1448-4ecc-b42b-18180cae77b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:46.051533 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da8278-1448-4ecc-b42b-18180cae77b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:46.051533 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da8278-1448-4ecc-b42b-18180cae77b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:46.051533 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da8278-1448-4ecc-b42b-18180cae77b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:46.051533 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da8278-1448-4ecc-b42b-18180cae77b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:46.052063 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da8278-1448-4ecc-b42b-18180cae77b2 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:46.170098 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1157/2288] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:28:45 2022] POST /identity/v3/users => generated 286 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:46.171601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae76b8-271f-4a6b-a6ec-33f4442e5768 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:46.186299 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:46.198018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae76b8-271f-4a6b-a6ec-33f4442e5768 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:46.205716 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e8470-247c-4dd6-b0d5-0f013db27938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:46.206148 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e8470-247c-4dd6-b0d5-0f013db27938 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:46.208230 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e8470-247c-4dd6-b0d5-0f013db27938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:46.208512 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e8470-247c-4dd6-b0d5-0f013db27938 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:46.209219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e8470-247c-4dd6-b0d5-0f013db27938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:46.210904 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e8470-247c-4dd6-b0d5-0f013db27938 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:46.223430 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1132/2289] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:28:46.228777 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da8278-1448-4ecc-b42b-18180cae77b2 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:46.241961 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da8278-1448-4ecc-b42b-18180cae77b2 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:46.249991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b843d-6dbe-43c8-a574-e7972d3decbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:46.250969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b843d-6dbe-43c8-a574-e7972d3decbc admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:46.251207 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b843d-6dbe-43c8-a574-e7972d3decbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:46.251604 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b843d-6dbe-43c8-a574-e7972d3decbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:46.252840 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b843d-6dbe-43c8-a574-e7972d3decbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:46.255421 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b843d-6dbe-43c8-a574-e7972d3decbc admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:46.268565 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1158/2290] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:28:46.273024 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e8470-247c-4dd6-b0d5-0f013db27938 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:46.284967 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e8470-247c-4dd6-b0d5-0f013db27938 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:46.290285 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9879ef-ad51-4eeb-88e1-95ae525a8289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:46.290994 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9879ef-ad51-4eeb-88e1-95ae525a8289 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:46.291354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9879ef-ad51-4eeb-88e1-95ae525a8289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:46.292069 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9879ef-ad51-4eeb-88e1-95ae525a8289 admin admin] PATH_INFO: `/v3/projects/517e391202b7495fac647096f40a0b7a/users/3122c42abffe4cfb981f2cb1c450e7c9/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:46.311102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9879ef-ad51-4eeb-88e1-95ae525a8289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=517e391202b7495fac647096f40a0b7a, user_id=3122c42abffe4cfb981f2cb1c450e7c9, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:46.313884 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9879ef-ad51-4eeb-88e1-95ae525a8289 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:46.435371 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1133/2291] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:46 2022] PUT /identity/v3/projects/517e391202b7495fac647096f40a0b7a/users/3122c42abffe4cfb981f2cb1c450e7c9/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:46.446712 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9a5fe-0264-4987-8eb6-fa3568de9580 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:46.446997 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9a5fe-0264-4987-8eb6-fa3568de9580 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:46.447298 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9a5fe-0264-4987-8eb6-fa3568de9580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:46.479242 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-bfd9a5fe-0264-4987-8eb6-fa3568de9580 None None] MFA Rules not processed for user `3122c42abffe4cfb981f2cb1c450e7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:46.480524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-bfd9a5fe-0264-4987-8eb6-fa3568de9580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:46.562629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1159/2292] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:46.564310 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c605653-8ecd-4686-9402-4f4e1a6d1cae None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:46.564759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c605653-8ecd-4686-9402-4f4e1a6d1cae None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:46.565106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c605653-8ecd-4686-9402-4f4e1a6d1cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:46.587057 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9a5fe-0264-4987-8eb6-fa3568de9580 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:46.588535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-bfd9a5fe-0264-4987-8eb6-fa3568de9580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:46.615034 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-0c605653-8ecd-4686-9402-4f4e1a6d1cae None None] MFA Rules not processed for user `6f2e383c506d41f3ba12112f363cf3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:46.616314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-0c605653-8ecd-4686-9402-4f4e1a6d1cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:46.775376 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1134/2293] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:28:46.787700 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d257445-166f-48c6-a112-293d4f1ce653 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:46.787990 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d257445-166f-48c6-a112-293d4f1ce653 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:46.788267 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d257445-166f-48c6-a112-293d4f1ce653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:46.799788 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9a5fe-0264-4987-8eb6-fa3568de9580 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:46.807706 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb1a43-d793-429d-8c0b-01a765e982fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '871f208a13ba435491022b9ea9b735e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:46.808847 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb1a43-d793-429d-8c0b-01a765e982fe service glance] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:46.809739 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb1a43-d793-429d-8c0b-01a765e982fe service glance] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:46.810375 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb1a43-d793-429d-8c0b-01a765e982fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:46.844215 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-6d257445-166f-48c6-a112-293d4f1ce653 None None] MFA Rules not processed for user `341ecd2c87f74f9fa81f2a861e560d87`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:46.844215 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6d257445-166f-48c6-a112-293d4f1ce653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:46.844376 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb1a43-d793-429d-8c0b-01a765e982fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:46.850595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb1a43-d793-429d-8c0b-01a765e982fe service glance] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:46.871154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1160/2294] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:28:46.945384 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1135/2295] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:47.153745 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb1a43-d793-429d-8c0b-01a765e982fe service glance] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:47.156278 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-4efb1a43-d793-429d-8c0b-01a765e982fe service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:47.281235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb1a43-d793-429d-8c0b-01a765e982fe service glance] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:47.292042 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce07d7e-5c5b-4df4-8204-09920775e179 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:47.292677 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce07d7e-5c5b-4df4-8204-09920775e179 service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:47.292959 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce07d7e-5c5b-4df4-8204-09920775e179 service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:47.293229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce07d7e-5c5b-4df4-8204-09920775e179 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:47.299769 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-4ce07d7e-5c5b-4df4-8204-09920775e179 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:47.325292 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce07d7e-5c5b-4df4-8204-09920775e179 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:47.327744 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce07d7e-5c5b-4df4-8204-09920775e179 service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:47.339322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1161/2296] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:28:49.389616 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:49.956204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:51.337362 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:51.542616 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:51.988539 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:52.781422 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:53.628265 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:53.988759 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:54.324851 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d257445-166f-48c6-a112-293d4f1ce653 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:54.326187 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6d257445-166f-48c6-a112-293d4f1ce653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:54.462436 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d257445-166f-48c6-a112-293d4f1ce653 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:54.467858 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16640058-aa99-4234-9580-b76d168ba5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:54.468522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16640058-aa99-4234-9580-b76d168ba5b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:54.468793 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16640058-aa99-4234-9580-b76d168ba5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:54.469078 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16640058-aa99-4234-9580-b76d168ba5b6 admin admin] PATH_INFO: `/v3/users/1e2dc22123214bedb5f8f419b32d8eb6` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:54.470229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16640058-aa99-4234-9580-b76d168ba5b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e2dc22123214bedb5f8f419b32d8eb6)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:54.472231 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16640058-aa99-4234-9580-b76d168ba5b6 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:54.617678 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-16640058-aa99-4234-9580-b76d168ba5b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e2dc22123214bedb5f8f419b32d8eb6'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:54.674125 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:54.710525 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-16640058-aa99-4234-9580-b76d168ba5b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e2dc22123214bedb5f8f419b32d8eb6'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:54.711600 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-16640058-aa99-4234-9580-b76d168ba5b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e2dc22123214bedb5f8f419b32d8eb6'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:54.712352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-16640058-aa99-4234-9580-b76d168ba5b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e2dc22123214bedb5f8f419b32d8eb6'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:54.720924 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-16640058-aa99-4234-9580-b76d168ba5b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e2dc22123214bedb5f8f419b32d8eb6'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:54.744603 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1136/2297] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:28:54 2022] DELETE /identity/v3/users/1e2dc22123214bedb5f8f419b32d8eb6 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:54.758093 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcae0d-c9a1-4b3d-aba2-b35af264f708 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:54.758384 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcae0d-c9a1-4b3d-aba2-b35af264f708 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:54.758644 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcae0d-c9a1-4b3d-aba2-b35af264f708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:54.777977 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-35bcae0d-c9a1-4b3d-aba2-b35af264f708 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:54.779219 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-35bcae0d-c9a1-4b3d-aba2-b35af264f708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:54.845084 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1162/2298] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:54.855204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16640058-aa99-4234-9580-b76d168ba5b6 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:54.857036 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-16640058-aa99-4234-9580-b76d168ba5b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:54.903151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:54.923770 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16640058-aa99-4234-9580-b76d168ba5b6 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:54.928544 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b211e6-2e10-4157-aaf0-ddf74ff760a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:54.929230 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b211e6-2e10-4157-aaf0-ddf74ff760a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:54.929507 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b211e6-2e10-4157-aaf0-ddf74ff760a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:54.929779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b211e6-2e10-4157-aaf0-ddf74ff760a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:54.939825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b211e6-2e10-4157-aaf0-ddf74ff760a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:54.941858 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b211e6-2e10-4157-aaf0-ddf74ff760a7 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:54.952525 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1137/2299] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:28:55.457582 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=81,keystone:INSERT=5,keystone:DELETE=14 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:55.508361 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:55.612023 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcae0d-c9a1-4b3d-aba2-b35af264f708 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:55.612023 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-35bcae0d-c9a1-4b3d-aba2-b35af264f708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:55.626784 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcae0d-c9a1-4b3d-aba2-b35af264f708 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:55.637961 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f6f1f-0eb8-45c4-98ee-7f22262bb5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:55.638889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f6f1f-0eb8-45c4-98ee-7f22262bb5bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:55.640096 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f6f1f-0eb8-45c4-98ee-7f22262bb5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:55.640581 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f6f1f-0eb8-45c4-98ee-7f22262bb5bd admin admin] PATH_INFO: `/v3/projects/9c3b26e36af24c2dbb3b4a74cd193ce1` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:55.644005 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f6f1f-0eb8-45c4-98ee-7f22262bb5bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c3b26e36af24c2dbb3b4a74cd193ce1)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:55.647061 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f6f1f-0eb8-45c4-98ee-7f22262bb5bd admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:55.792283 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-be7f6f1f-0eb8-45c4-98ee-7f22262bb5bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c3b26e36af24c2dbb3b4a74cd193ce1', 'request_id': 'req-be7f6f1f-0eb8-45c4-98ee-7f22262bb5bd'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:55.800020 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-be7f6f1f-0eb8-45c4-98ee-7f22262bb5bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c3b26e36af24c2dbb3b4a74cd193ce1', 'request_id': 'req-be7f6f1f-0eb8-45c4-98ee-7f22262bb5bd'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:55.914194 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-be7f6f1f-0eb8-45c4-98ee-7f22262bb5bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c3b26e36af24c2dbb3b4a74cd193ce1', 'request_id': 'req-be7f6f1f-0eb8-45c4-98ee-7f22262bb5bd'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:55.927832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-be7f6f1f-0eb8-45c4-98ee-7f22262bb5bd admin admin] The token cache is being invalidate because project 9c3b26e36af24c2dbb3b4a74cd193ce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:28:55.928140 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-be7f6f1f-0eb8-45c4-98ee-7f22262bb5bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:55.928784 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-be7f6f1f-0eb8-45c4-98ee-7f22262bb5bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:28:55.930558 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1163/2300] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:28:55 2022] DELETE /identity/v3/projects/9c3b26e36af24c2dbb3b4a74cd193ce1 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:55.935432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28194f4-0ef3-45d2-a28d-9793b97d36d3 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:55.935940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28194f4-0ef3-45d2-a28d-9793b97d36d3 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:55.936042 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28194f4-0ef3-45d2-a28d-9793b97d36d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:55.960024 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-e28194f4-0ef3-45d2-a28d-9793b97d36d3 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:55.961180 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-e28194f4-0ef3-45d2-a28d-9793b97d36d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:55.971054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:55.994197 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:56.034085 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1138/2301] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:56.043073 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a17a5-94a8-423b-970c-22228f6f8704 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:56.043362 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a17a5-94a8-423b-970c-22228f6f8704 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:56.043667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a17a5-94a8-423b-970c-22228f6f8704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:56.068259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-a84a17a5-94a8-423b-970c-22228f6f8704 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:56.070333 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-a84a17a5-94a8-423b-970c-22228f6f8704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:56.085098 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1164/2302] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:56.089644 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28194f4-0ef3-45d2-a28d-9793b97d36d3 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:56.101538 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28194f4-0ef3-45d2-a28d-9793b97d36d3 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:56.106677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304df5b-6354-4741-a28d-947d81a9b4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:56.107529 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304df5b-6354-4741-a28d-947d81a9b4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:56.107812 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304df5b-6354-4741-a28d-947d81a9b4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:56.108238 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304df5b-6354-4741-a28d-947d81a9b4d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:56.108913 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304df5b-6354-4741-a28d-947d81a9b4d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:28:56.109198 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304df5b-6354-4741-a28d-947d81a9b4d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:56.110853 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304df5b-6354-4741-a28d-947d81a9b4d7 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:56.126467 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1139/2303] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:28:56.129552 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a17a5-94a8-423b-970c-22228f6f8704 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:56.140449 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a17a5-94a8-423b-970c-22228f6f8704 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:56.146609 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efedc45c-008d-497f-8171-518fd2b7fa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:56.147720 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedc45c-008d-497f-8171-518fd2b7fa4a admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:56.147720 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedc45c-008d-497f-8171-518fd2b7fa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:56.148068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedc45c-008d-497f-8171-518fd2b7fa4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:56.148819 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efedc45c-008d-497f-8171-518fd2b7fa4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:56.150771 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efedc45c-008d-497f-8171-518fd2b7fa4a admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:56.300116 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1165/2304] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:28:56 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:56.305084 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304df5b-6354-4741-a28d-947d81a9b4d7 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:56.321936 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304df5b-6354-4741-a28d-947d81a9b4d7 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:56.325547 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=76,keystone:INSERT=8,keystone:DELETE=16 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:56.392251 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d313ca-f6d5-4e29-9d88-ee2121152dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:56.392897 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d313ca-f6d5-4e29-9d88-ee2121152dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:56.393181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d313ca-f6d5-4e29-9d88-ee2121152dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:56.393453 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d313ca-f6d5-4e29-9d88-ee2121152dd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:56.394644 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d313ca-f6d5-4e29-9d88-ee2121152dd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:56.396696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d313ca-f6d5-4e29-9d88-ee2121152dd8 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:56.426560 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:56.509312 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1140/2305] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:28:56 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:28:56.509701 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efedc45c-008d-497f-8171-518fd2b7fa4a admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:56.530035 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efedc45c-008d-497f-8171-518fd2b7fa4a admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:56.537594 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc5d52-9529-4937-a975-99c4904710f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:56.539137 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc5d52-9529-4937-a975-99c4904710f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:56.539558 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc5d52-9529-4937-a975-99c4904710f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:56.539834 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc5d52-9529-4937-a975-99c4904710f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:56.540562 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc5d52-9529-4937-a975-99c4904710f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:56.542202 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc5d52-9529-4937-a975-99c4904710f2 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:56.561644 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d313ca-f6d5-4e29-9d88-ee2121152dd8 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:56.563574 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1166/2306] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:28:56.573686 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d313ca-f6d5-4e29-9d88-ee2121152dd8 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:56.579254 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6384b12-5ee2-4133-af40-861f818e2109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:56.580034 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6384b12-5ee2-4133-af40-861f818e2109 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:56.580312 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6384b12-5ee2-4133-af40-861f818e2109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:56.581372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6384b12-5ee2-4133-af40-861f818e2109 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:56.581372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6384b12-5ee2-4133-af40-861f818e2109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:56.583384 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6384b12-5ee2-4133-af40-861f818e2109 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:56.601664 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1141/2307] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:28:56.602841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc5d52-9529-4937-a975-99c4904710f2 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:56.624835 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc5d52-9529-4937-a975-99c4904710f2 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:56.630436 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb8a94-da99-4d03-a064-f0733ad224a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:56.631109 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb8a94-da99-4d03-a064-f0733ad224a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:56.631391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb8a94-da99-4d03-a064-f0733ad224a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:56.631710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb8a94-da99-4d03-a064-f0733ad224a6 admin admin] PATH_INFO: `/v3/projects/dfa84326e40c460d8f57f8b4bc83c050/users/eee15bfd12f84c6db46ce2616d010e36/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:56.651007 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb8a94-da99-4d03-a064-f0733ad224a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfa84326e40c460d8f57f8b4bc83c050, user_id=eee15bfd12f84c6db46ce2616d010e36, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:56.653779 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb8a94-da99-4d03-a064-f0733ad224a6 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:56.783131 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1167/2308] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:28:56 2022] PUT /identity/v3/projects/dfa84326e40c460d8f57f8b4bc83c050/users/eee15bfd12f84c6db46ce2616d010e36/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:28:56.799335 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbdd6f-7a28-4cb3-b002-739bf67489e7 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:56.799695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbdd6f-7a28-4cb3-b002-739bf67489e7 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:56.799978 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbdd6f-7a28-4cb3-b002-739bf67489e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:56.857511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-cddbdd6f-7a28-4cb3-b002-739bf67489e7 None None] MFA Rules not processed for user `eee15bfd12f84c6db46ce2616d010e36`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:28:56.858984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-cddbdd6f-7a28-4cb3-b002-739bf67489e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:56.954636 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:56.972903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1142/2309] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:28:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:28:56.985870 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb8a94-da99-4d03-a064-f0733ad224a6 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:28:56.988037 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-d2eb8a94-da99-4d03-a064-f0733ad224a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:28:57.029419 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:57.069708 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb8a94-da99-4d03-a064-f0733ad224a6 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:28:57.074258 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f135d-e7ac-4079-bfc3-d2ccd6a34c19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:28:57.074877 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f135d-e7ac-4079-bfc3-d2ccd6a34c19 service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:28:57.075484 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f135d-e7ac-4079-bfc3-d2ccd6a34c19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:28:57.076108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f135d-e7ac-4079-bfc3-d2ccd6a34c19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:28:57.093552 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f135d-e7ac-4079-bfc3-d2ccd6a34c19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:28:57.096320 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f135d-e7ac-4079-bfc3-d2ccd6a34c19 service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:28:57.117137 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1168/2310] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:28:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:28:58.177531 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:58.428796 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:59.416983 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:28:59.530183 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:00.052159 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e669a3-8686-40cd-aef1-7b5824a08368 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:00.052479 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e669a3-8686-40cd-aef1-7b5824a08368 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:00.052807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e669a3-8686-40cd-aef1-7b5824a08368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:00.075374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-60e669a3-8686-40cd-aef1-7b5824a08368 None None] MFA Rules not processed for user `c1d558f1f2f443e18d95a7cff604c691`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:29:00.076699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-60e669a3-8686-40cd-aef1-7b5824a08368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:00.157759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1143/2311] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:29:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:29:00.310678 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17eb7f-8677-40fd-a20b-e62353739918 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:00.310940 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17eb7f-8677-40fd-a20b-e62353739918 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:00.311221 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17eb7f-8677-40fd-a20b-e62353739918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:00.337083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-7e17eb7f-8677-40fd-a20b-e62353739918 None None] MFA Rules not processed for user `eee15bfd12f84c6db46ce2616d010e36`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:29:00.339332 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-7e17eb7f-8677-40fd-a20b-e62353739918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:00.348391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1169/2312] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:29:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:29:00.634741 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:00.715346 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:01.458567 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:02.268777 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:02.617628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:02.847072 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:03.090469 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:03.136429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:03.319582 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:03.360690 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:03.634261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:03.857000 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:03.901454 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:04.206000 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:04.313690 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:04.530823 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:04.684952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:05.067707 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:05.685517 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:05.765443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:06.010520 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:06.084904 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:06.450401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:06.479665 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:07.319357 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:07.338267 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:07.725314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:07.776177 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:08.330327 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:08.564693 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:08.670542 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:09.283836 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db376df-64ad-4845-a1ef-c800423ae889 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:09.284133 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db376df-64ad-4845-a1ef-c800423ae889 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:09.284413 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db376df-64ad-4845-a1ef-c800423ae889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:09.313432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-8db376df-64ad-4845-a1ef-c800423ae889 None None] MFA Rules not processed for user `2e7cc9c938214193b922ab1bc8288a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:29:09.314931 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-8db376df-64ad-4845-a1ef-c800423ae889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:09.410743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1144/2313] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:29:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:29:09.736660 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:09.771461 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:10.153190 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:10.496502 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:11.051667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:11.209888 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2a6fc-e779-4665-88b5-755b626b97f0 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:11.210803 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2a6fc-e779-4665-88b5-755b626b97f0 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:11.211228 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2a6fc-e779-4665-88b5-755b626b97f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:11.235900 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-60e2a6fc-e779-4665-88b5-755b626b97f0 None None] MFA Rules not processed for user `c314372147b2491cb4481d538056472c`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:29:11.238378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-60e2a6fc-e779-4665-88b5-755b626b97f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:11.370789 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1170/2314] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Sep 6 20:29:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:29:11.430359 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db376df-64ad-4845-a1ef-c800423ae889 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:11.431884 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-8db376df-64ad-4845-a1ef-c800423ae889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:11.511297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db376df-64ad-4845-a1ef-c800423ae889 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:11.516668 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be25e1c-9714-4aed-9c9c-6a78eaedbc3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6c4f91a59548fd979e7232a2afd6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:11.517400 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be25e1c-9714-4aed-9c9c-6a78eaedbc3f service swift] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:11.517682 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be25e1c-9714-4aed-9c9c-6a78eaedbc3f service swift] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:11.517958 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be25e1c-9714-4aed-9c9c-6a78eaedbc3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:11.526989 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be25e1c-9714-4aed-9c9c-6a78eaedbc3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:11.528624 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be25e1c-9714-4aed-9c9c-6a78eaedbc3f service swift] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:11.537543 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1145/2315] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Sep 6 20:29:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 20:29:11.953832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:13.313309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:14.039205 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:14.866143 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:14.892072 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:15.793457 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:15.901907 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:16.027969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:16.062922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:16.170488 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:16.245448 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:16.313205 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:16.428540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:16.938077 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:17.304973 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:17.490790 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:17.747506 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:20.295107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2a6fc-e779-4665-88b5-755b626b97f0 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:20.297595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-60e2a6fc-e779-4665-88b5-755b626b97f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:20.537078 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be25e1c-9714-4aed-9c9c-6a78eaedbc3f service swift] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:20.537078 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-7be25e1c-9714-4aed-9c9c-6a78eaedbc3f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:20.539487 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be25e1c-9714-4aed-9c9c-6a78eaedbc3f service swift] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:20.553006 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c916370-2815-4f4d-8c2a-6856c19b1331 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:20.553641 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c916370-2815-4f4d-8c2a-6856c19b1331 service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:20.553921 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c916370-2815-4f4d-8c2a-6856c19b1331 service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:20.554193 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c916370-2815-4f4d-8c2a-6856c19b1331 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:20.556179 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2a6fc-e779-4665-88b5-755b626b97f0 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:20.562569 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-5c916370-2815-4f4d-8c2a-6856c19b1331 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:20.565102 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15285c64-00c6-4a96-92b1-6fe355225032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:20.567060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15285c64-00c6-4a96-92b1-6fe355225032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:20.567359 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15285c64-00c6-4a96-92b1-6fe355225032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:20.567712 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15285c64-00c6-4a96-92b1-6fe355225032 admin admin] PATH_INFO: `/v3/users/3122c42abffe4cfb981f2cb1c450e7c9` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:20.569290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15285c64-00c6-4a96-92b1-6fe355225032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3122c42abffe4cfb981f2cb1c450e7c9)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:20.571741 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15285c64-00c6-4a96-92b1-6fe355225032 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:20.695550 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c916370-2815-4f4d-8c2a-6856c19b1331 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:20.697655 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c916370-2815-4f4d-8c2a-6856c19b1331 service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:20.702971 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:20.712472 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1146/2316] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:29:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:29:20.770519 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-15285c64-00c6-4a96-92b1-6fe355225032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3122c42abffe4cfb981f2cb1c450e7c9'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:29:20.868293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-15285c64-00c6-4a96-92b1-6fe355225032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3122c42abffe4cfb981f2cb1c450e7c9'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:29:20.869115 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-15285c64-00c6-4a96-92b1-6fe355225032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3122c42abffe4cfb981f2cb1c450e7c9'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:29:20.873644 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-15285c64-00c6-4a96-92b1-6fe355225032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3122c42abffe4cfb981f2cb1c450e7c9'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:29:20.885771 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-15285c64-00c6-4a96-92b1-6fe355225032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3122c42abffe4cfb981f2cb1c450e7c9'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:29:20.938935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585f911-d426-4864-86c5-e615c7ffb4aa None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:20.939697 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585f911-d426-4864-86c5-e615c7ffb4aa None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:20.940232 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585f911-d426-4864-86c5-e615c7ffb4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:20.943241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1171/2317] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:29:20 2022] DELETE /identity/v3/users/3122c42abffe4cfb981f2cb1c450e7c9 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:29:20.991186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-f585f911-d426-4864-86c5-e615c7ffb4aa None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:29:20.993260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f585f911-d426-4864-86c5-e615c7ffb4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:21.203172 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1147/2318] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:29:21.216436 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15285c64-00c6-4a96-92b1-6fe355225032 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:21.219017 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-15285c64-00c6-4a96-92b1-6fe355225032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:21.347589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:21.361836 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15285c64-00c6-4a96-92b1-6fe355225032 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:21.367794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a3f56-9c56-4e9d-b236-afbaba92d45b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:21.368487 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a3f56-9c56-4e9d-b236-afbaba92d45b service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:21.368861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a3f56-9c56-4e9d-b236-afbaba92d45b service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:21.369180 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a3f56-9c56-4e9d-b236-afbaba92d45b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:21.386180 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a3f56-9c56-4e9d-b236-afbaba92d45b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:21.387719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a3f56-9c56-4e9d-b236-afbaba92d45b service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:21.414063 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1172/2319] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:29:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:29:22.033120 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585f911-d426-4864-86c5-e615c7ffb4aa None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:22.034626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f585f911-d426-4864-86c5-e615c7ffb4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:22.054773 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585f911-d426-4864-86c5-e615c7ffb4aa None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:22.066913 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb31db-3caa-47d9-8329-c33717b53ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:22.067605 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb31db-3caa-47d9-8329-c33717b53ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:22.067887 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb31db-3caa-47d9-8329-c33717b53ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:22.068161 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb31db-3caa-47d9-8329-c33717b53ca0 admin admin] PATH_INFO: `/v3/projects/517e391202b7495fac647096f40a0b7a` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:22.076761 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb31db-3caa-47d9-8329-c33717b53ca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=517e391202b7495fac647096f40a0b7a)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:22.078712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb31db-3caa-47d9-8329-c33717b53ca0 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:22.340248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-cebb31db-3caa-47d9-8329-c33717b53ca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '517e391202b7495fac647096f40a0b7a', 'request_id': 'req-cebb31db-3caa-47d9-8329-c33717b53ca0'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:29:22.353528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-cebb31db-3caa-47d9-8329-c33717b53ca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '517e391202b7495fac647096f40a0b7a', 'request_id': 'req-cebb31db-3caa-47d9-8329-c33717b53ca0'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:29:22.444149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-cebb31db-3caa-47d9-8329-c33717b53ca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '517e391202b7495fac647096f40a0b7a', 'request_id': 'req-cebb31db-3caa-47d9-8329-c33717b53ca0'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:29:22.462292 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-cebb31db-3caa-47d9-8329-c33717b53ca0 admin admin] The token cache is being invalidate because project 517e391202b7495fac647096f40a0b7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:29:22.463018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-cebb31db-3caa-47d9-8329-c33717b53ca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:29:22.467155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-cebb31db-3caa-47d9-8329-c33717b53ca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:29:22.469082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1148/2320] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:29:22 2022] DELETE /identity/v3/projects/517e391202b7495fac647096f40a0b7a => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:29:22.480417 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb06d44-91f4-4aa8-a4a7-a589afaad7b7 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:22.480417 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb06d44-91f4-4aa8-a4a7-a589afaad7b7 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:22.480417 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb06d44-91f4-4aa8-a4a7-a589afaad7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:22.522657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-1cb06d44-91f4-4aa8-a4a7-a589afaad7b7 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:29:22.524237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-1cb06d44-91f4-4aa8-a4a7-a589afaad7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:22.654727 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1d513-d279-4d51-b761-e670709c9c3f None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:22.655011 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1d513-d279-4d51-b761-e670709c9c3f None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:22.655290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1d513-d279-4d51-b761-e670709c9c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:22.671208 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1173/2321] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:29:22.738041 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-c4b1d513-d279-4d51-b761-e670709c9c3f None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:29:22.739840 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c4b1d513-d279-4d51-b761-e670709c9c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:22.772953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb06d44-91f4-4aa8-a4a7-a589afaad7b7 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:22.773479 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1149/2322] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:29:22.783629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb06d44-91f4-4aa8-a4a7-a589afaad7b7 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:22.811874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725883e-daf2-4715-b0d1-bce69e1640dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:22.812509 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725883e-daf2-4715-b0d1-bce69e1640dd admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:22.812789 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725883e-daf2-4715-b0d1-bce69e1640dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:22.813059 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725883e-daf2-4715-b0d1-bce69e1640dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:22.825280 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725883e-daf2-4715-b0d1-bce69e1640dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:29:22.825280 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725883e-daf2-4715-b0d1-bce69e1640dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:22.836656 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725883e-daf2-4715-b0d1-bce69e1640dd admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:22.869959 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1d513-d279-4d51-b761-e670709c9c3f None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:22.888047 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1174/2323] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:29:22.888278 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1d513-d279-4d51-b761-e670709c9c3f None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:22.911974 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12061ab5-5105-4c69-b5a7-166f01e4d3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:22.912659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12061ab5-5105-4c69-b5a7-166f01e4d3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:22.912869 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12061ab5-5105-4c69-b5a7-166f01e4d3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:22.913678 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12061ab5-5105-4c69-b5a7-166f01e4d3b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:22.914295 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12061ab5-5105-4c69-b5a7-166f01e4d3b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:22.916849 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12061ab5-5105-4c69-b5a7-166f01e4d3b6 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:23.026588 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1150/2324] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:29:22 2022] POST /identity/v3/projects => generated 391 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:29:23.031842 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725883e-daf2-4715-b0d1-bce69e1640dd admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:23.058788 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725883e-daf2-4715-b0d1-bce69e1640dd admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:23.171023 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c60a3-c2c3-4a69-9d42-b1ac859749d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:23.172159 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c60a3-c2c3-4a69-9d42-b1ac859749d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:23.172652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c60a3-c2c3-4a69-9d42-b1ac859749d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:23.173222 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c60a3-c2c3-4a69-9d42-b1ac859749d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:23.174396 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c60a3-c2c3-4a69-9d42-b1ac859749d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:23.178400 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3c60a3-c2c3-4a69-9d42-b1ac859749d8 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:23.311688 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1175/2325] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:29:23 2022] POST /identity/v3/users => generated 296 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:29:23.312975 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12061ab5-5105-4c69-b5a7-166f01e4d3b6 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:23.333221 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12061ab5-5105-4c69-b5a7-166f01e4d3b6 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:23.350745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92914630-4281-4a54-97d5-5f4566549f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:23.351299 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92914630-4281-4a54-97d5-5f4566549f82 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:23.351780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92914630-4281-4a54-97d5-5f4566549f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:23.352118 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92914630-4281-4a54-97d5-5f4566549f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:23.352781 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92914630-4281-4a54-97d5-5f4566549f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:23.354904 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92914630-4281-4a54-97d5-5f4566549f82 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:23.375603 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1151/2326] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:29:23.388731 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c60a3-c2c3-4a69-9d42-b1ac859749d8 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:23.394784 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c60a3-c2c3-4a69-9d42-b1ac859749d8 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:23.400078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48c7b1-e72b-46a8-98ba-965469ed290b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:23.400488 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48c7b1-e72b-46a8-98ba-965469ed290b admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:23.400769 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48c7b1-e72b-46a8-98ba-965469ed290b admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:23.401044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48c7b1-e72b-46a8-98ba-965469ed290b admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:23.401692 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48c7b1-e72b-46a8-98ba-965469ed290b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:23.403823 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48c7b1-e72b-46a8-98ba-965469ed290b admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:23.420430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1176/2327] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:29:23.421667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92914630-4281-4a54-97d5-5f4566549f82 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:23.439315 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92914630-4281-4a54-97d5-5f4566549f82 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:23.448615 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1169380-10e9-485e-bcb3-ab46176dca9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:23.451905 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1169380-10e9-485e-bcb3-ab46176dca9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:23.451905 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1169380-10e9-485e-bcb3-ab46176dca9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:23.451905 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1169380-10e9-485e-bcb3-ab46176dca9a admin admin] PATH_INFO: `/v3/projects/bc554e3d37824bdd958766935d2a715c/users/277145ddb0df4c87a0d0c4af11c3805b/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:23.490637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1169380-10e9-485e-bcb3-ab46176dca9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc554e3d37824bdd958766935d2a715c, user_id=277145ddb0df4c87a0d0c4af11c3805b, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:23.493794 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1169380-10e9-485e-bcb3-ab46176dca9a admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:23.590022 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1152/2328] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:29:23 2022] PUT /identity/v3/projects/bc554e3d37824bdd958766935d2a715c/users/277145ddb0df4c87a0d0c4af11c3805b/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:29:23.602608 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c529ce-8754-4b6b-b1e1-34e989655f90 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:23.604577 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c529ce-8754-4b6b-b1e1-34e989655f90 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:23.604857 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c529ce-8754-4b6b-b1e1-34e989655f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:23.851513 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-d4c529ce-8754-4b6b-b1e1-34e989655f90 None None] MFA Rules not processed for user `277145ddb0df4c87a0d0c4af11c3805b`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:29:23.852938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-d4c529ce-8754-4b6b-b1e1-34e989655f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:23.911811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:23.937324 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1177/2329] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:29:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:29:23.950578 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1169380-10e9-485e-bcb3-ab46176dca9a admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:23.952292 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c1169380-10e9-485e-bcb3-ab46176dca9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:23.975057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:24.026988 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1169380-10e9-485e-bcb3-ab46176dca9a admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:24.033197 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ca2c5-2b6b-4125-a160-7f2508d0495b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:24.034113 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ca2c5-2b6b-4125-a160-7f2508d0495b service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:24.034477 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ca2c5-2b6b-4125-a160-7f2508d0495b service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:24.034815 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ca2c5-2b6b-4125-a160-7f2508d0495b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:24.045015 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ca2c5-2b6b-4125-a160-7f2508d0495b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:24.046743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ca2c5-2b6b-4125-a160-7f2508d0495b service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:24.059121 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1153/2330] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:29:23 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:29:34.684117 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=8 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:34.844581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=18 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:36.538720 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c529ce-8754-4b6b-b1e1-34e989655f90 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:36.612199 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c529ce-8754-4b6b-b1e1-34e989655f90 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:36.617281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f69be-b87f-4301-8f8f-95017a0cb3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:36.617954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f69be-b87f-4301-8f8f-95017a0cb3e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:36.617954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f69be-b87f-4301-8f8f-95017a0cb3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:36.618456 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f69be-b87f-4301-8f8f-95017a0cb3e1 admin admin] PATH_INFO: `/v3/users/277145ddb0df4c87a0d0c4af11c3805b` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:36.619647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f69be-b87f-4301-8f8f-95017a0cb3e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=277145ddb0df4c87a0d0c4af11c3805b)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:36.621598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f69be-b87f-4301-8f8f-95017a0cb3e1 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:36.966550 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-bf6f69be-b87f-4301-8f8f-95017a0cb3e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '277145ddb0df4c87a0d0c4af11c3805b'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:29:37.011804 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-bf6f69be-b87f-4301-8f8f-95017a0cb3e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '277145ddb0df4c87a0d0c4af11c3805b'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:29:37.012570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-bf6f69be-b87f-4301-8f8f-95017a0cb3e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '277145ddb0df4c87a0d0c4af11c3805b'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:29:37.014075 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-bf6f69be-b87f-4301-8f8f-95017a0cb3e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '277145ddb0df4c87a0d0c4af11c3805b'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:29:37.024571 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-bf6f69be-b87f-4301-8f8f-95017a0cb3e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '277145ddb0df4c87a0d0c4af11c3805b'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:29:37.056969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1178/2331] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:29:36 2022] DELETE /identity/v3/users/277145ddb0df4c87a0d0c4af11c3805b => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:29:37.061326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd35caf-3bf3-4104-b37d-5705ad2c7627 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:37.061920 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd35caf-3bf3-4104-b37d-5705ad2c7627 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:37.061920 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd35caf-3bf3-4104-b37d-5705ad2c7627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:37.086138 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-afd35caf-3bf3-4104-b37d-5705ad2c7627 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:29:37.087367 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-afd35caf-3bf3-4104-b37d-5705ad2c7627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:37.165691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1154/2332] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:29:37.187860 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f69be-b87f-4301-8f8f-95017a0cb3e1 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:37.187860 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-bf6f69be-b87f-4301-8f8f-95017a0cb3e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:37.244728 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f69be-b87f-4301-8f8f-95017a0cb3e1 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:37.248790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4acb1-5aef-4a4c-afb8-7e5649e67bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:37.249769 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4acb1-5aef-4a4c-afb8-7e5649e67bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:37.249964 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4acb1-5aef-4a4c-afb8-7e5649e67bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:37.250333 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4acb1-5aef-4a4c-afb8-7e5649e67bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:37.262830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4acb1-5aef-4a4c-afb8-7e5649e67bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:37.264477 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4acb1-5aef-4a4c-afb8-7e5649e67bb4 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:37.276780 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1179/2333] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:29:38.148682 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd35caf-3bf3-4104-b37d-5705ad2c7627 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:38.151087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-afd35caf-3bf3-4104-b37d-5705ad2c7627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:38.166184 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd35caf-3bf3-4104-b37d-5705ad2c7627 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:38.173404 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8034fb-4063-4775-a247-d6c8b419b4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:38.173404 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8034fb-4063-4775-a247-d6c8b419b4f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:38.173404 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8034fb-4063-4775-a247-d6c8b419b4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:38.173404 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8034fb-4063-4775-a247-d6c8b419b4f5 admin admin] PATH_INFO: `/v3/projects/bc554e3d37824bdd958766935d2a715c` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:38.173883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8034fb-4063-4775-a247-d6c8b419b4f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc554e3d37824bdd958766935d2a715c)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:38.178181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8034fb-4063-4775-a247-d6c8b419b4f5 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:38.328199 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9d8034fb-4063-4775-a247-d6c8b419b4f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc554e3d37824bdd958766935d2a715c', 'request_id': 'req-9d8034fb-4063-4775-a247-d6c8b419b4f5'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:29:38.335917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9d8034fb-4063-4775-a247-d6c8b419b4f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc554e3d37824bdd958766935d2a715c', 'request_id': 'req-9d8034fb-4063-4775-a247-d6c8b419b4f5'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:29:38.426481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9d8034fb-4063-4775-a247-d6c8b419b4f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc554e3d37824bdd958766935d2a715c', 'request_id': 'req-9d8034fb-4063-4775-a247-d6c8b419b4f5'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:29:38.438419 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9d8034fb-4063-4775-a247-d6c8b419b4f5 admin admin] The token cache is being invalidate because project bc554e3d37824bdd958766935d2a715c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:29:38.438721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9d8034fb-4063-4775-a247-d6c8b419b4f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:29:38.439387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9d8034fb-4063-4775-a247-d6c8b419b4f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:29:38.440967 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1155/2334] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:29:38 2022] DELETE /identity/v3/projects/bc554e3d37824bdd958766935d2a715c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:29:38.446885 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88178de3-941d-447e-b6fc-38b58508c3b4 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:38.447330 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88178de3-941d-447e-b6fc-38b58508c3b4 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:38.447779 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88178de3-941d-447e-b6fc-38b58508c3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:38.471376 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-88178de3-941d-447e-b6fc-38b58508c3b4 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:29:38.473647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-88178de3-941d-447e-b6fc-38b58508c3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:38.492812 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:38.545649 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1180/2335] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:29:38.554372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd92b8f-bb5a-4699-a285-1cd34e5a73da None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:38.554656 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd92b8f-bb5a-4699-a285-1cd34e5a73da None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:38.554929 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd92b8f-bb5a-4699-a285-1cd34e5a73da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:38.584115 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-8fd92b8f-bb5a-4699-a285-1cd34e5a73da None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:29:38.586149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-8fd92b8f-bb5a-4699-a285-1cd34e5a73da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:38.593616 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1156/2336] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:29:38.598680 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88178de3-941d-447e-b6fc-38b58508c3b4 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:38.617520 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88178de3-941d-447e-b6fc-38b58508c3b4 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:38.623765 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532b98e-3eda-4f0e-a3c5-971f54a02fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:38.624682 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532b98e-3eda-4f0e-a3c5-971f54a02fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:38.624938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532b98e-3eda-4f0e-a3c5-971f54a02fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:38.625211 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532b98e-3eda-4f0e-a3c5-971f54a02fc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:38.625884 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532b98e-3eda-4f0e-a3c5-971f54a02fc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:29:38.626183 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532b98e-3eda-4f0e-a3c5-971f54a02fc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:38.627881 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532b98e-3eda-4f0e-a3c5-971f54a02fc9 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:38.640873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1181/2337] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:29:38.646052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd92b8f-bb5a-4699-a285-1cd34e5a73da None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:38.655779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd92b8f-bb5a-4699-a285-1cd34e5a73da None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:38.661205 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31d237-c272-4819-aabe-f96baaccab3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:38.661808 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31d237-c272-4819-aabe-f96baaccab3f admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:38.662089 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31d237-c272-4819-aabe-f96baaccab3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:38.662351 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31d237-c272-4819-aabe-f96baaccab3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:38.662983 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31d237-c272-4819-aabe-f96baaccab3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:38.665154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31d237-c272-4819-aabe-f96baaccab3f admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:38.828719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1157/2338] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:29:38 2022] POST /identity/v3/projects => generated 381 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:29:38.829846 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532b98e-3eda-4f0e-a3c5-971f54a02fc9 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:38.844478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532b98e-3eda-4f0e-a3c5-971f54a02fc9 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:38.918903 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325c6af-f953-45ec-9f6b-84e258c982a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:38.918903 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325c6af-f953-45ec-9f6b-84e258c982a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:38.918903 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325c6af-f953-45ec-9f6b-84e258c982a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:38.918903 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325c6af-f953-45ec-9f6b-84e258c982a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:38.919366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325c6af-f953-45ec-9f6b-84e258c982a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:38.920580 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325c6af-f953-45ec-9f6b-84e258c982a2 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:38.997375 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1182/2339] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:29:38 2022] POST /identity/v3/users => generated 291 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:29:39.001896 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31d237-c272-4819-aabe-f96baaccab3f admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:39.017730 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697d35a-8f7b-4469-9dbf-238dd67c341e None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:39.018107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697d35a-8f7b-4469-9dbf-238dd67c341e None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:39.018382 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697d35a-8f7b-4469-9dbf-238dd67c341e None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:39.019817 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1183/2340] 10.222.0.77 () {54 vars in 921 bytes} [Tue Sep 6 20:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:29:39.022057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31d237-c272-4819-aabe-f96baaccab3f admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:39.028494 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62df8c-5655-4688-8120-daee0b14fdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:39.029186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62df8c-5655-4688-8120-daee0b14fdf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:39.029411 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62df8c-5655-4688-8120-daee0b14fdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:39.029690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62df8c-5655-4688-8120-daee0b14fdf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:39.030503 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62df8c-5655-4688-8120-daee0b14fdf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:39.032385 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62df8c-5655-4688-8120-daee0b14fdf1 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:39.042509 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dc9e0-5a79-4e2b-8f98-af0fe8c7e3c1 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:39.042986 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dc9e0-5a79-4e2b-8f98-af0fe8c7e3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:39.043399 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dc9e0-5a79-4e2b-8f98-af0fe8c7e3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:39.064737 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1158/2341] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:29:39.067346 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62df8c-5655-4688-8120-daee0b14fdf1 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:39.069899 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-9b9dc9e0-5a79-4e2b-8f98-af0fe8c7e3c1 None None] MFA Rules not processed for user `b09ce16da49b4af38491ad4eb6287d70`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:29:39.071489 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-9b9dc9e0-5a79-4e2b-8f98-af0fe8c7e3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:39.096084 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62df8c-5655-4688-8120-daee0b14fdf1 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:39.103740 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2e965-7679-4090-954a-9c9180aeca17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:39.104398 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2e965-7679-4090-954a-9c9180aeca17 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:39.104740 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2e965-7679-4090-954a-9c9180aeca17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:39.105008 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2e965-7679-4090-954a-9c9180aeca17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:39.106058 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2e965-7679-4090-954a-9c9180aeca17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:39.108043 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2e965-7679-4090-954a-9c9180aeca17 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:39.124295 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1159/2342] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:29:39.129916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2e965-7679-4090-954a-9c9180aeca17 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:39.170674 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2e965-7679-4090-954a-9c9180aeca17 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:39.175984 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1184/2343] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Sep 6 20:29:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:29:39.190543 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d70919-0858-4e40-830b-137827f6d45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:39.192660 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d70919-0858-4e40-830b-137827f6d45f admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:39.193112 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d70919-0858-4e40-830b-137827f6d45f admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:39.193442 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d70919-0858-4e40-830b-137827f6d45f admin admin] PATH_INFO: `/v3/projects/c94581b77a6d4ebb8bdd5d9db2eee048/users/3a9c5777bcc149ea9a30f3fd1fca12ef/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:39.199803 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dc9e0-5a79-4e2b-8f98-af0fe8c7e3c1 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:39.201307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-9b9dc9e0-5a79-4e2b-8f98-af0fe8c7e3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:39.214379 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d70919-0858-4e40-830b-137827f6d45f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c94581b77a6d4ebb8bdd5d9db2eee048, user_id=3a9c5777bcc149ea9a30f3fd1fca12ef, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:39.217379 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d70919-0858-4e40-830b-137827f6d45f admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:39.243337 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:39.272988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dc9e0-5a79-4e2b-8f98-af0fe8c7e3c1 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:39.281800 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9c3ef-34e0-4b58-bda9-79397341ba36 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '871f208a13ba435491022b9ea9b735e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:39.282476 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9c3ef-34e0-4b58-bda9-79397341ba36 service glance] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:39.282756 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9c3ef-34e0-4b58-bda9-79397341ba36 service glance] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:39.283029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9c3ef-34e0-4b58-bda9-79397341ba36 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:39.295474 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9c3ef-34e0-4b58-bda9-79397341ba36 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:39.297399 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9c3ef-34e0-4b58-bda9-79397341ba36 service glance] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:39.302147 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1160/2344] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:29:39 2022] PUT /identity/v3/projects/c94581b77a6d4ebb8bdd5d9db2eee048/users/3a9c5777bcc149ea9a30f3fd1fca12ef/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:29:39.313254 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430d8dd-6825-4ef5-8cc6-b7467a08162c None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:39.313792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430d8dd-6825-4ef5-8cc6-b7467a08162c None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:39.314263 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430d8dd-6825-4ef5-8cc6-b7467a08162c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:39.324340 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1185/2345] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:29:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:29:39.349168 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-1430d8dd-6825-4ef5-8cc6-b7467a08162c None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:29:39.350538 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-1430d8dd-6825-4ef5-8cc6-b7467a08162c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:39.357635 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:39.455675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1161/2346] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:29:39.476494 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9c3ef-34e0-4b58-bda9-79397341ba36 service glance] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:39.477992 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-61e9c3ef-34e0-4b58-bda9-79397341ba36 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:39.544131 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9c3ef-34e0-4b58-bda9-79397341ba36 service glance] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:39.595487 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3038e-6865-48d4-846f-71f4f8e07bda None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:39.597644 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3038e-6865-48d4-846f-71f4f8e07bda None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:39.597825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3038e-6865-48d4-846f-71f4f8e07bda None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:39.601547 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1162/2347] 10.222.0.77 () {54 vars in 921 bytes} [Tue Sep 6 20:29:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:29:39.607929 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45336a5b-ac53-49e6-9172-c3481fe67b44 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:39.608201 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45336a5b-ac53-49e6-9172-c3481fe67b44 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:39.609648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45336a5b-ac53-49e6-9172-c3481fe67b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:39.623368 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511da5f5-ce90-4082-85db-d711fb17c522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:39.623368 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511da5f5-ce90-4082-85db-d711fb17c522 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:39.623368 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511da5f5-ce90-4082-85db-d711fb17c522 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:39.623368 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511da5f5-ce90-4082-85db-d711fb17c522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:39.639558 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511da5f5-ce90-4082-85db-d711fb17c522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:39.641287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511da5f5-ce90-4082-85db-d711fb17c522 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:39.649449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-45336a5b-ac53-49e6-9172-c3481fe67b44 None None] MFA Rules not processed for user `5a876d70d9634bf59af5f138e856f75f`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:29:39.655576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-45336a5b-ac53-49e6-9172-c3481fe67b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:39.657767 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1186/2348] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:29:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:29:39.695132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1163/2349] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Sep 6 20:29:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:29:39.715556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511da5f5-ce90-4082-85db-d711fb17c522 service neutron] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:39.729706 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511da5f5-ce90-4082-85db-d711fb17c522 service neutron] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:39.734825 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be9006-2291-4051-b1cb-49c629a6444c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:39.735683 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be9006-2291-4051-b1cb-49c629a6444c service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:39.736314 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be9006-2291-4051-b1cb-49c629a6444c service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:39.736712 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be9006-2291-4051-b1cb-49c629a6444c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:39.754208 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be9006-2291-4051-b1cb-49c629a6444c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:39.755472 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be9006-2291-4051-b1cb-49c629a6444c service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:39.778246 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1187/2350] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:29:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:29:39.922153 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e041ae-e518-4437-adc7-6237eae7b9ed None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:39.922688 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e041ae-e518-4437-adc7-6237eae7b9ed None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:39.923337 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e041ae-e518-4437-adc7-6237eae7b9ed None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:39.926230 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1164/2351] 10.222.0.77 () {54 vars in 921 bytes} [Tue Sep 6 20:29:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:29:39.933261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f523f3-5400-41ef-8e36-ce855a6ad8f9 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:39.933538 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f523f3-5400-41ef-8e36-ce855a6ad8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:39.933809 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f523f3-5400-41ef-8e36-ce855a6ad8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:39.979112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-01f523f3-5400-41ef-8e36-ce855a6ad8f9 None None] MFA Rules not processed for user `b09ce16da49b4af38491ad4eb6287d70`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:29:39.984243 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-01f523f3-5400-41ef-8e36-ce855a6ad8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:40.082010 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1188/2352] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Sep 6 20:29:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:29:40.097704 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e041ae-e518-4437-adc7-6237eae7b9ed None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:40.110183 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e041ae-e518-4437-adc7-6237eae7b9ed None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:40.117103 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083fc15-e8fd-49da-af58-e53252cdd048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:40.117741 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083fc15-e8fd-49da-af58-e53252cdd048 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:40.118040 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083fc15-e8fd-49da-af58-e53252cdd048 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:40.118373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083fc15-e8fd-49da-af58-e53252cdd048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:40.130643 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083fc15-e8fd-49da-af58-e53252cdd048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:40.132179 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083fc15-e8fd-49da-af58-e53252cdd048 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:40.146015 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1165/2353] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:29:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:29:41.985811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8831a-2e2c-465b-acf0-99e78eacdea0 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:41.986386 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8831a-2e2c-465b-acf0-99e78eacdea0 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:41.986486 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8831a-2e2c-465b-acf0-99e78eacdea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:42.045197 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-26f8831a-2e2c-465b-acf0-99e78eacdea0 None None] MFA Rules not processed for user `c314372147b2491cb4481d538056472c`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:29:42.047820 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-26f8831a-2e2c-465b-acf0-99e78eacdea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:42.059177 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:42.135927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1189/2354] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Sep 6 20:29:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:29:42.151826 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083fc15-e8fd-49da-af58-e53252cdd048 service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:42.153859 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c083fc15-e8fd-49da-af58-e53252cdd048 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:42.213067 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e611c06-9b8e-485b-b235-5440fdc27586 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:42.213399 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e611c06-9b8e-485b-b235-5440fdc27586 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:42.213643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e611c06-9b8e-485b-b235-5440fdc27586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:42.249390 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-6e611c06-9b8e-485b-b235-5440fdc27586 None None] MFA Rules not processed for user `c314372147b2491cb4481d538056472c`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:29:42.250649 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-6e611c06-9b8e-485b-b235-5440fdc27586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:42.256105 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083fc15-e8fd-49da-af58-e53252cdd048 service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:42.259905 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1190/2355] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Sep 6 20:29:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:29:42.269363 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96eadd-800d-4f08-af3f-0d372fe17632 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6c4f91a59548fd979e7232a2afd6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:42.271334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96eadd-800d-4f08-af3f-0d372fe17632 service swift] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:42.272480 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96eadd-800d-4f08-af3f-0d372fe17632 service swift] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:42.272771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96eadd-800d-4f08-af3f-0d372fe17632 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:42.276039 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e611c06-9b8e-485b-b235-5440fdc27586 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:42.291588 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96eadd-800d-4f08-af3f-0d372fe17632 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:42.292175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e611c06-9b8e-485b-b235-5440fdc27586 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:42.293393 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96eadd-800d-4f08-af3f-0d372fe17632 service swift] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:42.298598 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e8542-1221-441d-839b-0db50c03794a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6c4f91a59548fd979e7232a2afd6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:42.299417 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e8542-1221-441d-839b-0db50c03794a service swift] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:42.300196 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e8542-1221-441d-839b-0db50c03794a service swift] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:42.300612 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e8542-1221-441d-839b-0db50c03794a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:42.306122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1166/2356] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Sep 6 20:29:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 20:29:42.313956 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e8542-1221-441d-839b-0db50c03794a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:42.316978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e8542-1221-441d-839b-0db50c03794a service swift] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:42.328410 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1191/2357] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Sep 6 20:29:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 20:29:44.783757 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e5fb8-fda6-414e-8d8a-3d7fddc7b62e None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:44.785039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e5fb8-fda6-414e-8d8a-3d7fddc7b62e None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:44.785740 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e5fb8-fda6-414e-8d8a-3d7fddc7b62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:44.861612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-8c3e5fb8-fda6-414e-8d8a-3d7fddc7b62e None None] MFA Rules not processed for user `c314372147b2491cb4481d538056472c`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:29:44.870837 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-8c3e5fb8-fda6-414e-8d8a-3d7fddc7b62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:44.917543 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1167/2358] 10.222.0.77 () {58 vars in 967 bytes} [Tue Sep 6 20:29:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:29:44.946541 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e8542-1221-441d-839b-0db50c03794a service swift] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:44.973761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e8542-1221-441d-839b-0db50c03794a service swift] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:44.979798 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f4c2b-d57f-4799-ace3-3cb26b5b1619 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6c4f91a59548fd979e7232a2afd6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:44.981560 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f4c2b-d57f-4799-ace3-3cb26b5b1619 service swift] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:44.981847 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f4c2b-d57f-4799-ace3-3cb26b5b1619 service swift] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:44.982119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f4c2b-d57f-4799-ace3-3cb26b5b1619 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:44.995434 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f4c2b-d57f-4799-ace3-3cb26b5b1619 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:44.997116 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f4c2b-d57f-4799-ace3-3cb26b5b1619 service swift] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:45.020515 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1192/2359] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Sep 6 20:29:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 20:29:46.137490 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fa8bd-0777-4fd1-8dbc-5a817c7755ed None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:46.137945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fa8bd-0777-4fd1-8dbc-5a817c7755ed None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:46.138027 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fa8bd-0777-4fd1-8dbc-5a817c7755ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:46.215135 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-284fa8bd-0777-4fd1-8dbc-5a817c7755ed None None] MFA Rules not processed for user `c314372147b2491cb4481d538056472c`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:29:46.226605 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-284fa8bd-0777-4fd1-8dbc-5a817c7755ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:46.253088 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1168/2360] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Sep 6 20:29:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:29:46.271560 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f4c2b-d57f-4799-ace3-3cb26b5b1619 service swift] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:46.318747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f4c2b-d57f-4799-ace3-3cb26b5b1619 service swift] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:46.328767 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd28098-e08e-4087-aef2-04bbce501d77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6c4f91a59548fd979e7232a2afd6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:46.336175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd28098-e08e-4087-aef2-04bbce501d77 service swift] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:46.336175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd28098-e08e-4087-aef2-04bbce501d77 service swift] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:46.336175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd28098-e08e-4087-aef2-04bbce501d77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:46.356197 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd28098-e08e-4087-aef2-04bbce501d77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:46.358147 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd28098-e08e-4087-aef2-04bbce501d77 service swift] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:46.376885 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1193/2361] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Sep 6 20:29:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 20:29:47.376001 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde9e64-d356-4322-a547-1cf887a3b315 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:47.378374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde9e64-d356-4322-a547-1cf887a3b315 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:47.380229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde9e64-d356-4322-a547-1cf887a3b315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:47.507056 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-adde9e64-d356-4322-a547-1cf887a3b315 None None] MFA Rules not processed for user `c314372147b2491cb4481d538056472c`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:29:47.515684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-adde9e64-d356-4322-a547-1cf887a3b315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:47.540258 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1169/2362] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Sep 6 20:29:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:29:47.663603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd28098-e08e-4087-aef2-04bbce501d77 service swift] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:47.696524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd28098-e08e-4087-aef2-04bbce501d77 service swift] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:47.706722 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee70dd-bd5d-4540-91ca-786e11959e66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6c4f91a59548fd979e7232a2afd6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:47.709314 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee70dd-bd5d-4540-91ca-786e11959e66 service swift] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:47.709314 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee70dd-bd5d-4540-91ca-786e11959e66 service swift] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:47.709314 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee70dd-bd5d-4540-91ca-786e11959e66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:47.724421 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee70dd-bd5d-4540-91ca-786e11959e66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:47.726478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee70dd-bd5d-4540-91ca-786e11959e66 service swift] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:47.736681 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1194/2363] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Sep 6 20:29:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 20:29:50.229916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3e9d9-b879-4bfe-a76f-c80a1ff09335 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:50.232017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3e9d9-b879-4bfe-a76f-c80a1ff09335 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:50.234275 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3e9d9-b879-4bfe-a76f-c80a1ff09335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:50.307201 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-2ba3e9d9-b879-4bfe-a76f-c80a1ff09335 None None] MFA Rules not processed for user `3a9c5777bcc149ea9a30f3fd1fca12ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:29:50.311401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-2ba3e9d9-b879-4bfe-a76f-c80a1ff09335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:29:50.514138 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:29:50.558768 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1170/2364] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:29:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:29:50.566662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee70dd-bd5d-4540-91ca-786e11959e66 service swift] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:50.617764 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee70dd-bd5d-4540-91ca-786e11959e66 service swift] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:50.632820 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc42c12-3189-45c9-b8c0-561cc9e5dd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:50.633446 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc42c12-3189-45c9-b8c0-561cc9e5dd24 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:50.633729 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc42c12-3189-45c9-b8c0-561cc9e5dd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:50.634000 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc42c12-3189-45c9-b8c0-561cc9e5dd24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:50.634702 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc42c12-3189-45c9-b8c0-561cc9e5dd24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:50.641172 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc42c12-3189-45c9-b8c0-561cc9e5dd24 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:50.806509 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1195/2365] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:29:50 2022] POST /identity/v3/projects => generated 385 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:29:50.812359 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3e9d9-b879-4bfe-a76f-c80a1ff09335 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:50.848065 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3e9d9-b879-4bfe-a76f-c80a1ff09335 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:50.989907 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7313269-92ca-46d6-986d-77d9236a2eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:50.993263 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7313269-92ca-46d6-986d-77d9236a2eed admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:50.993263 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7313269-92ca-46d6-986d-77d9236a2eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:50.993263 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7313269-92ca-46d6-986d-77d9236a2eed admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:50.993263 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7313269-92ca-46d6-986d-77d9236a2eed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:50.994664 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7313269-92ca-46d6-986d-77d9236a2eed admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:51.108794 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1171/2366] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:29:50 2022] POST /identity/v3/users => generated 299 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:29:51.113652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc42c12-3189-45c9-b8c0-561cc9e5dd24 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:51.130638 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc42c12-3189-45c9-b8c0-561cc9e5dd24 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:51.136190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef57cc-123c-4228-99c6-42c761c6ed7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:51.141010 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef57cc-123c-4228-99c6-42c761c6ed7e admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:51.141010 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef57cc-123c-4228-99c6-42c761c6ed7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:51.141010 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef57cc-123c-4228-99c6-42c761c6ed7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:51.141010 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef57cc-123c-4228-99c6-42c761c6ed7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:51.141010 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef57cc-123c-4228-99c6-42c761c6ed7e admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:51.180688 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7313269-92ca-46d6-986d-77d9236a2eed admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:51.198638 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1196/2367] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:29:51.206631 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7313269-92ca-46d6-986d-77d9236a2eed admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:51.212466 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af75977-6333-4eab-887a-5c39a1db4618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:51.225961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af75977-6333-4eab-887a-5c39a1db4618 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:51.227433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af75977-6333-4eab-887a-5c39a1db4618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:51.228698 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af75977-6333-4eab-887a-5c39a1db4618 admin admin] PATH_INFO: `/v3/projects/54126cdbb91c479286bc2fd86c7e21bf/users/97a85f348c4d4eaea66042ecf4999daa/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:51.264374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af75977-6333-4eab-887a-5c39a1db4618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54126cdbb91c479286bc2fd86c7e21bf, user_id=97a85f348c4d4eaea66042ecf4999daa, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:51.273234 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af75977-6333-4eab-887a-5c39a1db4618 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:51.372976 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1172/2368] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:29:51 2022] PUT /identity/v3/projects/54126cdbb91c479286bc2fd86c7e21bf/users/97a85f348c4d4eaea66042ecf4999daa/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:29:51.377203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef57cc-123c-4228-99c6-42c761c6ed7e admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:51.410362 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef57cc-123c-4228-99c6-42c761c6ed7e admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:51.686726 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8123e-a9b1-4d83-b849-f376e238a189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:51.690571 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8123e-a9b1-4d83-b849-f376e238a189 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:51.692570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8123e-a9b1-4d83-b849-f376e238a189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:51.693792 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8123e-a9b1-4d83-b849-f376e238a189 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:51.694751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad8123e-a9b1-4d83-b849-f376e238a189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:51.700417 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad8123e-a9b1-4d83-b849-f376e238a189 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:51.753909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1197/2369] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:29:51.757987 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af75977-6333-4eab-887a-5c39a1db4618 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:29:51.777453 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af75977-6333-4eab-887a-5c39a1db4618 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:29:51.789998 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9fc8a-d27e-4107-8d2d-efdc1e21be71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:29:51.791334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9fc8a-d27e-4107-8d2d-efdc1e21be71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:29:51.791334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9fc8a-d27e-4107-8d2d-efdc1e21be71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:29:51.791625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9fc8a-d27e-4107-8d2d-efdc1e21be71 admin admin] PATH_INFO: `/v3/projects/54126cdbb91c479286bc2fd86c7e21bf/users/97a85f348c4d4eaea66042ecf4999daa/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:29:51.798609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9fc8a-d27e-4107-8d2d-efdc1e21be71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54126cdbb91c479286bc2fd86c7e21bf, user_id=97a85f348c4d4eaea66042ecf4999daa, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:29:51.801569 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9fc8a-d27e-4107-8d2d-efdc1e21be71 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:29:51.823342 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1173/2370] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:29:51 2022] PUT /identity/v3/projects/54126cdbb91c479286bc2fd86c7e21bf/users/97a85f348c4d4eaea66042ecf4999daa/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:30:01.741856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=90,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:30:01.810747 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=49,keystone:INSERT=5 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:30:01.857906 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8123e-a9b1-4d83-b849-f376e238a189 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:01.868368 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-1ad8123e-a9b1-4d83-b849-f376e238a189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:02.118197 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8123e-a9b1-4d83-b849-f376e238a189 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:02.237806 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724ea54-a6f8-47d5-9caf-760153a42a95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a486663ec144db0bbde6bf3deb35a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:02.238574 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724ea54-a6f8-47d5-9caf-760153a42a95 service placement] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:02.239141 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724ea54-a6f8-47d5-9caf-760153a42a95 service placement] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:02.239623 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724ea54-a6f8-47d5-9caf-760153a42a95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:02.241719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-d724ea54-a6f8-47d5-9caf-760153a42a95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:02.255571 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724ea54-a6f8-47d5-9caf-760153a42a95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:02.257191 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724ea54-a6f8-47d5-9caf-760153a42a95 service placement] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:02.270713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1198/2371] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:30:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:30:03.489133 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569f2cf-7cd0-4bd1-bf63-218fbf510f26 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:03.489911 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569f2cf-7cd0-4bd1-bf63-218fbf510f26 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:03.489911 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569f2cf-7cd0-4bd1-bf63-218fbf510f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:03.524174 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-7569f2cf-7cd0-4bd1-bf63-218fbf510f26 None None] MFA Rules not processed for user `c314372147b2491cb4481d538056472c`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:30:03.528918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-7569f2cf-7cd0-4bd1-bf63-218fbf510f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:03.731190 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1174/2372] 10.222.0.77 () {58 vars in 967 bytes} [Tue Sep 6 20:30:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:30:03.789531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724ea54-a6f8-47d5-9caf-760153a42a95 service placement] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:04.008451 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724ea54-a6f8-47d5-9caf-760153a42a95 service placement] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:04.052973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29558fa1-f0ff-4c21-b1cc-4ae2c247897e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6c4f91a59548fd979e7232a2afd6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:04.057954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29558fa1-f0ff-4c21-b1cc-4ae2c247897e service swift] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:04.057954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29558fa1-f0ff-4c21-b1cc-4ae2c247897e service swift] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:04.061494 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29558fa1-f0ff-4c21-b1cc-4ae2c247897e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:04.100154 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29558fa1-f0ff-4c21-b1cc-4ae2c247897e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:04.101803 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29558fa1-f0ff-4c21-b1cc-4ae2c247897e service swift] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:04.162269 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1199/2373] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Sep 6 20:30:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 20:30:04.516415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed16ccd-a277-4435-b3e3-ed2dd6052617 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:04.517004 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed16ccd-a277-4435-b3e3-ed2dd6052617 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:04.517004 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed16ccd-a277-4435-b3e3-ed2dd6052617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:04.614211 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-6ed16ccd-a277-4435-b3e3-ed2dd6052617 None None] MFA Rules not processed for user `97a85f348c4d4eaea66042ecf4999daa`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:30:04.615291 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6ed16ccd-a277-4435-b3e3-ed2dd6052617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:04.906610 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1175/2374] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:30:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:30:04.927973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29558fa1-f0ff-4c21-b1cc-4ae2c247897e service swift] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:04.930089 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-29558fa1-f0ff-4c21-b1cc-4ae2c247897e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:05.013486 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:30:05.057946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29558fa1-f0ff-4c21-b1cc-4ae2c247897e service swift] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:05.062223 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011392b-556f-4159-a787-8545a99b581f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '871f208a13ba435491022b9ea9b735e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:05.063344 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011392b-556f-4159-a787-8545a99b581f service glance] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:05.070206 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011392b-556f-4159-a787-8545a99b581f service glance] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:05.070206 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011392b-556f-4159-a787-8545a99b581f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:05.179857 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011392b-556f-4159-a787-8545a99b581f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:05.181742 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011392b-556f-4159-a787-8545a99b581f service glance] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:05.208678 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1200/2375] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:30:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:30:05.552037 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda9417-cbe6-4c8b-8a31-2a017ca396a4 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:05.552629 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda9417-cbe6-4c8b-8a31-2a017ca396a4 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:05.552629 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda9417-cbe6-4c8b-8a31-2a017ca396a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:05.592591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-ebda9417-cbe6-4c8b-8a31-2a017ca396a4 None None] MFA Rules not processed for user `c314372147b2491cb4481d538056472c`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:30:05.593854 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-ebda9417-cbe6-4c8b-8a31-2a017ca396a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:05.619793 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1176/2376] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Sep 6 20:30:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:30:05.631900 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011392b-556f-4159-a787-8545a99b581f service glance] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:05.667977 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011392b-556f-4159-a787-8545a99b581f service glance] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:05.691236 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551b420-a738-432b-80ae-1508cc24e0d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6c4f91a59548fd979e7232a2afd6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:05.692304 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551b420-a738-432b-80ae-1508cc24e0d6 service swift] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:05.692877 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551b420-a738-432b-80ae-1508cc24e0d6 service swift] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:05.694006 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551b420-a738-432b-80ae-1508cc24e0d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:05.733422 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551b420-a738-432b-80ae-1508cc24e0d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:05.735070 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551b420-a738-432b-80ae-1508cc24e0d6 service swift] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:05.745364 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1201/2377] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Sep 6 20:30:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 20:30:07.001284 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda9417-cbe6-4c8b-8a31-2a017ca396a4 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:07.004222 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-ebda9417-cbe6-4c8b-8a31-2a017ca396a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:07.251682 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda9417-cbe6-4c8b-8a31-2a017ca396a4 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:07.261879 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f07dc-1663-444c-a175-4e29a49072db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:07.266020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f07dc-1663-444c-a175-4e29a49072db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:07.267610 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f07dc-1663-444c-a175-4e29a49072db admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:07.267610 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f07dc-1663-444c-a175-4e29a49072db admin admin] PATH_INFO: `/v3/users/341ecd2c87f74f9fa81f2a861e560d87` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:07.268428 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f07dc-1663-444c-a175-4e29a49072db admin admin] RBAC: Authorizing `identity:delete_user(user_id=341ecd2c87f74f9fa81f2a861e560d87)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:07.271276 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f07dc-1663-444c-a175-4e29a49072db admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:07.426719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:30:07.582841 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-735f07dc-1663-444c-a175-4e29a49072db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '341ecd2c87f74f9fa81f2a861e560d87'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:07.669406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-735f07dc-1663-444c-a175-4e29a49072db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '341ecd2c87f74f9fa81f2a861e560d87'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:07.669406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-735f07dc-1663-444c-a175-4e29a49072db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '341ecd2c87f74f9fa81f2a861e560d87'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:07.669406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-735f07dc-1663-444c-a175-4e29a49072db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '341ecd2c87f74f9fa81f2a861e560d87'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:07.682498 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-735f07dc-1663-444c-a175-4e29a49072db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '341ecd2c87f74f9fa81f2a861e560d87'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:07.757823 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1177/2378] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:30:06 2022] DELETE /identity/v3/users/341ecd2c87f74f9fa81f2a861e560d87 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:30:08.196802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551b420-a738-432b-80ae-1508cc24e0d6 service swift] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:08.235057 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551b420-a738-432b-80ae-1508cc24e0d6 service swift] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:08.378264 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f07dc-1663-444c-a175-4e29a49072db admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:08.379843 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-735f07dc-1663-444c-a175-4e29a49072db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:08.516730 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a17f0-418c-4ff4-a32c-c2cb63744c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:08.517629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a17f0-418c-4ff4-a32c-c2cb63744c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:08.518810 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a17f0-418c-4ff4-a32c-c2cb63744c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:08.518810 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a17f0-418c-4ff4-a32c-c2cb63744c70 admin admin] PATH_INFO: `/v3/projects/6dc9e830028247ac92803be144bc9666` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:08.521502 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a17f0-418c-4ff4-a32c-c2cb63744c70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dc9e830028247ac92803be144bc9666)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:08.526872 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a17f0-418c-4ff4-a32c-c2cb63744c70 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:08.605264 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f07dc-1663-444c-a175-4e29a49072db admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:08.612017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c15f33-5d4e-4bc5-a2e0-7523ef822fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:08.613136 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c15f33-5d4e-4bc5-a2e0-7523ef822fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:08.613571 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c15f33-5d4e-4bc5-a2e0-7523ef822fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:08.614016 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c15f33-5d4e-4bc5-a2e0-7523ef822fb6 admin admin] PATH_INFO: `/v3/users/eee15bfd12f84c6db46ce2616d010e36` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:08.616042 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c15f33-5d4e-4bc5-a2e0-7523ef822fb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eee15bfd12f84c6db46ce2616d010e36)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:08.618871 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c15f33-5d4e-4bc5-a2e0-7523ef822fb6 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:08.795675 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c08a17f0-418c-4ff4-a32c-c2cb63744c70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dc9e830028247ac92803be144bc9666', 'request_id': 'req-c08a17f0-418c-4ff4-a32c-c2cb63744c70'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:08.811869 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c08a17f0-418c-4ff4-a32c-c2cb63744c70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dc9e830028247ac92803be144bc9666', 'request_id': 'req-c08a17f0-418c-4ff4-a32c-c2cb63744c70'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:08.888114 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-62c15f33-5d4e-4bc5-a2e0-7523ef822fb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eee15bfd12f84c6db46ce2616d010e36'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:08.889081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c08a17f0-418c-4ff4-a32c-c2cb63744c70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dc9e830028247ac92803be144bc9666', 'request_id': 'req-c08a17f0-418c-4ff4-a32c-c2cb63744c70'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:08.894753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:30:08.905465 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c08a17f0-418c-4ff4-a32c-c2cb63744c70 admin admin] The token cache is being invalidate because project 6dc9e830028247ac92803be144bc9666 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:30:08.905772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c08a17f0-418c-4ff4-a32c-c2cb63744c70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:08.907095 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c08a17f0-418c-4ff4-a32c-c2cb63744c70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:08.913036 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1202/2379] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:30:08 2022] DELETE /identity/v3/projects/6dc9e830028247ac92803be144bc9666 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:30:08.914349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a17f0-418c-4ff4-a32c-c2cb63744c70 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:08.916273 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-c08a17f0-418c-4ff4-a32c-c2cb63744c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:09.008743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-62c15f33-5d4e-4bc5-a2e0-7523ef822fb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eee15bfd12f84c6db46ce2616d010e36'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:09.009995 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-62c15f33-5d4e-4bc5-a2e0-7523ef822fb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eee15bfd12f84c6db46ce2616d010e36'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:09.010632 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-62c15f33-5d4e-4bc5-a2e0-7523ef822fb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eee15bfd12f84c6db46ce2616d010e36'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:09.031834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-62c15f33-5d4e-4bc5-a2e0-7523ef822fb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eee15bfd12f84c6db46ce2616d010e36'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:09.068586 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a17f0-418c-4ff4-a32c-c2cb63744c70 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:09.070953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115d64f-1676-46d3-83e6-2257420c43e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:09.071653 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115d64f-1676-46d3-83e6-2257420c43e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:09.071984 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115d64f-1676-46d3-83e6-2257420c43e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:09.072266 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115d64f-1676-46d3-83e6-2257420c43e8 admin admin] PATH_INFO: `/v3/users/6f2e383c506d41f3ba12112f363cf3a1` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:09.074235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115d64f-1676-46d3-83e6-2257420c43e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f2e383c506d41f3ba12112f363cf3a1)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:09.076696 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115d64f-1676-46d3-83e6-2257420c43e8 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:09.085083 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1178/2380] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:30:08 2022] DELETE /identity/v3/users/eee15bfd12f84c6db46ce2616d010e36 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:30:09.090274 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2481c4d-ac2b-4f7f-868b-1c4d066b8f3d None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:09.090828 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2481c4d-ac2b-4f7f-868b-1c4d066b8f3d None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:09.091275 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2481c4d-ac2b-4f7f-868b-1c4d066b8f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:09.126810 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-a2481c4d-ac2b-4f7f-868b-1c4d066b8f3d None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:30:09.128288 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-a2481c4d-ac2b-4f7f-868b-1c4d066b8f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:09.151156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:30:09.233364 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1179/2381] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:30:09.251996 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2481c4d-ac2b-4f7f-868b-1c4d066b8f3d None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:09.254320 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-a2481c4d-ac2b-4f7f-868b-1c4d066b8f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:09.300814 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9115d64f-1676-46d3-83e6-2257420c43e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f2e383c506d41f3ba12112f363cf3a1'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:09.380875 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9115d64f-1676-46d3-83e6-2257420c43e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f2e383c506d41f3ba12112f363cf3a1'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:09.382068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9115d64f-1676-46d3-83e6-2257420c43e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f2e383c506d41f3ba12112f363cf3a1'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:09.383272 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9115d64f-1676-46d3-83e6-2257420c43e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f2e383c506d41f3ba12112f363cf3a1'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:09.400507 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9115d64f-1676-46d3-83e6-2257420c43e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f2e383c506d41f3ba12112f363cf3a1'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:09.424603 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2481c4d-ac2b-4f7f-868b-1c4d066b8f3d None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:09.436022 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640e4e8-0bfa-4872-a202-7ec18ca9a92a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:09.438335 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640e4e8-0bfa-4872-a202-7ec18ca9a92a service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:09.438628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640e4e8-0bfa-4872-a202-7ec18ca9a92a service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:09.440732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640e4e8-0bfa-4872-a202-7ec18ca9a92a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:09.475246 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1203/2382] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:30:08 2022] DELETE /identity/v3/users/6f2e383c506d41f3ba12112f363cf3a1 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:30:09.477219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-8640e4e8-0bfa-4872-a202-7ec18ca9a92a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:09.512511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640e4e8-0bfa-4872-a202-7ec18ca9a92a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:09.515145 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640e4e8-0bfa-4872-a202-7ec18ca9a92a service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:09.539959 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1180/2383] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:30:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:30:10.205541 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115d64f-1676-46d3-83e6-2257420c43e8 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:10.208473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-9115d64f-1676-46d3-83e6-2257420c43e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:10.452616 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115d64f-1676-46d3-83e6-2257420c43e8 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:10.486124 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce55db0-7979-498e-b2cf-20ab970e7a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:10.487501 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce55db0-7979-498e-b2cf-20ab970e7a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:10.487749 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce55db0-7979-498e-b2cf-20ab970e7a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:10.488078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce55db0-7979-498e-b2cf-20ab970e7a62 admin admin] PATH_INFO: `/v3/projects/497c9229a2ac4fe79d35c941368040f2` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:10.489653 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce55db0-7979-498e-b2cf-20ab970e7a62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=497c9229a2ac4fe79d35c941368040f2)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:10.501505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce55db0-7979-498e-b2cf-20ab970e7a62 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:10.544974 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640e4e8-0bfa-4872-a202-7ec18ca9a92a service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:10.550645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-8640e4e8-0bfa-4872-a202-7ec18ca9a92a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:10.566481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640e4e8-0bfa-4872-a202-7ec18ca9a92a service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:10.589752 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:30:10.598001 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c8c75-8d36-4413-8b40-51fd5b3b0523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:10.598846 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c8c75-8d36-4413-8b40-51fd5b3b0523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:10.600298 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c8c75-8d36-4413-8b40-51fd5b3b0523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:10.601615 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c8c75-8d36-4413-8b40-51fd5b3b0523 admin admin] PATH_INFO: `/v3/projects/dfa84326e40c460d8f57f8b4bc83c050` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:10.605887 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c8c75-8d36-4413-8b40-51fd5b3b0523 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfa84326e40c460d8f57f8b4bc83c050)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:10.616431 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c8c75-8d36-4413-8b40-51fd5b3b0523 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:10.991666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-6ce55db0-7979-498e-b2cf-20ab970e7a62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '497c9229a2ac4fe79d35c941368040f2', 'request_id': 'req-6ce55db0-7979-498e-b2cf-20ab970e7a62'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:11.014985 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-6ce55db0-7979-498e-b2cf-20ab970e7a62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '497c9229a2ac4fe79d35c941368040f2', 'request_id': 'req-6ce55db0-7979-498e-b2cf-20ab970e7a62'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:11.044147 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-106c8c75-8d36-4413-8b40-51fd5b3b0523 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfa84326e40c460d8f57f8b4bc83c050', 'request_id': 'req-106c8c75-8d36-4413-8b40-51fd5b3b0523'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:11.070228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-106c8c75-8d36-4413-8b40-51fd5b3b0523 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfa84326e40c460d8f57f8b4bc83c050', 'request_id': 'req-106c8c75-8d36-4413-8b40-51fd5b3b0523'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:11.175246 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-6ce55db0-7979-498e-b2cf-20ab970e7a62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '497c9229a2ac4fe79d35c941368040f2', 'request_id': 'req-6ce55db0-7979-498e-b2cf-20ab970e7a62'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:11.190608 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-6ce55db0-7979-498e-b2cf-20ab970e7a62 admin admin] The token cache is being invalidate because project 497c9229a2ac4fe79d35c941368040f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:30:11.190930 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-6ce55db0-7979-498e-b2cf-20ab970e7a62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:11.191663 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-6ce55db0-7979-498e-b2cf-20ab970e7a62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:11.202971 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1204/2384] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:30:10 2022] DELETE /identity/v3/projects/497c9229a2ac4fe79d35c941368040f2 => generated 0 bytes in 995 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:30:11.206206 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a32be-bcda-45b6-9936-7ec1c85e810f None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:11.206487 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a32be-bcda-45b6-9936-7ec1c85e810f None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:11.206757 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a32be-bcda-45b6-9936-7ec1c85e810f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:11.257503 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-868a32be-bcda-45b6-9936-7ec1c85e810f None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:30:11.261072 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-868a32be-bcda-45b6-9936-7ec1c85e810f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:11.294976 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-106c8c75-8d36-4413-8b40-51fd5b3b0523 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfa84326e40c460d8f57f8b4bc83c050', 'request_id': 'req-106c8c75-8d36-4413-8b40-51fd5b3b0523'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:11.324632 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-106c8c75-8d36-4413-8b40-51fd5b3b0523 admin admin] The token cache is being invalidate because project dfa84326e40c460d8f57f8b4bc83c050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:30:11.329006 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-106c8c75-8d36-4413-8b40-51fd5b3b0523 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:11.329006 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-106c8c75-8d36-4413-8b40-51fd5b3b0523 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:11.334551 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1181/2385] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:30:10 2022] DELETE /identity/v3/projects/dfa84326e40c460d8f57f8b4bc83c050 => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:30:11.576802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1205/2386] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:30:11.601164 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6312ae1-da77-483f-b926-0563b503cd99 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:11.601714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6312ae1-da77-483f-b926-0563b503cd99 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:11.601810 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6312ae1-da77-483f-b926-0563b503cd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:11.781433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-a6312ae1-da77-483f-b926-0563b503cd99 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:30:11.786332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-a6312ae1-da77-483f-b926-0563b503cd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:11.849274 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1182/2387] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:30:11.850165 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a32be-bcda-45b6-9936-7ec1c85e810f None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:11.864638 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a32be-bcda-45b6-9936-7ec1c85e810f None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:11.888400 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f36974-bcfa-4bf6-97b4-9d0cdb41d768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:11.889242 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f36974-bcfa-4bf6-97b4-9d0cdb41d768 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:11.889637 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f36974-bcfa-4bf6-97b4-9d0cdb41d768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:11.889978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f36974-bcfa-4bf6-97b4-9d0cdb41d768 admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:11.890909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f36974-bcfa-4bf6-97b4-9d0cdb41d768 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:30:11.891341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f36974-bcfa-4bf6-97b4-9d0cdb41d768 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:11.894687 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f36974-bcfa-4bf6-97b4-9d0cdb41d768 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:11.934134 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1206/2388] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:30:11.941982 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6312ae1-da77-483f-b926-0563b503cd99 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:11.967978 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6312ae1-da77-483f-b926-0563b503cd99 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:11.988675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ebc00-69d2-4547-a96e-1bd675350a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:11.989550 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ebc00-69d2-4547-a96e-1bd675350a16 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:11.989550 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ebc00-69d2-4547-a96e-1bd675350a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:11.989853 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ebc00-69d2-4547-a96e-1bd675350a16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:11.990458 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ebc00-69d2-4547-a96e-1bd675350a16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:11.992421 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ebc00-69d2-4547-a96e-1bd675350a16 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:12.219267 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1183/2389] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:30:11 2022] POST /identity/v3/projects => generated 373 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:30:12.226203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f36974-bcfa-4bf6-97b4-9d0cdb41d768 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:12.247188 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f36974-bcfa-4bf6-97b4-9d0cdb41d768 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:12.489106 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817adce-b208-4b30-8b2b-357f628aa03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:12.489767 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817adce-b208-4b30-8b2b-357f628aa03b admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:12.490034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817adce-b208-4b30-8b2b-357f628aa03b admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:12.490034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817adce-b208-4b30-8b2b-357f628aa03b admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:12.490918 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a817adce-b208-4b30-8b2b-357f628aa03b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:12.496363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a817adce-b208-4b30-8b2b-357f628aa03b admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:12.977547 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1207/2390] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:30:12 2022] POST /identity/v3/users => generated 287 bytes in 754 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:30:12.982190 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ebc00-69d2-4547-a96e-1bd675350a16 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:12.999569 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ebc00-69d2-4547-a96e-1bd675350a16 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:13.009992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcc715-2898-46ba-9d29-e4fa804092d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:13.011798 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcc715-2898-46ba-9d29-e4fa804092d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:13.019270 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcc715-2898-46ba-9d29-e4fa804092d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:13.019270 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcc715-2898-46ba-9d29-e4fa804092d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:13.019270 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfcc715-2898-46ba-9d29-e4fa804092d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:13.019270 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfcc715-2898-46ba-9d29-e4fa804092d7 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:13.032892 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1184/2391] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:30:13.037768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817adce-b208-4b30-8b2b-357f628aa03b admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:13.057148 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817adce-b208-4b30-8b2b-357f628aa03b admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:13.066937 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f3325-f1f5-4cc1-8821-f0bd63109844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:13.067625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f3325-f1f5-4cc1-8821-f0bd63109844 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:13.067896 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f3325-f1f5-4cc1-8821-f0bd63109844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:13.068176 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f3325-f1f5-4cc1-8821-f0bd63109844 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:13.069098 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f3325-f1f5-4cc1-8821-f0bd63109844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:13.070606 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f3325-f1f5-4cc1-8821-f0bd63109844 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:13.110656 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1208/2392] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:30:13.114961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcc715-2898-46ba-9d29-e4fa804092d7 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:13.133645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcc715-2898-46ba-9d29-e4fa804092d7 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:13.149154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f7d49-fe7c-43c6-b01d-aa2c376c96e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:13.151704 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f7d49-fe7c-43c6-b01d-aa2c376c96e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:13.153426 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f7d49-fe7c-43c6-b01d-aa2c376c96e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:13.154030 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f7d49-fe7c-43c6-b01d-aa2c376c96e2 admin admin] PATH_INFO: `/v3/projects/4bf94083e5644e07afe5876752068c66/users/459e4df46abc45a4ab9f0422541b8ba0/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:13.165048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:30:13.198183 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f7d49-fe7c-43c6-b01d-aa2c376c96e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf94083e5644e07afe5876752068c66, user_id=459e4df46abc45a4ab9f0422541b8ba0, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:13.206584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f7d49-fe7c-43c6-b01d-aa2c376c96e2 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:13.329160 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1185/2393] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:30:13 2022] PUT /identity/v3/projects/4bf94083e5644e07afe5876752068c66/users/459e4df46abc45a4ab9f0422541b8ba0/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:30:13.345999 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd417dfa-3c51-4f9f-81f8-8e1c900e6075 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:13.348453 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd417dfa-3c51-4f9f-81f8-8e1c900e6075 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:13.348453 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd417dfa-3c51-4f9f-81f8-8e1c900e6075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:13.392326 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:30:13.413521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-dd417dfa-3c51-4f9f-81f8-8e1c900e6075 None None] MFA Rules not processed for user `459e4df46abc45a4ab9f0422541b8ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:30:13.415385 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-dd417dfa-3c51-4f9f-81f8-8e1c900e6075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:13.593657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1209/2394] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:30:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:30:13.614643 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f7d49-fe7c-43c6-b01d-aa2c376c96e2 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:13.619731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-ef3f7d49-fe7c-43c6-b01d-aa2c376c96e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:13.829144 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f7d49-fe7c-43c6-b01d-aa2c376c96e2 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:13.852603 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b9577-6d54-4a76-93af-dad4c854dd43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:13.853875 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b9577-6d54-4a76-93af-dad4c854dd43 service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:13.854462 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b9577-6d54-4a76-93af-dad4c854dd43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:13.854968 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b9577-6d54-4a76-93af-dad4c854dd43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:13.887046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b9577-6d54-4a76-93af-dad4c854dd43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:13.889078 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b9577-6d54-4a76-93af-dad4c854dd43 service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:13.942723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1186/2395] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:30:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:30:13.968767 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd417dfa-3c51-4f9f-81f8-8e1c900e6075 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:14.086363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd417dfa-3c51-4f9f-81f8-8e1c900e6075 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:14.099071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67700ba8-30f9-4c20-9e5e-41109fe279d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:14.100078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67700ba8-30f9-4c20-9e5e-41109fe279d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:14.100459 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67700ba8-30f9-4c20-9e5e-41109fe279d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:14.100852 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67700ba8-30f9-4c20-9e5e-41109fe279d8 admin admin] PATH_INFO: `/v3/users/459e4df46abc45a4ab9f0422541b8ba0` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:14.103378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67700ba8-30f9-4c20-9e5e-41109fe279d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=459e4df46abc45a4ab9f0422541b8ba0)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:14.106294 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67700ba8-30f9-4c20-9e5e-41109fe279d8 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:14.398329 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdb7fd-4097-4eaf-a87f-c530b689d720 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:14.399365 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdb7fd-4097-4eaf-a87f-c530b689d720 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:14.401406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdb7fd-4097-4eaf-a87f-c530b689d720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:14.439717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-67700ba8-30f9-4c20-9e5e-41109fe279d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '459e4df46abc45a4ab9f0422541b8ba0'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:14.496394 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-d1bdb7fd-4097-4eaf-a87f-c530b689d720 None None] MFA Rules not processed for user `87d974bb5cf94567b1493fa54e804374`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:30:14.497963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-d1bdb7fd-4097-4eaf-a87f-c530b689d720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:14.586459 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-67700ba8-30f9-4c20-9e5e-41109fe279d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '459e4df46abc45a4ab9f0422541b8ba0'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:14.587151 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-67700ba8-30f9-4c20-9e5e-41109fe279d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '459e4df46abc45a4ab9f0422541b8ba0'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:14.587834 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-67700ba8-30f9-4c20-9e5e-41109fe279d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '459e4df46abc45a4ab9f0422541b8ba0'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:14.604055 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-67700ba8-30f9-4c20-9e5e-41109fe279d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '459e4df46abc45a4ab9f0422541b8ba0'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:14.604352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1187/2396] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:30:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:30:14.654882 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1210/2397] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:30:13 2022] DELETE /identity/v3/users/459e4df46abc45a4ab9f0422541b8ba0 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:30:14.662539 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb7b99-5d33-4745-98fe-a93114eaff43 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:14.663085 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb7b99-5d33-4745-98fe-a93114eaff43 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:14.663601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb7b99-5d33-4745-98fe-a93114eaff43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:14.690197 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-18eb7b99-5d33-4745-98fe-a93114eaff43 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:30:14.691827 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-18eb7b99-5d33-4745-98fe-a93114eaff43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:14.899390 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1188/2398] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:30:14.911989 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67700ba8-30f9-4c20-9e5e-41109fe279d8 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:14.913634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-67700ba8-30f9-4c20-9e5e-41109fe279d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:14.969782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:30:15.105055 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67700ba8-30f9-4c20-9e5e-41109fe279d8 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:15.114501 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d35159-25aa-43e3-94aa-be0c075ac1e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:15.115150 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d35159-25aa-43e3-94aa-be0c075ac1e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:15.115432 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d35159-25aa-43e3-94aa-be0c075ac1e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:15.118282 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d35159-25aa-43e3-94aa-be0c075ac1e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:15.130243 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d35159-25aa-43e3-94aa-be0c075ac1e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:15.133034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d35159-25aa-43e3-94aa-be0c075ac1e3 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:15.165801 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1211/2399] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:30:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:30:16.118937 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb7b99-5d33-4745-98fe-a93114eaff43 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:16.122358 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-18eb7b99-5d33-4745-98fe-a93114eaff43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:16.183751 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb7b99-5d33-4745-98fe-a93114eaff43 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:16.207424 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e84b2-5784-46be-95de-745ff87cf97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:16.208182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e84b2-5784-46be-95de-745ff87cf97f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:16.208533 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e84b2-5784-46be-95de-745ff87cf97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:16.208851 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e84b2-5784-46be-95de-745ff87cf97f admin admin] PATH_INFO: `/v3/projects/4bf94083e5644e07afe5876752068c66` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:16.210114 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e84b2-5784-46be-95de-745ff87cf97f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bf94083e5644e07afe5876752068c66)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:16.212643 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e84b2-5784-46be-95de-745ff87cf97f admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:16.385568 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:30:16.424317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-a98e84b2-5784-46be-95de-745ff87cf97f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bf94083e5644e07afe5876752068c66', 'request_id': 'req-a98e84b2-5784-46be-95de-745ff87cf97f'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:16.431732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-a98e84b2-5784-46be-95de-745ff87cf97f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bf94083e5644e07afe5876752068c66', 'request_id': 'req-a98e84b2-5784-46be-95de-745ff87cf97f'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:16.505631 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-a98e84b2-5784-46be-95de-745ff87cf97f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bf94083e5644e07afe5876752068c66', 'request_id': 'req-a98e84b2-5784-46be-95de-745ff87cf97f'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:16.523698 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-a98e84b2-5784-46be-95de-745ff87cf97f admin admin] The token cache is being invalidate because project 4bf94083e5644e07afe5876752068c66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:30:16.524132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-a98e84b2-5784-46be-95de-745ff87cf97f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:16.527616 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-a98e84b2-5784-46be-95de-745ff87cf97f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:16.536870 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1189/2400] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:30:16 2022] DELETE /identity/v3/projects/4bf94083e5644e07afe5876752068c66 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:30:16.541420 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19109116-e6b7-466a-8ea7-9938960bbc71 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:16.541907 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19109116-e6b7-466a-8ea7-9938960bbc71 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:16.542011 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19109116-e6b7-466a-8ea7-9938960bbc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:16.632078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-19109116-e6b7-466a-8ea7-9938960bbc71 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:30:16.648012 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-19109116-e6b7-466a-8ea7-9938960bbc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:16.711084 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82441844-2d9d-4584-a583-479bc37454af None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:16.711650 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82441844-2d9d-4584-a583-479bc37454af None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:16.712085 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82441844-2d9d-4584-a583-479bc37454af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:16.737321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-82441844-2d9d-4584-a583-479bc37454af None None] MFA Rules not processed for user `c314372147b2491cb4481d538056472c`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:30:16.739013 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-82441844-2d9d-4584-a583-479bc37454af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:16.745519 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1212/2401] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:30:16.755464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298c5dd-f74a-4fa1-b9fc-aaa6ff737461 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:16.755464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298c5dd-f74a-4fa1-b9fc-aaa6ff737461 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:16.755464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298c5dd-f74a-4fa1-b9fc-aaa6ff737461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:16.776038 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-7298c5dd-f74a-4fa1-b9fc-aaa6ff737461 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:30:16.777265 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-7298c5dd-f74a-4fa1-b9fc-aaa6ff737461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:16.791009 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1213/2402] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:30:16.806425 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298c5dd-f74a-4fa1-b9fc-aaa6ff737461 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:16.831461 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298c5dd-f74a-4fa1-b9fc-aaa6ff737461 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:16.833511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1190/2403] 10.222.0.77 () {58 vars in 967 bytes} [Tue Sep 6 20:30:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:30:16.840732 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d67fb8-2a86-4960-8be5-ffdf277747e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:16.841852 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d67fb8-2a86-4960-8be5-ffdf277747e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:16.842135 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d67fb8-2a86-4960-8be5-ffdf277747e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:16.842410 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d67fb8-2a86-4960-8be5-ffdf277747e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:16.843242 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d67fb8-2a86-4960-8be5-ffdf277747e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:30:16.843609 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d67fb8-2a86-4960-8be5-ffdf277747e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:16.846172 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d67fb8-2a86-4960-8be5-ffdf277747e1 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:16.853244 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82441844-2d9d-4584-a583-479bc37454af None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:16.854754 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-82441844-2d9d-4584-a583-479bc37454af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:16.869984 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1214/2404] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:30:16.870770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d67fb8-2a86-4960-8be5-ffdf277747e1 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:16.885260 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d67fb8-2a86-4960-8be5-ffdf277747e1 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:16.890553 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666d1e3-4472-4253-969d-6bc4e466652f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:16.891171 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666d1e3-4472-4253-969d-6bc4e466652f admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:16.891468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666d1e3-4472-4253-969d-6bc4e466652f admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:16.891813 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666d1e3-4472-4253-969d-6bc4e466652f admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:16.892493 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666d1e3-4472-4253-969d-6bc4e466652f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:16.894839 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666d1e3-4472-4253-969d-6bc4e466652f admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:16.965437 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82441844-2d9d-4584-a583-479bc37454af None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:16.974551 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d30b7-1381-4a21-a3e4-0dc1b1b14e31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6c4f91a59548fd979e7232a2afd6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:16.975524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d30b7-1381-4a21-a3e4-0dc1b1b14e31 service swift] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:16.975927 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d30b7-1381-4a21-a3e4-0dc1b1b14e31 service swift] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:16.976378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d30b7-1381-4a21-a3e4-0dc1b1b14e31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:16.994066 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1215/2405] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:30:16 2022] POST /identity/v3/projects => generated 399 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:30:16.997392 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d30b7-1381-4a21-a3e4-0dc1b1b14e31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:17.002232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666d1e3-4472-4253-969d-6bc4e466652f admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:17.002434 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d30b7-1381-4a21-a3e4-0dc1b1b14e31 service swift] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:17.010430 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1191/2406] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Sep 6 20:30:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 20:30:17.104020 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666d1e3-4472-4253-969d-6bc4e466652f admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:17.112098 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b563f-9a0f-42d1-8e33-34bcfcbefbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:17.112907 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b563f-9a0f-42d1-8e33-34bcfcbefbba admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:17.113190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b563f-9a0f-42d1-8e33-34bcfcbefbba admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:17.113471 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b563f-9a0f-42d1-8e33-34bcfcbefbba admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:17.114102 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b563f-9a0f-42d1-8e33-34bcfcbefbba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:17.116357 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b563f-9a0f-42d1-8e33-34bcfcbefbba admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:17.279522 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1216/2407] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:30:16 2022] POST /identity/v3/users => generated 300 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:30:17.281602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d30b7-1381-4a21-a3e4-0dc1b1b14e31 service swift] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:17.293376 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d30b7-1381-4a21-a3e4-0dc1b1b14e31 service swift] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:17.298746 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabca47-0242-4cba-87cd-973a41397861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:17.300034 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabca47-0242-4cba-87cd-973a41397861 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:17.300350 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabca47-0242-4cba-87cd-973a41397861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:17.300650 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabca47-0242-4cba-87cd-973a41397861 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:17.301306 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acabca47-0242-4cba-87cd-973a41397861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:17.302934 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acabca47-0242-4cba-87cd-973a41397861 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:17.314364 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1192/2408] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:30:17.325932 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b563f-9a0f-42d1-8e33-34bcfcbefbba admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:17.347269 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b563f-9a0f-42d1-8e33-34bcfcbefbba admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:17.352302 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c8756-02ab-4245-942c-e444ba2b2f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:17.352930 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c8756-02ab-4245-942c-e444ba2b2f34 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:17.353205 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c8756-02ab-4245-942c-e444ba2b2f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:17.353473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c8756-02ab-4245-942c-e444ba2b2f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:17.354282 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c8756-02ab-4245-942c-e444ba2b2f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:17.355826 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c8756-02ab-4245-942c-e444ba2b2f34 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:17.359243 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:30:17.378932 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1217/2409] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:30:17.380354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabca47-0242-4cba-87cd-973a41397861 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:17.391816 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabca47-0242-4cba-87cd-973a41397861 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:17.397140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0dff2-e01c-41ef-93bf-fe497002f29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:17.397999 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0dff2-e01c-41ef-93bf-fe497002f29a admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:17.398457 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0dff2-e01c-41ef-93bf-fe497002f29a admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:17.398690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0dff2-e01c-41ef-93bf-fe497002f29a admin admin] PATH_INFO: `/v3/projects/368ff579b74b4bf2bcce33af3adf3333/users/ac43ce22dc294ef9a3f86ad373a83eff/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:17.421540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0dff2-e01c-41ef-93bf-fe497002f29a admin admin] RBAC: Authorizing `identity:create_grant(project_id=368ff579b74b4bf2bcce33af3adf3333, user_id=ac43ce22dc294ef9a3f86ad373a83eff, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:17.425040 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0dff2-e01c-41ef-93bf-fe497002f29a admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:17.620045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1193/2410] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:30:17 2022] PUT /identity/v3/projects/368ff579b74b4bf2bcce33af3adf3333/users/ac43ce22dc294ef9a3f86ad373a83eff/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:30:17.635039 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7c466-b820-4f0b-85f4-867284c40e58 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:17.635039 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7c466-b820-4f0b-85f4-867284c40e58 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:17.635039 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7c466-b820-4f0b-85f4-867284c40e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:17.663995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-d2c7c466-b820-4f0b-85f4-867284c40e58 None None] MFA Rules not processed for user `ac43ce22dc294ef9a3f86ad373a83eff`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:30:17.665349 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-d2c7c466-b820-4f0b-85f4-867284c40e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:17.738066 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1218/2411] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:30:17 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:30:17.750411 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0dff2-e01c-41ef-93bf-fe497002f29a admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:17.752458 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-27d0dff2-e01c-41ef-93bf-fe497002f29a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:17.778171 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:30:17.829237 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0dff2-e01c-41ef-93bf-fe497002f29a admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:17.833710 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffbee2-a690-48c8-b99c-3e351c2b17c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:17.837582 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffbee2-a690-48c8-b99c-3e351c2b17c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:17.837582 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffbee2-a690-48c8-b99c-3e351c2b17c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:17.837582 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffbee2-a690-48c8-b99c-3e351c2b17c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:17.848142 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ffbee2-a690-48c8-b99c-3e351c2b17c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:17.849691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ffbee2-a690-48c8-b99c-3e351c2b17c6 service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:17.859535 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1194/2412] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:30:17 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:30:21.100459 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c5e51-354d-4738-9f90-72458943b946 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:21.101072 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c5e51-354d-4738-9f90-72458943b946 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:21.101072 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c5e51-354d-4738-9f90-72458943b946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:21.126125 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-698c5e51-354d-4738-9f90-72458943b946 None None] MFA Rules not processed for user `c314372147b2491cb4481d538056472c`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:30:21.128330 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-698c5e51-354d-4738-9f90-72458943b946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:21.218528 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1219/2413] 10.222.0.77 () {58 vars in 967 bytes} [Tue Sep 6 20:30:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:30:21.240926 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffbee2-a690-48c8-b99c-3e351c2b17c6 service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:21.348445 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffbee2-a690-48c8-b99c-3e351c2b17c6 service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:21.353535 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1ecc2-b355-4c86-909a-f8f3e74058f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6c4f91a59548fd979e7232a2afd6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:21.365157 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1ecc2-b355-4c86-909a-f8f3e74058f1 service swift] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:21.365157 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1ecc2-b355-4c86-909a-f8f3e74058f1 service swift] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:21.365157 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1ecc2-b355-4c86-909a-f8f3e74058f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:21.366742 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1ecc2-b355-4c86-909a-f8f3e74058f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:21.369183 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1ecc2-b355-4c86-909a-f8f3e74058f1 service swift] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:21.379304 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1195/2414] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Sep 6 20:30:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 20:30:23.430435 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253ea92-053c-46f7-a5dd-984369fbda0b None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:23.430944 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253ea92-053c-46f7-a5dd-984369fbda0b None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:23.430944 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253ea92-053c-46f7-a5dd-984369fbda0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:23.450819 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-0253ea92-053c-46f7-a5dd-984369fbda0b None None] MFA Rules not processed for user `3a9c5777bcc149ea9a30f3fd1fca12ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:30:23.452148 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-0253ea92-053c-46f7-a5dd-984369fbda0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:23.516013 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1220/2415] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:30:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:30:26.055278 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1ecc2-b355-4c86-909a-f8f3e74058f1 service swift] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:26.058681 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-33f1ecc2-b355-4c86-909a-f8f3e74058f1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:26.157788 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1ecc2-b355-4c86-909a-f8f3e74058f1 service swift] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:26.169209 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf61de-3546-4e80-992d-7f1a039bd8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:26.169209 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf61de-3546-4e80-992d-7f1a039bd8c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:26.169209 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf61de-3546-4e80-992d-7f1a039bd8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:26.169209 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf61de-3546-4e80-992d-7f1a039bd8c7 admin admin] PATH_INFO: `/v3/users/c1d558f1f2f443e18d95a7cff604c691` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:26.169595 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf61de-3546-4e80-992d-7f1a039bd8c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1d558f1f2f443e18d95a7cff604c691)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:26.169931 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf61de-3546-4e80-992d-7f1a039bd8c7 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:26.260307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253ea92-053c-46f7-a5dd-984369fbda0b None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:26.276408 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253ea92-053c-46f7-a5dd-984369fbda0b None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:26.286127 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda0c9e-52cd-4a94-a94a-9763ef7a152d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:26.286961 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda0c9e-52cd-4a94-a94a-9763ef7a152d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:26.291593 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda0c9e-52cd-4a94-a94a-9763ef7a152d admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:26.292337 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda0c9e-52cd-4a94-a94a-9763ef7a152d admin admin] PATH_INFO: `/v3/users/ac43ce22dc294ef9a3f86ad373a83eff` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:26.294272 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda0c9e-52cd-4a94-a94a-9763ef7a152d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac43ce22dc294ef9a3f86ad373a83eff)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:26.296522 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda0c9e-52cd-4a94-a94a-9763ef7a152d admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:26.386695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c3cf61de-3546-4e80-992d-7f1a039bd8c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1d558f1f2f443e18d95a7cff604c691'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:26.394097 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:30:26.471890 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c3cf61de-3546-4e80-992d-7f1a039bd8c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1d558f1f2f443e18d95a7cff604c691'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:26.472577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c3cf61de-3546-4e80-992d-7f1a039bd8c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1d558f1f2f443e18d95a7cff604c691'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:26.473769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c3cf61de-3546-4e80-992d-7f1a039bd8c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1d558f1f2f443e18d95a7cff604c691'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:26.491562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-c3cf61de-3546-4e80-992d-7f1a039bd8c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1d558f1f2f443e18d95a7cff604c691'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:26.518964 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1196/2416] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:30:26 2022] DELETE /identity/v3/users/c1d558f1f2f443e18d95a7cff604c691 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:30:26.571225 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:30:26.586282 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-dbda0c9e-52cd-4a94-a94a-9763ef7a152d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac43ce22dc294ef9a3f86ad373a83eff'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:26.659603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-dbda0c9e-52cd-4a94-a94a-9763ef7a152d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac43ce22dc294ef9a3f86ad373a83eff'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:26.660337 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-dbda0c9e-52cd-4a94-a94a-9763ef7a152d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac43ce22dc294ef9a3f86ad373a83eff'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:26.660946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-dbda0c9e-52cd-4a94-a94a-9763ef7a152d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac43ce22dc294ef9a3f86ad373a83eff'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:26.671485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-dbda0c9e-52cd-4a94-a94a-9763ef7a152d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac43ce22dc294ef9a3f86ad373a83eff'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:26.725590 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e33aa-71d2-42e5-9fbd-42d316db82f8 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:26.725868 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1221/2417] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:30:26 2022] DELETE /identity/v3/users/ac43ce22dc294ef9a3f86ad373a83eff => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:30:26.726118 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e33aa-71d2-42e5-9fbd-42d316db82f8 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:26.726553 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e33aa-71d2-42e5-9fbd-42d316db82f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:26.753113 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-377e33aa-71d2-42e5-9fbd-42d316db82f8 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:30:26.754529 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-377e33aa-71d2-42e5-9fbd-42d316db82f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:26.839373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1197/2418] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:30:26.850294 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda0c9e-52cd-4a94-a94a-9763ef7a152d admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:26.852387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-dbda0c9e-52cd-4a94-a94a-9763ef7a152d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:26.895489 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e33aa-71d2-42e5-9fbd-42d316db82f8 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:26.895489 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-377e33aa-71d2-42e5-9fbd-42d316db82f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:26.909927 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e33aa-71d2-42e5-9fbd-42d316db82f8 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:26.932961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf1ce1-1a31-48a6-8cd7-578a817ff5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:26.935033 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf1ce1-1a31-48a6-8cd7-578a817ff5bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:26.935321 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf1ce1-1a31-48a6-8cd7-578a817ff5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:26.935682 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf1ce1-1a31-48a6-8cd7-578a817ff5bb admin admin] PATH_INFO: `/v3/projects/87f4679c1f4b49d58df47e20201e465a` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:26.938034 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf1ce1-1a31-48a6-8cd7-578a817ff5bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=87f4679c1f4b49d58df47e20201e465a)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:26.940152 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda0c9e-52cd-4a94-a94a-9763ef7a152d admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:26.945583 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf1ce1-1a31-48a6-8cd7-578a817ff5bb admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:26.946417 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95951d-4ff4-408c-a5bd-6e1cb1a7c14e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:26.947109 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95951d-4ff4-408c-a5bd-6e1cb1a7c14e service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:26.947492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95951d-4ff4-408c-a5bd-6e1cb1a7c14e service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:26.947798 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95951d-4ff4-408c-a5bd-6e1cb1a7c14e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:26.961265 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95951d-4ff4-408c-a5bd-6e1cb1a7c14e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:26.963111 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95951d-4ff4-408c-a5bd-6e1cb1a7c14e service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:26.975347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1222/2419] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:30:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:30:27.078662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9fdf1ce1-1a31-48a6-8cd7-578a817ff5bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87f4679c1f4b49d58df47e20201e465a', 'request_id': 'req-9fdf1ce1-1a31-48a6-8cd7-578a817ff5bb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:27.086457 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9fdf1ce1-1a31-48a6-8cd7-578a817ff5bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87f4679c1f4b49d58df47e20201e465a', 'request_id': 'req-9fdf1ce1-1a31-48a6-8cd7-578a817ff5bb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:27.180233 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9fdf1ce1-1a31-48a6-8cd7-578a817ff5bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87f4679c1f4b49d58df47e20201e465a', 'request_id': 'req-9fdf1ce1-1a31-48a6-8cd7-578a817ff5bb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:27.193046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9fdf1ce1-1a31-48a6-8cd7-578a817ff5bb admin admin] The token cache is being invalidate because project 87f4679c1f4b49d58df47e20201e465a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:30:27.193345 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9fdf1ce1-1a31-48a6-8cd7-578a817ff5bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:27.194021 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9fdf1ce1-1a31-48a6-8cd7-578a817ff5bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:27.196121 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1198/2420] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:30:26 2022] DELETE /identity/v3/projects/87f4679c1f4b49d58df47e20201e465a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:30:27.202761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c0b2f-04ec-42c7-b3b0-504014dff162 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:27.203169 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c0b2f-04ec-42c7-b3b0-504014dff162 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:27.203864 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c0b2f-04ec-42c7-b3b0-504014dff162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:27.226760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-ab8c0b2f-04ec-42c7-b3b0-504014dff162 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:30:27.230249 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ab8c0b2f-04ec-42c7-b3b0-504014dff162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:27.301624 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1223/2421] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:30:27.309882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e05f9-31c0-4f4f-87a9-cddb1df36a63 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:27.309882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e05f9-31c0-4f4f-87a9-cddb1df36a63 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:27.310083 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e05f9-31c0-4f4f-87a9-cddb1df36a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:27.341885 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-b94e05f9-31c0-4f4f-87a9-cddb1df36a63 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:30:27.343173 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-b94e05f9-31c0-4f4f-87a9-cddb1df36a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:27.352404 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1199/2422] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:30:27.357142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c0b2f-04ec-42c7-b3b0-504014dff162 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:27.368992 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c0b2f-04ec-42c7-b3b0-504014dff162 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:27.374932 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5bdd9-f4d6-4220-8df1-60a51416211f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:27.375827 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5bdd9-f4d6-4220-8df1-60a51416211f admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:27.376108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5bdd9-f4d6-4220-8df1-60a51416211f admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:27.376380 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5bdd9-f4d6-4220-8df1-60a51416211f admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:27.377028 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5bdd9-f4d6-4220-8df1-60a51416211f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:30:27.377333 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5bdd9-f4d6-4220-8df1-60a51416211f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:27.379706 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5bdd9-f4d6-4220-8df1-60a51416211f admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:27.403605 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1224/2423] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:30:27.405911 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e05f9-31c0-4f4f-87a9-cddb1df36a63 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:27.418786 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e05f9-31c0-4f4f-87a9-cddb1df36a63 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:27.426307 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a9abb-aafc-494f-98f6-ffc29bd4d988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:27.427894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a9abb-aafc-494f-98f6-ffc29bd4d988 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:27.427894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a9abb-aafc-494f-98f6-ffc29bd4d988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:27.428261 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a9abb-aafc-494f-98f6-ffc29bd4d988 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:27.428984 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a9abb-aafc-494f-98f6-ffc29bd4d988 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:27.432100 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a9abb-aafc-494f-98f6-ffc29bd4d988 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:27.440444 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5bdd9-f4d6-4220-8df1-60a51416211f admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:27.442472 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-7df5bdd9-f4d6-4220-8df1-60a51416211f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:27.477662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5bdd9-f4d6-4220-8df1-60a51416211f admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:27.485907 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68c53a-d4ca-497d-8f56-0ce44e5466a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:27.486894 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68c53a-d4ca-497d-8f56-0ce44e5466a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:27.487341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68c53a-d4ca-497d-8f56-0ce44e5466a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:27.491730 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68c53a-d4ca-497d-8f56-0ce44e5466a3 admin admin] PATH_INFO: `/v3/projects/368ff579b74b4bf2bcce33af3adf3333` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:27.491730 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68c53a-d4ca-497d-8f56-0ce44e5466a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=368ff579b74b4bf2bcce33af3adf3333)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:27.491730 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68c53a-d4ca-497d-8f56-0ce44e5466a3 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:27.580251 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1200/2424] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:30:27 2022] POST /identity/v3/projects => generated 369 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:30:27.591935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a9abb-aafc-494f-98f6-ffc29bd4d988 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:27.630609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:30:27.651782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:30:27.669132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9f68c53a-d4ca-497d-8f56-0ce44e5466a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '368ff579b74b4bf2bcce33af3adf3333', 'request_id': 'req-9f68c53a-d4ca-497d-8f56-0ce44e5466a3'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:27.682817 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a9abb-aafc-494f-98f6-ffc29bd4d988 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:27.683031 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9f68c53a-d4ca-497d-8f56-0ce44e5466a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '368ff579b74b4bf2bcce33af3adf3333', 'request_id': 'req-9f68c53a-d4ca-497d-8f56-0ce44e5466a3'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:27.768964 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9f68c53a-d4ca-497d-8f56-0ce44e5466a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '368ff579b74b4bf2bcce33af3adf3333', 'request_id': 'req-9f68c53a-d4ca-497d-8f56-0ce44e5466a3'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:27.786742 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9f68c53a-d4ca-497d-8f56-0ce44e5466a3 admin admin] The token cache is being invalidate because project 368ff579b74b4bf2bcce33af3adf3333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:30:27.787389 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9f68c53a-d4ca-497d-8f56-0ce44e5466a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:27.788329 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9f68c53a-d4ca-497d-8f56-0ce44e5466a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:30:27.788920 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b816cb3-8474-4b39-b8f2-8c78c0f9df79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:27.789627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b816cb3-8474-4b39-b8f2-8c78c0f9df79 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:27.790222 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b816cb3-8474-4b39-b8f2-8c78c0f9df79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:27.790603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1225/2425] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:30:27 2022] DELETE /identity/v3/projects/368ff579b74b4bf2bcce33af3adf3333 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:30:27.795924 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b816cb3-8474-4b39-b8f2-8c78c0f9df79 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:27.795924 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b816cb3-8474-4b39-b8f2-8c78c0f9df79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:27.795924 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b816cb3-8474-4b39-b8f2-8c78c0f9df79 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:27.982521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68c53a-d4ca-497d-8f56-0ce44e5466a3 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:27.984445 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1201/2426] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:30:27 2022] POST /identity/v3/users => generated 285 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:30:27.986310 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-9f68c53a-d4ca-497d-8f56-0ce44e5466a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:28.018614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68c53a-d4ca-497d-8f56-0ce44e5466a3 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:28.024064 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e8f2a-5820-4a2b-98cd-918e2fafff7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:28.024674 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e8f2a-5820-4a2b-98cd-918e2fafff7d admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:28.024947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e8f2a-5820-4a2b-98cd-918e2fafff7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:28.025215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e8f2a-5820-4a2b-98cd-918e2fafff7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:28.025849 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e8f2a-5820-4a2b-98cd-918e2fafff7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:28.027493 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e8f2a-5820-4a2b-98cd-918e2fafff7d admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:28.043853 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1226/2427] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:30:28.048253 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b816cb3-8474-4b39-b8f2-8c78c0f9df79 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:28.058530 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b816cb3-8474-4b39-b8f2-8c78c0f9df79 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:28.063338 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9c505-0ab8-493e-a5b2-3c952968965e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:28.064051 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9c505-0ab8-493e-a5b2-3c952968965e admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:28.064328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9c505-0ab8-493e-a5b2-3c952968965e admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:28.064601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9c505-0ab8-493e-a5b2-3c952968965e admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:28.065296 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9c505-0ab8-493e-a5b2-3c952968965e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:28.067463 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9c505-0ab8-493e-a5b2-3c952968965e admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:28.078256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1202/2428] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:30:28.083521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e8f2a-5820-4a2b-98cd-918e2fafff7d admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:28.096114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e8f2a-5820-4a2b-98cd-918e2fafff7d admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:28.101488 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc99d0c-199a-41d7-92db-4d3bbfcfa4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:28.104489 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc99d0c-199a-41d7-92db-4d3bbfcfa4cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:28.104489 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc99d0c-199a-41d7-92db-4d3bbfcfa4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:28.104489 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc99d0c-199a-41d7-92db-4d3bbfcfa4cf admin admin] PATH_INFO: `/v3/projects/095fbec64f94465683032dbc9a1eba3a/users/12c5c03e8b6943ff9983dd76d9427bde/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:28.119562 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc99d0c-199a-41d7-92db-4d3bbfcfa4cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=095fbec64f94465683032dbc9a1eba3a, user_id=12c5c03e8b6943ff9983dd76d9427bde, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:28.123742 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc99d0c-199a-41d7-92db-4d3bbfcfa4cf admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:28.218966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1227/2429] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:30:28 2022] PUT /identity/v3/projects/095fbec64f94465683032dbc9a1eba3a/users/12c5c03e8b6943ff9983dd76d9427bde/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:30:28.230591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4583c-5142-4089-bd81-9ea25d9227c4 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:28.231391 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4583c-5142-4089-bd81-9ea25d9227c4 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:28.231391 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4583c-5142-4089-bd81-9ea25d9227c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:28.390455 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-2ac4583c-5142-4089-bd81-9ea25d9227c4 None None] MFA Rules not processed for user `12c5c03e8b6943ff9983dd76d9427bde`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:30:28.391661 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-2ac4583c-5142-4089-bd81-9ea25d9227c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:28.476085 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1203/2430] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:30:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:30:28.489286 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc99d0c-199a-41d7-92db-4d3bbfcfa4cf admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:28.491726 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-0fc99d0c-199a-41d7-92db-4d3bbfcfa4cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:28.558514 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc99d0c-199a-41d7-92db-4d3bbfcfa4cf admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:28.563388 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d78d36-d279-47cf-8fe7-e92ca78a3079 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '871f208a13ba435491022b9ea9b735e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:28.564038 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d78d36-d279-47cf-8fe7-e92ca78a3079 service glance] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:28.564309 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d78d36-d279-47cf-8fe7-e92ca78a3079 service glance] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:28.564578 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d78d36-d279-47cf-8fe7-e92ca78a3079 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:28.578209 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d78d36-d279-47cf-8fe7-e92ca78a3079 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:28.579756 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d78d36-d279-47cf-8fe7-e92ca78a3079 service glance] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:28.593419 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1228/2431] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:30:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:30:29.973552 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1ede4-4809-4209-aa76-da1e2c634a51 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:29.974246 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1ede4-4809-4209-aa76-da1e2c634a51 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:29.974246 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1ede4-4809-4209-aa76-da1e2c634a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:29.997675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-7af1ede4-4809-4209-aa76-da1e2c634a51 None None] MFA Rules not processed for user `c314372147b2491cb4481d538056472c`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:30:29.999112 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-7af1ede4-4809-4209-aa76-da1e2c634a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:30.053606 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:30:30.106769 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1204/2432] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Sep 6 20:30:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:30:30.107611 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d78d36-d279-47cf-8fe7-e92ca78a3079 service glance] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:30.109259 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-b7d78d36-d279-47cf-8fe7-e92ca78a3079 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:30:30.267413 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d78d36-d279-47cf-8fe7-e92ca78a3079 service glance] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:30.279014 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69e0df-bf04-4f2b-a842-fdf4dfa37019 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6c4f91a59548fd979e7232a2afd6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:30.281824 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69e0df-bf04-4f2b-a842-fdf4dfa37019 service swift] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:30.281824 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69e0df-bf04-4f2b-a842-fdf4dfa37019 service swift] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:30.281824 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69e0df-bf04-4f2b-a842-fdf4dfa37019 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:30.307378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69e0df-bf04-4f2b-a842-fdf4dfa37019 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:30.310513 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69e0df-bf04-4f2b-a842-fdf4dfa37019 service swift] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:30:30.332890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1229/2433] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Sep 6 20:30:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 20:30:40.146751 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=8 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:30:40.318048 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:DELETE=5,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:30:59.830106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1ede4-4809-4209-aa76-da1e2c634a51 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:30:59.897352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1ede4-4809-4209-aa76-da1e2c634a51 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:30:59.902086 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908379cd-8d59-41bb-aae4-26a0ed28e73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:30:59.902746 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908379cd-8d59-41bb-aae4-26a0ed28e73a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:30:59.903027 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908379cd-8d59-41bb-aae4-26a0ed28e73a admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:30:59.903301 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908379cd-8d59-41bb-aae4-26a0ed28e73a admin admin] PATH_INFO: `/v3/users/12c5c03e8b6943ff9983dd76d9427bde` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:30:59.904593 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908379cd-8d59-41bb-aae4-26a0ed28e73a admin admin] RBAC: Authorizing `identity:delete_user(user_id=12c5c03e8b6943ff9983dd76d9427bde)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:30:59.906442 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908379cd-8d59-41bb-aae4-26a0ed28e73a admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:31:00.120252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-908379cd-8d59-41bb-aae4-26a0ed28e73a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12c5c03e8b6943ff9983dd76d9427bde'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:31:00.202158 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-908379cd-8d59-41bb-aae4-26a0ed28e73a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12c5c03e8b6943ff9983dd76d9427bde'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:31:00.202901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-908379cd-8d59-41bb-aae4-26a0ed28e73a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12c5c03e8b6943ff9983dd76d9427bde'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:31:00.204005 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-908379cd-8d59-41bb-aae4-26a0ed28e73a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12c5c03e8b6943ff9983dd76d9427bde'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:31:00.213993 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-908379cd-8d59-41bb-aae4-26a0ed28e73a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12c5c03e8b6943ff9983dd76d9427bde'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:31:00.234012 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1205/2434] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:30:59 2022] DELETE /identity/v3/users/12c5c03e8b6943ff9983dd76d9427bde => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:31:00.238429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cc5ee-5aa4-4c07-8386-365c62714308 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:31:00.238888 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cc5ee-5aa4-4c07-8386-365c62714308 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:31:00.239017 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cc5ee-5aa4-4c07-8386-365c62714308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:31:00.260188 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-424cc5ee-5aa4-4c07-8386-365c62714308 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:31:00.261960 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-424cc5ee-5aa4-4c07-8386-365c62714308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:31:00.325036 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908379cd-8d59-41bb-aae4-26a0ed28e73a admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:31:00.326752 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-908379cd-8d59-41bb-aae4-26a0ed28e73a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:31:00.334526 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1230/2435] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:31:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:31:00.344723 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cc5ee-5aa4-4c07-8386-365c62714308 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:31:00.346400 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-424cc5ee-5aa4-4c07-8386-365c62714308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:31:00.392747 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908379cd-8d59-41bb-aae4-26a0ed28e73a admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:31:00.396494 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1558373-ad15-4372-8cf9-e9314c81e9ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:31:00.397112 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1558373-ad15-4372-8cf9-e9314c81e9ef service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:31:00.397413 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1558373-ad15-4372-8cf9-e9314c81e9ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:31:00.397678 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1558373-ad15-4372-8cf9-e9314c81e9ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:31:00.399552 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-b1558373-ad15-4372-8cf9-e9314c81e9ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:31:00.408329 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cc5ee-5aa4-4c07-8386-365c62714308 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:31:00.412202 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2507e6-a8d5-4cad-ada8-f741216ae6ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:31:00.412818 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2507e6-a8d5-4cad-ada8-f741216ae6ab service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:31:00.413099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2507e6-a8d5-4cad-ada8-f741216ae6ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:31:00.413401 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2507e6-a8d5-4cad-ada8-f741216ae6ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:31:00.423782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2507e6-a8d5-4cad-ada8-f741216ae6ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:31:00.425254 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2507e6-a8d5-4cad-ada8-f741216ae6ab service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:31:00.435450 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:31:00.436000 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1231/2436] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:31:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:31:00.467564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1558373-ad15-4372-8cf9-e9314c81e9ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:31:00.469044 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1558373-ad15-4372-8cf9-e9314c81e9ef service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:31:00.479145 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1206/2437] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:31:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:31:01.004391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2507e6-a8d5-4cad-ada8-f741216ae6ab service neutron] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:31:01.006029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-fd2507e6-a8d5-4cad-ada8-f741216ae6ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:31:01.039708 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2507e6-a8d5-4cad-ada8-f741216ae6ab service neutron] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:31:01.044937 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40eea51-526e-4ca7-a723-ed51085dcd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:31:01.045576 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40eea51-526e-4ca7-a723-ed51085dcd7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:31:01.045850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40eea51-526e-4ca7-a723-ed51085dcd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:31:01.046122 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40eea51-526e-4ca7-a723-ed51085dcd7b admin admin] PATH_INFO: `/v3/projects/095fbec64f94465683032dbc9a1eba3a` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:31:01.047249 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40eea51-526e-4ca7-a723-ed51085dcd7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=095fbec64f94465683032dbc9a1eba3a)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:31:01.049193 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40eea51-526e-4ca7-a723-ed51085dcd7b admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:31:01.179629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c40eea51-526e-4ca7-a723-ed51085dcd7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '095fbec64f94465683032dbc9a1eba3a', 'request_id': 'req-c40eea51-526e-4ca7-a723-ed51085dcd7b'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:31:01.188614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c40eea51-526e-4ca7-a723-ed51085dcd7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '095fbec64f94465683032dbc9a1eba3a', 'request_id': 'req-c40eea51-526e-4ca7-a723-ed51085dcd7b'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:31:01.305069 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c40eea51-526e-4ca7-a723-ed51085dcd7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '095fbec64f94465683032dbc9a1eba3a', 'request_id': 'req-c40eea51-526e-4ca7-a723-ed51085dcd7b'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:31:01.316797 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c40eea51-526e-4ca7-a723-ed51085dcd7b admin admin] The token cache is being invalidate because project 095fbec64f94465683032dbc9a1eba3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:31:01.317292 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c40eea51-526e-4ca7-a723-ed51085dcd7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:31:01.318092 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c40eea51-526e-4ca7-a723-ed51085dcd7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:31:01.319884 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1232/2438] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:31:01 2022] DELETE /identity/v3/projects/095fbec64f94465683032dbc9a1eba3a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:31:01.325350 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559b610-454c-4815-8de0-8b6c06e1ace0 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:31:01.325887 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559b610-454c-4815-8de0-8b6c06e1ace0 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:31:01.325887 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559b610-454c-4815-8de0-8b6c06e1ace0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:31:01.346735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-9559b610-454c-4815-8de0-8b6c06e1ace0 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:31:01.348084 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-9559b610-454c-4815-8de0-8b6c06e1ace0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:31:01.418295 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09059cb6-245d-46fd-bd09-9f77f1ef467f None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:31:01.418564 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09059cb6-245d-46fd-bd09-9f77f1ef467f None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:31:01.418848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09059cb6-245d-46fd-bd09-9f77f1ef467f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:31:01.428132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1207/2439] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:31:01.437179 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e1dfe-9f3a-4672-895b-4d153f63fe99 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:31:01.437937 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e1dfe-9f3a-4672-895b-4d153f63fe99 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:31:01.438448 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e1dfe-9f3a-4672-895b-4d153f63fe99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:31:01.441059 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-09059cb6-245d-46fd-bd09-9f77f1ef467f None None] MFA Rules not processed for user `2e7cc9c938214193b922ab1bc8288a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:31:01.442700 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-09059cb6-245d-46fd-bd09-9f77f1ef467f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:31:01.469535 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-759e1dfe-9f3a-4672-895b-4d153f63fe99 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:31:01.471147 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-759e1dfe-9f3a-4672-895b-4d153f63fe99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:31:01.479089 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:31:01.484604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1208/2440] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:31:01.485877 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e1dfe-9f3a-4672-895b-4d153f63fe99 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:31:01.497326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e1dfe-9f3a-4672-895b-4d153f63fe99 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:31:01.502480 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3d557-80c9-49f2-9e28-31e3f46c2919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:31:01.504156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3d557-80c9-49f2-9e28-31e3f46c2919 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:31:01.504445 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3d557-80c9-49f2-9e28-31e3f46c2919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:31:01.505271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3d557-80c9-49f2-9e28-31e3f46c2919 admin admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:31:01.505932 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3d557-80c9-49f2-9e28-31e3f46c2919 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:31:01.506242 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3d557-80c9-49f2-9e28-31e3f46c2919 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:31:01.507929 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3d557-80c9-49f2-9e28-31e3f46c2919 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:31:01.526134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1209/2441] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:31:01.531466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1233/2442] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:31:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:31:01.531653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3d557-80c9-49f2-9e28-31e3f46c2919 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:31:01.540422 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3d557-80c9-49f2-9e28-31e3f46c2919 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:31:01.545735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f05d4-a21c-4600-be6f-db44ebd4516c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:31:01.546529 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f05d4-a21c-4600-be6f-db44ebd4516c admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:31:01.546995 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f05d4-a21c-4600-be6f-db44ebd4516c admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:31:01.547464 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f05d4-a21c-4600-be6f-db44ebd4516c admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:31:01.548406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f05d4-a21c-4600-be6f-db44ebd4516c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:31:01.550571 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f05d4-a21c-4600-be6f-db44ebd4516c admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:31:01.642582 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1210/2443] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:31:01 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:31:01.647990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09059cb6-245d-46fd-bd09-9f77f1ef467f None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:31:01.669264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09059cb6-245d-46fd-bd09-9f77f1ef467f None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:31:01.750153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c0d02-aad6-4ff5-97e7-6cc3038af262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:31:01.750660 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c0d02-aad6-4ff5-97e7-6cc3038af262 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:31:01.750992 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c0d02-aad6-4ff5-97e7-6cc3038af262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:31:01.751189 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c0d02-aad6-4ff5-97e7-6cc3038af262 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:31:01.751883 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c0d02-aad6-4ff5-97e7-6cc3038af262 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:31:01.753964 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c0d02-aad6-4ff5-97e7-6cc3038af262 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:31:01.877585 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1234/2444] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:31:01 2022] POST /identity/v3/users => generated 292 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:31:01.881857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f05d4-a21c-4600-be6f-db44ebd4516c admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:31:01.893049 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f05d4-a21c-4600-be6f-db44ebd4516c admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:31:01.898543 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ee24c-126c-4267-b6cd-ea68a689b3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:31:01.899250 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ee24c-126c-4267-b6cd-ea68a689b3db admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:31:01.899574 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ee24c-126c-4267-b6cd-ea68a689b3db admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:31:01.899845 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ee24c-126c-4267-b6cd-ea68a689b3db admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:31:01.900482 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ee24c-126c-4267-b6cd-ea68a689b3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:31:01.902075 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ee24c-126c-4267-b6cd-ea68a689b3db admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:31:01.913859 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1211/2445] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:31:01.918235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c0d02-aad6-4ff5-97e7-6cc3038af262 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:31:01.929348 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c0d02-aad6-4ff5-97e7-6cc3038af262 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:31:01.934198 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0704b-2b8f-4d3e-b857-978024d87e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:31:01.934804 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0704b-2b8f-4d3e-b857-978024d87e7e admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:31:01.935063 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0704b-2b8f-4d3e-b857-978024d87e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:31:01.935339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0704b-2b8f-4d3e-b857-978024d87e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:31:01.936062 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0704b-2b8f-4d3e-b857-978024d87e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:31:01.937676 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0704b-2b8f-4d3e-b857-978024d87e7e admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:31:01.957419 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1235/2446] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:31:01.959162 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ee24c-126c-4267-b6cd-ea68a689b3db admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:31:01.970126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ee24c-126c-4267-b6cd-ea68a689b3db admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:31:01.976025 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1be09-36d9-4017-bf84-d57242bbfed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:31:01.976687 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1be09-36d9-4017-bf84-d57242bbfed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:31:01.976964 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1be09-36d9-4017-bf84-d57242bbfed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:31:01.977228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1be09-36d9-4017-bf84-d57242bbfed4 admin admin] PATH_INFO: `/v3/projects/fe1680a7439749e080ba7c94e7c62117/users/b1072574dbae4515abdc9632c2979321/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:31:02.019217 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1be09-36d9-4017-bf84-d57242bbfed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe1680a7439749e080ba7c94e7c62117, user_id=b1072574dbae4515abdc9632c2979321, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:31:02.022613 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1be09-36d9-4017-bf84-d57242bbfed4 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:31:02.137507 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1212/2447] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:31:01 2022] PUT /identity/v3/projects/fe1680a7439749e080ba7c94e7c62117/users/b1072574dbae4515abdc9632c2979321/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:31:02.146252 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd04fc-2ec4-4aa2-8f16-134c3e7acd27 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:31:02.146252 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd04fc-2ec4-4aa2-8f16-134c3e7acd27 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:31:02.146252 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd04fc-2ec4-4aa2-8f16-134c3e7acd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:31:02.183302 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-7efd04fc-2ec4-4aa2-8f16-134c3e7acd27 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:31:02.184918 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-7efd04fc-2ec4-4aa2-8f16-134c3e7acd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:31:02.261877 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1236/2448] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:31:02.273404 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1be09-36d9-4017-bf84-d57242bbfed4 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:31:02.275523 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-afc1be09-36d9-4017-bf84-d57242bbfed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:31:02.355881 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1be09-36d9-4017-bf84-d57242bbfed4 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:31:02.355881 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f1d17-7b82-420b-8a07-7c890acce739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:31:02.355881 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f1d17-7b82-420b-8a07-7c890acce739 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:31:02.356892 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f1d17-7b82-420b-8a07-7c890acce739 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:31:02.357394 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f1d17-7b82-420b-8a07-7c890acce739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:31:02.373269 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:31:02.375871 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f1d17-7b82-420b-8a07-7c890acce739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:31:02.377404 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f1d17-7b82-420b-8a07-7c890acce739 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:31:02.390032 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1213/2449] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:31:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:31:04.402262 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2d513-55a9-4898-96cf-65ab2dac0c4a None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:31:04.403130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2d513-55a9-4898-96cf-65ab2dac0c4a None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:31:04.403673 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2d513-55a9-4898-96cf-65ab2dac0c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:31:04.443240 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-01d2d513-55a9-4898-96cf-65ab2dac0c4a None None] MFA Rules not processed for user `b1072574dbae4515abdc9632c2979321`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:31:04.444520 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-01d2d513-55a9-4898-96cf-65ab2dac0c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:31:04.509534 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:31:04.541912 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1237/2450] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:31:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:31:04.554999 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f1d17-7b82-420b-8a07-7c890acce739 service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:31:04.556545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-495f1d17-7b82-420b-8a07-7c890acce739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:31:04.618658 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f1d17-7b82-420b-8a07-7c890acce739 service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:31:04.622597 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c72d2-5486-4479-84ed-b89f8107e29e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:31:04.623304 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c72d2-5486-4479-84ed-b89f8107e29e service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:31:04.623627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c72d2-5486-4479-84ed-b89f8107e29e service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:31:04.623907 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c72d2-5486-4479-84ed-b89f8107e29e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:31:04.635256 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c72d2-5486-4479-84ed-b89f8107e29e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:31:04.636753 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c72d2-5486-4479-84ed-b89f8107e29e service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:31:04.647905 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1214/2451] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:31:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:31:06.614978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6b751-4af8-4679-8c5e-f2b5c6b32c89 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:31:06.615547 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6b751-4af8-4679-8c5e-f2b5c6b32c89 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:31:06.615547 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6b751-4af8-4679-8c5e-f2b5c6b32c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:31:06.635952 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-afb6b751-4af8-4679-8c5e-f2b5c6b32c89 None None] MFA Rules not processed for user `b1072574dbae4515abdc9632c2979321`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:31:06.637185 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-afb6b751-4af8-4679-8c5e-f2b5c6b32c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:31:06.644995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1238/2452] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:31:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:31:14.642447 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=28 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:31:16.630929 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=12 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:31:20.219921 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450b611-3e7f-4c18-9af2-60aa3a9cf6b4 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:31:20.220602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450b611-3e7f-4c18-9af2-60aa3a9cf6b4 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:31:20.220602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450b611-3e7f-4c18-9af2-60aa3a9cf6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:31:20.241481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-3450b611-3e7f-4c18-9af2-60aa3a9cf6b4 None None] MFA Rules not processed for user `779846f3313940b388340f1794450e17`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:31:20.242886 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-3450b611-3e7f-4c18-9af2-60aa3a9cf6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:31:20.303035 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1215/2453] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:31:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:31:30.295309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=25 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:31:53.152016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ccf1b-b8c1-4c3a-a5df-a9215295a9b4 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:31:53.152586 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ccf1b-b8c1-4c3a-a5df-a9215295a9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:31:53.152586 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ccf1b-b8c1-4c3a-a5df-a9215295a9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:31:53.171819 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-b24ccf1b-b8c1-4c3a-a5df-a9215295a9b4 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:31:53.173022 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-b24ccf1b-b8c1-4c3a-a5df-a9215295a9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:31:53.181642 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1239/2454] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Sep 6 20:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:31:53.203681 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450b611-3e7f-4c18-9af2-60aa3a9cf6b4 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:31:53.205153 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-3450b611-3e7f-4c18-9af2-60aa3a9cf6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:31:53.278520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450b611-3e7f-4c18-9af2-60aa3a9cf6b4 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:31:53.283989 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d04ef9-9c29-482e-8513-ec028bf06e6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:31:53.284594 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d04ef9-9c29-482e-8513-ec028bf06e6c service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:31:53.284872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d04ef9-9c29-482e-8513-ec028bf06e6c service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:31:53.285143 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d04ef9-9c29-482e-8513-ec028bf06e6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:31:53.293607 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d04ef9-9c29-482e-8513-ec028bf06e6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:31:53.295165 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d04ef9-9c29-482e-8513-ec028bf06e6c service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:31:53.305084 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1216/2455] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:31:57.004719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ccf1b-b8c1-4c3a-a5df-a9215295a9b4 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:31:57.006202 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-b24ccf1b-b8c1-4c3a-a5df-a9215295a9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:31:57.020085 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ccf1b-b8c1-4c3a-a5df-a9215295a9b4 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:31:57.024362 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20001aab-d943-48e4-a454-118447854ab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:31:57.024973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20001aab-d943-48e4-a454-118447854ab1 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:31:57.025253 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20001aab-d943-48e4-a454-118447854ab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:31:57.025525 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20001aab-d943-48e4-a454-118447854ab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:31:57.027270 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-20001aab-d943-48e4-a454-118447854ab1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:31:57.041907 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20001aab-d943-48e4-a454-118447854ab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:31:57.043341 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20001aab-d943-48e4-a454-118447854ab1 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:31:57.054481 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1240/2456] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:31:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:31:59.619179 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d04ef9-9c29-482e-8513-ec028bf06e6c service nova] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:31:59.630826 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d04ef9-9c29-482e-8513-ec028bf06e6c service nova] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:31:59.639885 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebabb4e-c1ad-4861-b26d-587cd9928dd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:31:59.639885 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebabb4e-c1ad-4861-b26d-587cd9928dd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:31:59.639885 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebabb4e-c1ad-4861-b26d-587cd9928dd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:31:59.639885 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebabb4e-c1ad-4861-b26d-587cd9928dd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:31:59.640249 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-0ebabb4e-c1ad-4861-b26d-587cd9928dd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:31:59.654062 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebabb4e-c1ad-4861-b26d-587cd9928dd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:31:59.655630 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebabb4e-c1ad-4861-b26d-587cd9928dd0 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:31:59.669928 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1217/2457] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:31:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:32:00.734691 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbcebb-64f0-41fe-b7d0-3bf11e48d9e3 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:00.735365 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbcebb-64f0-41fe-b7d0-3bf11e48d9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:00.735365 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbcebb-64f0-41fe-b7d0-3bf11e48d9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:00.756501 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-3ebbcebb-64f0-41fe-b7d0-3bf11e48d9e3 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:32:00.757833 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-3ebbcebb-64f0-41fe-b7d0-3bf11e48d9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:00.766399 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1241/2458] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Sep 6 20:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:32:00.800089 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebabb4e-c1ad-4861-b26d-587cd9928dd0 service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:00.802589 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-0ebabb4e-c1ad-4861-b26d-587cd9928dd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:00.816584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebabb4e-c1ad-4861-b26d-587cd9928dd0 service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:00.823333 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d9e03-56a6-44c8-b135-e80795cf492f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:00.824036 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d9e03-56a6-44c8-b135-e80795cf492f service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:00.824313 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d9e03-56a6-44c8-b135-e80795cf492f service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:00.824630 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d9e03-56a6-44c8-b135-e80795cf492f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:00.835212 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d9e03-56a6-44c8-b135-e80795cf492f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:00.838177 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d9e03-56a6-44c8-b135-e80795cf492f service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:00.849104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1218/2459] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:32:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:32:06.491953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9c8a2-d9f8-4cec-9013-f689e4196f29 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:06.493074 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9c8a2-d9f8-4cec-9013-f689e4196f29 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:06.493074 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9c8a2-d9f8-4cec-9013-f689e4196f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:06.514882 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-6ff9c8a2-d9f8-4cec-9013-f689e4196f29 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:32:06.516146 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-6ff9c8a2-d9f8-4cec-9013-f689e4196f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:06.524977 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1242/2460] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Sep 6 20:32:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:32:06.567031 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d9e03-56a6-44c8-b135-e80795cf492f service nova] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:06.586017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d9e03-56a6-44c8-b135-e80795cf492f service nova] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:06.593665 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a737fc6-ab86-4f44-bf80-22063bba208e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:06.595653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a737fc6-ab86-4f44-bf80-22063bba208e service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:06.596185 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a737fc6-ab86-4f44-bf80-22063bba208e service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:06.597370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a737fc6-ab86-4f44-bf80-22063bba208e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:06.608634 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a737fc6-ab86-4f44-bf80-22063bba208e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:06.610255 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a737fc6-ab86-4f44-bf80-22063bba208e service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:06.621665 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1219/2461] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:32:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:32:08.524724 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c69170-6c95-41e3-883f-309a2e89c88b None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:08.525257 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c69170-6c95-41e3-883f-309a2e89c88b None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:08.525257 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c69170-6c95-41e3-883f-309a2e89c88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:08.545200 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-82c69170-6c95-41e3-883f-309a2e89c88b None None] MFA Rules not processed for user `87d974bb5cf94567b1493fa54e804374`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:32:08.546414 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-82c69170-6c95-41e3-883f-309a2e89c88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:08.604316 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1243/2462] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:32:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:32:11.360561 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a737fc6-ab86-4f44-bf80-22063bba208e service nova] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:11.373154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a737fc6-ab86-4f44-bf80-22063bba208e service nova] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:11.378993 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d4457-94ec-4028-a586-aa6af5582dbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:11.379584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d4457-94ec-4028-a586-aa6af5582dbf service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:11.380070 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d4457-94ec-4028-a586-aa6af5582dbf service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:11.380352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d4457-94ec-4028-a586-aa6af5582dbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:11.382647 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-2e5d4457-94ec-4028-a586-aa6af5582dbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:11.468264 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d4457-94ec-4028-a586-aa6af5582dbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:11.468264 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d4457-94ec-4028-a586-aa6af5582dbf service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:11.495881 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1220/2463] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:32:11 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:32:13.440958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7a540-0981-4ce4-9294-48dfd54ba324 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:13.441567 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7a540-0981-4ce4-9294-48dfd54ba324 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:13.441567 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7a540-0981-4ce4-9294-48dfd54ba324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:13.462428 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-f7b7a540-0981-4ce4-9294-48dfd54ba324 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:32:13.463701 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-f7b7a540-0981-4ce4-9294-48dfd54ba324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:13.471986 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1244/2464] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Sep 6 20:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:32:13.495504 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d4457-94ec-4028-a586-aa6af5582dbf service nova] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:13.507382 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d4457-94ec-4028-a586-aa6af5582dbf service nova] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:13.513415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991df2a7-aeab-4648-85a7-3785ca664b86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:13.514027 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991df2a7-aeab-4648-85a7-3785ca664b86 service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:13.514309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991df2a7-aeab-4648-85a7-3785ca664b86 service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:13.514583 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991df2a7-aeab-4648-85a7-3785ca664b86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:13.523198 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991df2a7-aeab-4648-85a7-3785ca664b86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:13.525348 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991df2a7-aeab-4648-85a7-3785ca664b86 service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:13.535463 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1221/2465] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:32:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:32:17.779961 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a45d3-5095-4ac6-9870-1d2dab0b5b35 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:17.780519 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a45d3-5095-4ac6-9870-1d2dab0b5b35 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:17.780519 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a45d3-5095-4ac6-9870-1d2dab0b5b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:17.788271 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=44 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:32:17.801495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-6a1a45d3-5095-4ac6-9870-1d2dab0b5b35 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:32:17.802712 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-6a1a45d3-5095-4ac6-9870-1d2dab0b5b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:17.812971 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1245/2466] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Sep 6 20:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:32:17.839622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991df2a7-aeab-4648-85a7-3785ca664b86 service nova] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:17.856866 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991df2a7-aeab-4648-85a7-3785ca664b86 service nova] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:17.865544 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e5eef-0b74-4adc-bfa1-1b3832d8bcdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:17.866215 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e5eef-0b74-4adc-bfa1-1b3832d8bcdc service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:17.866666 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e5eef-0b74-4adc-bfa1-1b3832d8bcdc service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:17.867083 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e5eef-0b74-4adc-bfa1-1b3832d8bcdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:17.876995 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e5eef-0b74-4adc-bfa1-1b3832d8bcdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:17.878564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e5eef-0b74-4adc-bfa1-1b3832d8bcdc service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:17.889627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1222/2467] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:32:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:32:23.866188 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a45d3-5095-4ac6-9870-1d2dab0b5b35 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:23.886336 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a45d3-5095-4ac6-9870-1d2dab0b5b35 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:23.890619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd211050-69b1-4f8c-b0cd-2a7a3511c538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:23.892283 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd211050-69b1-4f8c-b0cd-2a7a3511c538 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:23.892389 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd211050-69b1-4f8c-b0cd-2a7a3511c538 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:23.892661 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd211050-69b1-4f8c-b0cd-2a7a3511c538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:23.894749 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-cd211050-69b1-4f8c-b0cd-2a7a3511c538 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:23.906595 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd211050-69b1-4f8c-b0cd-2a7a3511c538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:23.908167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd211050-69b1-4f8c-b0cd-2a7a3511c538 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:23.918628 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1246/2468] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:32:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:32:25.145573 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fd4d9-9d1b-4049-b7eb-1d03d9eec541 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:25.146118 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fd4d9-9d1b-4049-b7eb-1d03d9eec541 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:25.146118 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fd4d9-9d1b-4049-b7eb-1d03d9eec541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:25.154512 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=93 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:32:25.167162 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-539fd4d9-9d1b-4049-b7eb-1d03d9eec541 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:32:25.168435 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-539fd4d9-9d1b-4049-b7eb-1d03d9eec541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:25.176666 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1223/2469] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Sep 6 20:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:32:25.204966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd211050-69b1-4f8c-b0cd-2a7a3511c538 service neutron] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:25.220420 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd211050-69b1-4f8c-b0cd-2a7a3511c538 service neutron] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:25.226237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a84997-7b11-4cd9-8c3e-6da0e93c09db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:25.226921 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a84997-7b11-4cd9-8c3e-6da0e93c09db service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:25.227226 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a84997-7b11-4cd9-8c3e-6da0e93c09db service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:25.227496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a84997-7b11-4cd9-8c3e-6da0e93c09db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:25.236232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a84997-7b11-4cd9-8c3e-6da0e93c09db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:25.237795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a84997-7b11-4cd9-8c3e-6da0e93c09db service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:25.247402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1247/2470] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:32:35.214270 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:32:35.243080 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=14 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:32:35.498601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fd4d9-9d1b-4049-b7eb-1d03d9eec541 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:35.513609 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fd4d9-9d1b-4049-b7eb-1d03d9eec541 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:35.519723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d0b82-f6db-4b46-a919-624619b922e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:35.520370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d0b82-f6db-4b46-a919-624619b922e0 service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:35.520649 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d0b82-f6db-4b46-a919-624619b922e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:35.521085 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d0b82-f6db-4b46-a919-624619b922e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:35.523956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-743d0b82-f6db-4b46-a919-624619b922e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:35.535746 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d0b82-f6db-4b46-a919-624619b922e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:35.537593 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d0b82-f6db-4b46-a919-624619b922e0 service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:35.548982 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1224/2471] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:32:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:32:35.817934 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a84997-7b11-4cd9-8c3e-6da0e93c09db service nova] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:35.828727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a84997-7b11-4cd9-8c3e-6da0e93c09db service nova] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:35.834815 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d8693-7652-415b-baf6-4689f5630f66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:35.836090 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d8693-7652-415b-baf6-4689f5630f66 service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:35.836460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d8693-7652-415b-baf6-4689f5630f66 service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:35.836726 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d8693-7652-415b-baf6-4689f5630f66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:35.838621 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-c14d8693-7652-415b-baf6-4689f5630f66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:35.852768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d8693-7652-415b-baf6-4689f5630f66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:35.854363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d8693-7652-415b-baf6-4689f5630f66 service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:35.865478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1248/2472] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:32:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:32:44.461227 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d0b82-f6db-4b46-a919-624619b922e0 service nova] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:44.472477 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d0b82-f6db-4b46-a919-624619b922e0 service nova] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:44.479482 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8a99c-47b4-4f8b-97bd-741485900ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:44.480676 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8a99c-47b4-4f8b-97bd-741485900ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:44.480676 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8a99c-47b4-4f8b-97bd-741485900ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:44.481149 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8a99c-47b4-4f8b-97bd-741485900ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:44.483171 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-26c8a99c-47b4-4f8b-97bd-741485900ee6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:44.498248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8a99c-47b4-4f8b-97bd-741485900ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:44.500207 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8a99c-47b4-4f8b-97bd-741485900ee6 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:44.512869 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1225/2473] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:32:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:32:45.860839 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=6 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:32:48.729214 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffb4cd-afa7-47f7-8b62-d6f8800e9fa4 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:48.729822 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffb4cd-afa7-47f7-8b62-d6f8800e9fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:48.729822 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffb4cd-afa7-47f7-8b62-d6f8800e9fa4 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:48.731106 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1249/2474] 10.222.0.77 () {54 vars in 961 bytes} [Tue Sep 6 20:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:32:48.736718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cefd8-03ee-4d60-a302-8c011ea80770 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:48.737575 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cefd8-03ee-4d60-a302-8c011ea80770 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:48.738090 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cefd8-03ee-4d60-a302-8c011ea80770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:48.759983 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-162cefd8-03ee-4d60-a302-8c011ea80770 None None] MFA Rules not processed for user `2a486663ec144db0bbde6bf3deb35a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:32:48.761291 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-162cefd8-03ee-4d60-a302-8c011ea80770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:48.829558 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1226/2475] 10.222.0.77 () {58 vars in 1058 bytes} [Tue Sep 6 20:32:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:32:48.838207 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ffb4cd-afa7-47f7-8b62-d6f8800e9fa4 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:48.854231 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ffb4cd-afa7-47f7-8b62-d6f8800e9fa4 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:48.860829 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc586d-cda5-444e-a89c-2e47fa7af690 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a486663ec144db0bbde6bf3deb35a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:48.868708 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc586d-cda5-444e-a89c-2e47fa7af690 service placement] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:48.868708 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc586d-cda5-444e-a89c-2e47fa7af690 service placement] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:48.868708 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc586d-cda5-444e-a89c-2e47fa7af690 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:48.868708 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-3fbc586d-cda5-444e-a89c-2e47fa7af690 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:48.877392 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc586d-cda5-444e-a89c-2e47fa7af690 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:48.879793 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc586d-cda5-444e-a89c-2e47fa7af690 service placement] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:48.892178 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1250/2476] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:32:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:32:48.908751 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cefd8-03ee-4d60-a302-8c011ea80770 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:48.910090 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-162cefd8-03ee-4d60-a302-8c011ea80770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:48.931168 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cefd8-03ee-4d60-a302-8c011ea80770 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:48.936746 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610de813-fc9f-4edb-a1ef-f46815d0be90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:48.937556 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610de813-fc9f-4edb-a1ef-f46815d0be90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:48.937730 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610de813-fc9f-4edb-a1ef-f46815d0be90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:48.938001 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610de813-fc9f-4edb-a1ef-f46815d0be90 admin admin] PATH_INFO: `/v3/users/2e7cc9c938214193b922ab1bc8288a4b` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:48.939155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610de813-fc9f-4edb-a1ef-f46815d0be90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e7cc9c938214193b922ab1bc8288a4b)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:48.941126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610de813-fc9f-4edb-a1ef-f46815d0be90 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:49.176030 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-610de813-fc9f-4edb-a1ef-f46815d0be90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e7cc9c938214193b922ab1bc8288a4b'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:32:49.271761 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-610de813-fc9f-4edb-a1ef-f46815d0be90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e7cc9c938214193b922ab1bc8288a4b'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:32:49.272404 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-610de813-fc9f-4edb-a1ef-f46815d0be90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e7cc9c938214193b922ab1bc8288a4b'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:32:49.273017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-610de813-fc9f-4edb-a1ef-f46815d0be90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e7cc9c938214193b922ab1bc8288a4b'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:32:49.281457 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-610de813-fc9f-4edb-a1ef-f46815d0be90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e7cc9c938214193b922ab1bc8288a4b'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:32:49.300052 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1227/2477] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:32:48 2022] DELETE /identity/v3/users/2e7cc9c938214193b922ab1bc8288a4b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:32:49.595635 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc586d-cda5-444e-a89c-2e47fa7af690 service placement] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:49.609433 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc586d-cda5-444e-a89c-2e47fa7af690 service placement] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:49.674868 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ed28e-a919-44bf-a15e-c558679ffce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:49.675645 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ed28e-a919-44bf-a15e-c558679ffce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:49.675801 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ed28e-a919-44bf-a15e-c558679ffce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:49.676100 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ed28e-a919-44bf-a15e-c558679ffce0 admin admin] PATH_INFO: `/v3/projects/604b4ccf32184d70b2b709a3ad22f25a` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:49.677901 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ed28e-a919-44bf-a15e-c558679ffce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=604b4ccf32184d70b2b709a3ad22f25a)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:49.680134 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ed28e-a919-44bf-a15e-c558679ffce0 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:49.839146 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-013ed28e-a919-44bf-a15e-c558679ffce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '604b4ccf32184d70b2b709a3ad22f25a', 'request_id': 'req-013ed28e-a919-44bf-a15e-c558679ffce0'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:32:49.846119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-013ed28e-a919-44bf-a15e-c558679ffce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '604b4ccf32184d70b2b709a3ad22f25a', 'request_id': 'req-013ed28e-a919-44bf-a15e-c558679ffce0'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:32:49.948820 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-013ed28e-a919-44bf-a15e-c558679ffce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '604b4ccf32184d70b2b709a3ad22f25a', 'request_id': 'req-013ed28e-a919-44bf-a15e-c558679ffce0'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:32:49.962241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-013ed28e-a919-44bf-a15e-c558679ffce0 admin admin] The token cache is being invalidate because project 604b4ccf32184d70b2b709a3ad22f25a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:32:49.962527 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-013ed28e-a919-44bf-a15e-c558679ffce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:32:49.963193 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-013ed28e-a919-44bf-a15e-c558679ffce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:32:49.964878 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1251/2478] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:32:49 2022] DELETE /identity/v3/projects/604b4ccf32184d70b2b709a3ad22f25a => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:32:49.969796 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a669a-6238-4ad2-995c-922b18272d34 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:49.970310 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a669a-6238-4ad2-995c-922b18272d34 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:49.970432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a669a-6238-4ad2-995c-922b18272d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:49.993185 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-462a669a-6238-4ad2-995c-922b18272d34 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:32:49.994497 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-462a669a-6238-4ad2-995c-922b18272d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:50.035831 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:32:50.058134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1228/2479] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:32:50.065780 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276ed0d-1a6e-4b06-997f-91415cdd01a2 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:50.066078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276ed0d-1a6e-4b06-997f-91415cdd01a2 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:50.066380 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276ed0d-1a6e-4b06-997f-91415cdd01a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:50.088911 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-1276ed0d-1a6e-4b06-997f-91415cdd01a2 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:32:50.090143 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-1276ed0d-1a6e-4b06-997f-91415cdd01a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:50.098293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1252/2480] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:32:50.102765 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a669a-6238-4ad2-995c-922b18272d34 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:50.114260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a669a-6238-4ad2-995c-922b18272d34 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:50.120054 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf385a-412a-48a8-89a3-eeeafee3af34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:50.120831 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf385a-412a-48a8-89a3-eeeafee3af34 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:50.121117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf385a-412a-48a8-89a3-eeeafee3af34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:50.121399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf385a-412a-48a8-89a3-eeeafee3af34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:50.122268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf385a-412a-48a8-89a3-eeeafee3af34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:32:50.122387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf385a-412a-48a8-89a3-eeeafee3af34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:50.123996 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf385a-412a-48a8-89a3-eeeafee3af34 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:50.143871 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1229/2481] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:32:50.147726 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276ed0d-1a6e-4b06-997f-91415cdd01a2 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:50.158165 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276ed0d-1a6e-4b06-997f-91415cdd01a2 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:50.163018 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518c809-b5e0-49d5-923b-54b69c968d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:50.163656 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518c809-b5e0-49d5-923b-54b69c968d28 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:50.163953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518c809-b5e0-49d5-923b-54b69c968d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:50.164221 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518c809-b5e0-49d5-923b-54b69c968d28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:50.164869 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518c809-b5e0-49d5-923b-54b69c968d28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:50.166870 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518c809-b5e0-49d5-923b-54b69c968d28 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:50.296044 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1253/2482] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:32:50 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:32:50.300771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf385a-412a-48a8-89a3-eeeafee3af34 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:50.311369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf385a-412a-48a8-89a3-eeeafee3af34 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:50.373057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59842bb1-3d91-47ac-8b89-9f79e878ee75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:50.373563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59842bb1-3d91-47ac-8b89-9f79e878ee75 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:50.373845 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59842bb1-3d91-47ac-8b89-9f79e878ee75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:50.374119 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59842bb1-3d91-47ac-8b89-9f79e878ee75 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:50.374757 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59842bb1-3d91-47ac-8b89-9f79e878ee75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:50.376816 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59842bb1-3d91-47ac-8b89-9f79e878ee75 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:50.466144 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1230/2483] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:32:50 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:32:50.470553 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518c809-b5e0-49d5-923b-54b69c968d28 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:50.481727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518c809-b5e0-49d5-923b-54b69c968d28 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:50.486291 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e672aba-18e4-4f0f-85f6-da831d583c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:50.486893 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e672aba-18e4-4f0f-85f6-da831d583c6c admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:50.487171 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e672aba-18e4-4f0f-85f6-da831d583c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:50.487464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e672aba-18e4-4f0f-85f6-da831d583c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:50.488126 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e672aba-18e4-4f0f-85f6-da831d583c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:50.489891 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e672aba-18e4-4f0f-85f6-da831d583c6c admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:50.500907 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1254/2484] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:32:50.511283 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59842bb1-3d91-47ac-8b89-9f79e878ee75 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:50.521711 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59842bb1-3d91-47ac-8b89-9f79e878ee75 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:50.527022 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4f974-a15a-44a5-a5f4-2795d10ced2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:50.527660 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4f974-a15a-44a5-a5f4-2795d10ced2a admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:50.527940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4f974-a15a-44a5-a5f4-2795d10ced2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:50.528235 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4f974-a15a-44a5-a5f4-2795d10ced2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:50.528859 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4f974-a15a-44a5-a5f4-2795d10ced2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:50.530472 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4f974-a15a-44a5-a5f4-2795d10ced2a admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:50.542128 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1231/2485] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:32:50.546505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e672aba-18e4-4f0f-85f6-da831d583c6c admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:50.556778 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e672aba-18e4-4f0f-85f6-da831d583c6c admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:50.561557 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7a36e-02e8-4edd-8620-f138e2eb44ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:50.562203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7a36e-02e8-4edd-8620-f138e2eb44ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:50.562474 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7a36e-02e8-4edd-8620-f138e2eb44ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:50.562739 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7a36e-02e8-4edd-8620-f138e2eb44ee admin admin] PATH_INFO: `/v3/projects/75904cb4c43049ad975423273965b870/users/1f0c5f691aab46dcb238e6f64eaaa71f/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:50.578500 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7a36e-02e8-4edd-8620-f138e2eb44ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=75904cb4c43049ad975423273965b870, user_id=1f0c5f691aab46dcb238e6f64eaaa71f, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:50.583024 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7a36e-02e8-4edd-8620-f138e2eb44ee admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:50.682382 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1255/2486] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:32:50 2022] PUT /identity/v3/projects/75904cb4c43049ad975423273965b870/users/1f0c5f691aab46dcb238e6f64eaaa71f/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:32:50.693952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38114f43-981a-4a97-adb6-efb474047583 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:50.694752 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38114f43-981a-4a97-adb6-efb474047583 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:50.695048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38114f43-981a-4a97-adb6-efb474047583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:50.725057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-38114f43-981a-4a97-adb6-efb474047583 None None] MFA Rules not processed for user `1f0c5f691aab46dcb238e6f64eaaa71f`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:32:50.727287 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-38114f43-981a-4a97-adb6-efb474047583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:50.799142 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1232/2487] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:32:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:32:50.810804 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7a36e-02e8-4edd-8620-f138e2eb44ee admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:50.812621 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-1bb7a36e-02e8-4edd-8620-f138e2eb44ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:50.833546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:32:50.897795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ab1e0-ce18-4d56-afea-c8c26bb0208e None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:50.898055 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ab1e0-ce18-4d56-afea-c8c26bb0208e None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:50.898369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ab1e0-ce18-4d56-afea-c8c26bb0208e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:50.901010 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7a36e-02e8-4edd-8620-f138e2eb44ee admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:50.907085 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bac6f7-c405-488a-8513-abef7607304a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:50.907766 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bac6f7-c405-488a-8513-abef7607304a service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:50.908027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bac6f7-c405-488a-8513-abef7607304a service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:50.908867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bac6f7-c405-488a-8513-abef7607304a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:50.918797 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bac6f7-c405-488a-8513-abef7607304a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:50.919295 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-a20ab1e0-ce18-4d56-afea-c8c26bb0208e None None] MFA Rules not processed for user `b1072574dbae4515abdc9632c2979321`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:32:50.920579 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-a20ab1e0-ce18-4d56-afea-c8c26bb0208e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:50.920717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bac6f7-c405-488a-8513-abef7607304a service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:50.931186 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1256/2488] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:32:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:32:50.960981 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:32:50.985084 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1233/2489] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:32:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:32:51.256089 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bac6f7-c405-488a-8513-abef7607304a service nova] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:51.258168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-87bac6f7-c405-488a-8513-abef7607304a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:51.321505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bac6f7-c405-488a-8513-abef7607304a service nova] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:51.325742 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a1a30-d9d0-498b-abdf-670a28f1daa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:51.326378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a1a30-d9d0-498b-abdf-670a28f1daa8 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:51.326659 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a1a30-d9d0-498b-abdf-670a28f1daa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:51.326944 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a1a30-d9d0-498b-abdf-670a28f1daa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:51.328739 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-640a1a30-d9d0-498b-abdf-670a28f1daa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:51.340005 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a1a30-d9d0-498b-abdf-670a28f1daa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:51.341457 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a1a30-d9d0-498b-abdf-670a28f1daa8 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:51.350367 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1257/2490] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:32:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:32:51.863893 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ab1e0-ce18-4d56-afea-c8c26bb0208e None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:51.865741 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-a20ab1e0-ce18-4d56-afea-c8c26bb0208e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:52.004278 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ab1e0-ce18-4d56-afea-c8c26bb0208e None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:52.018939 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e8c79-4068-42eb-a141-94546d1c50b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a486663ec144db0bbde6bf3deb35a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:52.019352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e8c79-4068-42eb-a141-94546d1c50b5 service placement] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:52.019591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e8c79-4068-42eb-a141-94546d1c50b5 service placement] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:52.019866 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e8c79-4068-42eb-a141-94546d1c50b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:52.021904 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-e22e8c79-4068-42eb-a141-94546d1c50b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:52.035943 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e8c79-4068-42eb-a141-94546d1c50b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:52.037489 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e8c79-4068-42eb-a141-94546d1c50b5 service placement] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:52.050184 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1234/2491] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:32:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:32:54.593768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a1a30-d9d0-498b-abdf-670a28f1daa8 service neutron] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:54.667953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a1a30-d9d0-498b-abdf-670a28f1daa8 service neutron] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:54.672632 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08cebd-895b-4061-932c-f4f99db6f798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:54.673284 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08cebd-895b-4061-932c-f4f99db6f798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:54.673577 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08cebd-895b-4061-932c-f4f99db6f798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:54.673829 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08cebd-895b-4061-932c-f4f99db6f798 admin admin] PATH_INFO: `/v3/users/1f0c5f691aab46dcb238e6f64eaaa71f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:54.674989 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08cebd-895b-4061-932c-f4f99db6f798 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f0c5f691aab46dcb238e6f64eaaa71f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:54.676977 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08cebd-895b-4061-932c-f4f99db6f798 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:55.054992 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:32:55.057790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-8c08cebd-895b-4061-932c-f4f99db6f798 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f0c5f691aab46dcb238e6f64eaaa71f'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:32:55.203492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-8c08cebd-895b-4061-932c-f4f99db6f798 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f0c5f691aab46dcb238e6f64eaaa71f'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:32:55.204570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-8c08cebd-895b-4061-932c-f4f99db6f798 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f0c5f691aab46dcb238e6f64eaaa71f'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:32:55.205204 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-8c08cebd-895b-4061-932c-f4f99db6f798 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f0c5f691aab46dcb238e6f64eaaa71f'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:32:55.216160 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-8c08cebd-895b-4061-932c-f4f99db6f798 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f0c5f691aab46dcb238e6f64eaaa71f'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:32:55.240378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1258/2492] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:32:54 2022] DELETE /identity/v3/users/1f0c5f691aab46dcb238e6f64eaaa71f => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:32:55.242080 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73050931-5574-4605-a9c0-69f9aa09693f None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:55.243401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73050931-5574-4605-a9c0-69f9aa09693f None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:55.255577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73050931-5574-4605-a9c0-69f9aa09693f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:55.269905 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-73050931-5574-4605-a9c0-69f9aa09693f None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:32:55.271145 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-73050931-5574-4605-a9c0-69f9aa09693f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:55.352048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1235/2493] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:32:55.365374 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08cebd-895b-4061-932c-f4f99db6f798 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:55.367869 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-8c08cebd-895b-4061-932c-f4f99db6f798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:55.448517 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08cebd-895b-4061-932c-f4f99db6f798 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:55.452903 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89100d-22cc-41c5-b640-17de5e978c6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:55.453526 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89100d-22cc-41c5-b640-17de5e978c6d service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:55.453808 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89100d-22cc-41c5-b640-17de5e978c6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:55.454081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89100d-22cc-41c5-b640-17de5e978c6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:55.466178 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89100d-22cc-41c5-b640-17de5e978c6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:55.468556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89100d-22cc-41c5-b640-17de5e978c6d service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:55.481300 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1259/2494] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:32:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:32:56.310573 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73050931-5574-4605-a9c0-69f9aa09693f None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:56.310573 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-73050931-5574-4605-a9c0-69f9aa09693f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:56.325517 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73050931-5574-4605-a9c0-69f9aa09693f None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:56.335367 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380ebc9-16f6-4dbd-8808-13908aeae9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:56.336427 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380ebc9-16f6-4dbd-8808-13908aeae9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:56.336722 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380ebc9-16f6-4dbd-8808-13908aeae9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:56.337058 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380ebc9-16f6-4dbd-8808-13908aeae9bb admin admin] PATH_INFO: `/v3/projects/75904cb4c43049ad975423273965b870` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:56.338926 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9380ebc9-16f6-4dbd-8808-13908aeae9bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=75904cb4c43049ad975423273965b870)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:56.341437 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9380ebc9-16f6-4dbd-8808-13908aeae9bb admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:56.535581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9380ebc9-16f6-4dbd-8808-13908aeae9bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75904cb4c43049ad975423273965b870', 'request_id': 'req-9380ebc9-16f6-4dbd-8808-13908aeae9bb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:32:56.543027 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9380ebc9-16f6-4dbd-8808-13908aeae9bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75904cb4c43049ad975423273965b870', 'request_id': 'req-9380ebc9-16f6-4dbd-8808-13908aeae9bb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:32:56.607362 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9380ebc9-16f6-4dbd-8808-13908aeae9bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75904cb4c43049ad975423273965b870', 'request_id': 'req-9380ebc9-16f6-4dbd-8808-13908aeae9bb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:32:56.612836 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:32:56.620153 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9380ebc9-16f6-4dbd-8808-13908aeae9bb admin admin] The token cache is being invalidate because project 75904cb4c43049ad975423273965b870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:32:56.639749 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9380ebc9-16f6-4dbd-8808-13908aeae9bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:32:56.639749 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9380ebc9-16f6-4dbd-8808-13908aeae9bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:32:56.639749 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1236/2495] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:32:56 2022] DELETE /identity/v3/projects/75904cb4c43049ad975423273965b870 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:32:56.640109 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833740e-ea4a-42f4-a424-80da61ad5d1c None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:56.640109 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833740e-ea4a-42f4-a424-80da61ad5d1c None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:56.640109 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833740e-ea4a-42f4-a424-80da61ad5d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:56.651372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-b833740e-ea4a-42f4-a424-80da61ad5d1c None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:32:56.652727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-b833740e-ea4a-42f4-a424-80da61ad5d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:56.735679 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1260/2496] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:32:56.743653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5623e15-29c2-4ad3-abba-8006d2eeebe7 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:56.743937 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5623e15-29c2-4ad3-abba-8006d2eeebe7 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:56.744397 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5623e15-29c2-4ad3-abba-8006d2eeebe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:56.767354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-b5623e15-29c2-4ad3-abba-8006d2eeebe7 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:32:56.768662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-b5623e15-29c2-4ad3-abba-8006d2eeebe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:56.778761 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1237/2497] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:32:56.786934 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833740e-ea4a-42f4-a424-80da61ad5d1c None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:56.800212 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833740e-ea4a-42f4-a424-80da61ad5d1c None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:56.806102 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d0468-a544-46ad-b881-ffb83169e30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:56.807080 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d0468-a544-46ad-b881-ffb83169e30e admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:56.807407 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d0468-a544-46ad-b881-ffb83169e30e admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:56.807824 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d0468-a544-46ad-b881-ffb83169e30e admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:56.808393 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d0468-a544-46ad-b881-ffb83169e30e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:32:56.808692 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d0468-a544-46ad-b881-ffb83169e30e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:56.810677 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d0468-a544-46ad-b881-ffb83169e30e admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:56.849128 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1261/2498] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:32:56.854493 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5623e15-29c2-4ad3-abba-8006d2eeebe7 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:56.868758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5623e15-29c2-4ad3-abba-8006d2eeebe7 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:56.893110 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f824ae3-15f8-4ec4-8ed2-aac60d02f529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:56.893782 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f824ae3-15f8-4ec4-8ed2-aac60d02f529 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:56.894099 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f824ae3-15f8-4ec4-8ed2-aac60d02f529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:56.894495 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f824ae3-15f8-4ec4-8ed2-aac60d02f529 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:56.895170 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f824ae3-15f8-4ec4-8ed2-aac60d02f529 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:56.897882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f824ae3-15f8-4ec4-8ed2-aac60d02f529 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:57.065496 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1238/2499] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:32:56 2022] POST /identity/v3/projects => generated 381 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:32:57.069604 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d0468-a544-46ad-b881-ffb83169e30e admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:57.080389 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d0468-a544-46ad-b881-ffb83169e30e admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:57.133794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:32:57.144792 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bcc865-15a5-4827-b2a2-da6c72e979d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:57.144792 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcc865-15a5-4827-b2a2-da6c72e979d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:57.145129 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcc865-15a5-4827-b2a2-da6c72e979d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:57.145372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcc865-15a5-4827-b2a2-da6c72e979d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:57.145884 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bcc865-15a5-4827-b2a2-da6c72e979d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:57.148516 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bcc865-15a5-4827-b2a2-da6c72e979d5 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:57.339419 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1262/2500] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:32:57 2022] POST /identity/v3/users => generated 291 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:32:57.343640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f824ae3-15f8-4ec4-8ed2-aac60d02f529 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:57.355219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f824ae3-15f8-4ec4-8ed2-aac60d02f529 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:57.360596 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb0b6c-254b-4030-8df4-31e92a82fdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:57.361393 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb0b6c-254b-4030-8df4-31e92a82fdca admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:57.361674 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb0b6c-254b-4030-8df4-31e92a82fdca admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:57.361940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb0b6c-254b-4030-8df4-31e92a82fdca admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:57.362601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb0b6c-254b-4030-8df4-31e92a82fdca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:57.364506 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb0b6c-254b-4030-8df4-31e92a82fdca admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:57.378232 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1239/2501] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:32:57.383165 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bcc865-15a5-4827-b2a2-da6c72e979d5 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:57.399885 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bcc865-15a5-4827-b2a2-da6c72e979d5 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:57.408820 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6371e-2502-48ab-9258-f9b8341b96f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:57.409806 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6371e-2502-48ab-9258-f9b8341b96f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:57.410094 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6371e-2502-48ab-9258-f9b8341b96f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:57.410402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6371e-2502-48ab-9258-f9b8341b96f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:57.411055 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6371e-2502-48ab-9258-f9b8341b96f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:57.413535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6371e-2502-48ab-9258-f9b8341b96f9 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:57.425537 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1263/2502] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:32:57.430087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb0b6c-254b-4030-8df4-31e92a82fdca admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:57.441177 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb0b6c-254b-4030-8df4-31e92a82fdca admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:57.446884 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac44f4-9e54-4a92-bb6f-a66812fd7880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:57.447637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac44f4-9e54-4a92-bb6f-a66812fd7880 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:57.453990 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac44f4-9e54-4a92-bb6f-a66812fd7880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:57.453990 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac44f4-9e54-4a92-bb6f-a66812fd7880 admin admin] PATH_INFO: `/v3/projects/581b369e80a343b3901b03d102d89645/users/a08a5270653e41c4b75f6af3d2598a8c/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:57.466395 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac44f4-9e54-4a92-bb6f-a66812fd7880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=581b369e80a343b3901b03d102d89645, user_id=a08a5270653e41c4b75f6af3d2598a8c, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:57.469221 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac44f4-9e54-4a92-bb6f-a66812fd7880 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:57.511020 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdeaf60-8bd3-4b83-9dc1-1699b5056e30 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:57.517153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdeaf60-8bd3-4b83-9dc1-1699b5056e30 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:57.517153 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdeaf60-8bd3-4b83-9dc1-1699b5056e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:57.556409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-0fdeaf60-8bd3-4b83-9dc1-1699b5056e30 None None] MFA Rules not processed for user `c314372147b2491cb4481d538056472c`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:32:57.557660 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-0fdeaf60-8bd3-4b83-9dc1-1699b5056e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:57.588643 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1240/2503] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:32:57 2022] PUT /identity/v3/projects/581b369e80a343b3901b03d102d89645/users/a08a5270653e41c4b75f6af3d2598a8c/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:32:57.590180 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fa3b6-0da2-40bc-8b3c-8ab5d5345fde None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:57.590488 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fa3b6-0da2-40bc-8b3c-8ab5d5345fde None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:57.590869 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fa3b6-0da2-40bc-8b3c-8ab5d5345fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:57.664096 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-b91fa3b6-0da2-40bc-8b3c-8ab5d5345fde None None] MFA Rules not processed for user `a08a5270653e41c4b75f6af3d2598a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:32:57.670355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-b91fa3b6-0da2-40bc-8b3c-8ab5d5345fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:57.687011 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1264/2504] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Sep 6 20:32:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:32:57.743050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdeaf60-8bd3-4b83-9dc1-1699b5056e30 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:57.745275 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-0fdeaf60-8bd3-4b83-9dc1-1699b5056e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:57.770330 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1241/2505] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:32:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:32:57.775701 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fa3b6-0da2-40bc-8b3c-8ab5d5345fde None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:57.847271 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdeaf60-8bd3-4b83-9dc1-1699b5056e30 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:57.873192 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fa3b6-0da2-40bc-8b3c-8ab5d5345fde None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:57.890592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008733c-f327-42c7-adff-4b8187f529b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:57.891716 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008733c-f327-42c7-adff-4b8187f529b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:57.892337 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008733c-f327-42c7-adff-4b8187f529b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:57.893181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008733c-f327-42c7-adff-4b8187f529b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:57.894036 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008733c-f327-42c7-adff-4b8187f529b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:57.896974 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008733c-f327-42c7-adff-4b8187f529b8 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:57.932890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f366792-fca3-4f20-bd0a-7a6216fa9557 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6c4f91a59548fd979e7232a2afd6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:57.933582 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f366792-fca3-4f20-bd0a-7a6216fa9557 service swift] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:57.933865 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f366792-fca3-4f20-bd0a-7a6216fa9557 service swift] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:57.934139 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f366792-fca3-4f20-bd0a-7a6216fa9557 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:57.956848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:32:58.012452 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f366792-fca3-4f20-bd0a-7a6216fa9557 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:58.014293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f366792-fca3-4f20-bd0a-7a6216fa9557 service swift] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:58.024072 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1265/2506] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Sep 6 20:32:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 20:32:58.089245 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1242/2507] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:32:57 2022] POST /identity/v3/projects => generated 379 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:32:58.090678 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f366792-fca3-4f20-bd0a-7a6216fa9557 service swift] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:58.119797 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f366792-fca3-4f20-bd0a-7a6216fa9557 service swift] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:58.214673 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddf18f-5ea9-4742-8cc8-1148fa140b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:58.215403 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddf18f-5ea9-4742-8cc8-1148fa140b44 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:58.215797 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddf18f-5ea9-4742-8cc8-1148fa140b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:58.219547 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddf18f-5ea9-4742-8cc8-1148fa140b44 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:58.220337 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddf18f-5ea9-4742-8cc8-1148fa140b44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:58.222537 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddf18f-5ea9-4742-8cc8-1148fa140b44 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:58.394024 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1266/2508] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:32:58 2022] POST /identity/v3/users => generated 296 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:32:58.399698 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008733c-f327-42c7-adff-4b8187f529b8 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:58.429639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008733c-f327-42c7-adff-4b8187f529b8 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:58.457251 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0f4ef-44d0-4c79-a226-56dd3c086afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:58.458652 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0f4ef-44d0-4c79-a226-56dd3c086afc admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:58.460429 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0f4ef-44d0-4c79-a226-56dd3c086afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:58.461117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0f4ef-44d0-4c79-a226-56dd3c086afc admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:58.465803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a0f4ef-44d0-4c79-a226-56dd3c086afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:58.469938 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a0f4ef-44d0-4c79-a226-56dd3c086afc admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:58.473691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:32:58.502753 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1243/2509] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:32:58.508574 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddf18f-5ea9-4742-8cc8-1148fa140b44 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:58.530226 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddf18f-5ea9-4742-8cc8-1148fa140b44 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:58.536561 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2dc8c-2617-4490-8ef4-23925a52d25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:58.538323 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2dc8c-2617-4490-8ef4-23925a52d25f admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:58.538770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2dc8c-2617-4490-8ef4-23925a52d25f admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:58.539214 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2dc8c-2617-4490-8ef4-23925a52d25f admin admin] PATH_INFO: `/v3/projects/5f03089306c041efa4a34bd46bf5f468/users/9b00fe4a4df445e0b9b46c7e3e2732cb/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:58.560423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2dc8c-2617-4490-8ef4-23925a52d25f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f03089306c041efa4a34bd46bf5f468, user_id=9b00fe4a4df445e0b9b46c7e3e2732cb, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:58.563887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2dc8c-2617-4490-8ef4-23925a52d25f admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:58.730006 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1267/2510] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:32:58 2022] PUT /identity/v3/projects/5f03089306c041efa4a34bd46bf5f468/users/9b00fe4a4df445e0b9b46c7e3e2732cb/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:32:58.734356 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0f4ef-44d0-4c79-a226-56dd3c086afc admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:58.748061 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0f4ef-44d0-4c79-a226-56dd3c086afc admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:58.869583 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b00c1-f29b-430b-b730-96325885983a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:58.870957 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b00c1-f29b-430b-b730-96325885983a admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:58.871583 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b00c1-f29b-430b-b730-96325885983a admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:58.872075 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b00c1-f29b-430b-b730-96325885983a admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:58.872977 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b00c1-f29b-430b-b730-96325885983a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:58.875707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b00c1-f29b-430b-b730-96325885983a admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:58.893655 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1244/2511] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:32:58.898774 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2dc8c-2617-4490-8ef4-23925a52d25f admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:58.916520 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2dc8c-2617-4490-8ef4-23925a52d25f admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:58.930168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c02491-e978-49be-a507-b80a9ceaece4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:58.930891 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c02491-e978-49be-a507-b80a9ceaece4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:58.931166 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c02491-e978-49be-a507-b80a9ceaece4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:58.931700 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c02491-e978-49be-a507-b80a9ceaece4 admin admin] PATH_INFO: `/v3/projects/5f03089306c041efa4a34bd46bf5f468/users/9b00fe4a4df445e0b9b46c7e3e2732cb/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:58.936771 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c02491-e978-49be-a507-b80a9ceaece4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f03089306c041efa4a34bd46bf5f468, user_id=9b00fe4a4df445e0b9b46c7e3e2732cb, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:58.940887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c02491-e978-49be-a507-b80a9ceaece4 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:58.970293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1268/2512] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:32:58 2022] PUT /identity/v3/projects/5f03089306c041efa4a34bd46bf5f468/users/9b00fe4a4df445e0b9b46c7e3e2732cb/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:32:58.986663 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab58fe-f32b-4344-8dc1-02031f5f774e None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:58.986982 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab58fe-f32b-4344-8dc1-02031f5f774e None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:58.987352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab58fe-f32b-4344-8dc1-02031f5f774e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:59.091083 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-c5ab58fe-f32b-4344-8dc1-02031f5f774e None None] MFA Rules not processed for user `9b00fe4a4df445e0b9b46c7e3e2732cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:32:59.092801 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c5ab58fe-f32b-4344-8dc1-02031f5f774e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:59.160776 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c02491-e978-49be-a507-b80a9ceaece4 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:59.164257 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-96c02491-e978-49be-a507-b80a9ceaece4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:59.250812 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1245/2513] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:32:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:32:59.270212 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab58fe-f32b-4344-8dc1-02031f5f774e None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:59.272686 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c5ab58fe-f32b-4344-8dc1-02031f5f774e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:59.286388 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c02491-e978-49be-a507-b80a9ceaece4 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:59.293174 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69de37-72ff-49dd-b5a4-552bad113baa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:59.294107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69de37-72ff-49dd-b5a4-552bad113baa service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:59.294722 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69de37-72ff-49dd-b5a4-552bad113baa service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:59.295161 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69de37-72ff-49dd-b5a4-552bad113baa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:59.298024 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-1b69de37-72ff-49dd-b5a4-552bad113baa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:32:59.309881 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:32:59.313424 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69de37-72ff-49dd-b5a4-552bad113baa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:59.315474 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69de37-72ff-49dd-b5a4-552bad113baa service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:59.332364 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1269/2514] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:32:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:32:59.443276 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab58fe-f32b-4344-8dc1-02031f5f774e None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:59.447613 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f0730-3f61-4460-bded-2e9dd3044396 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:59.450712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f0730-3f61-4460-bded-2e9dd3044396 service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:59.450712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f0730-3f61-4460-bded-2e9dd3044396 service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:59.450712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f0730-3f61-4460-bded-2e9dd3044396 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:59.460987 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f0730-3f61-4460-bded-2e9dd3044396 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:59.462927 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f0730-3f61-4460-bded-2e9dd3044396 service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:59.478771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1246/2515] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:32:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:32:59.734191 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69de37-72ff-49dd-b5a4-552bad113baa service nova] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:32:59.745643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69de37-72ff-49dd-b5a4-552bad113baa service nova] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:32:59.750063 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910333d-578c-4604-ae21-b1a32c1b384e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:32:59.750701 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910333d-578c-4604-ae21-b1a32c1b384e service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:32:59.750986 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910333d-578c-4604-ae21-b1a32c1b384e service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:32:59.751264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910333d-578c-4604-ae21-b1a32c1b384e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:32:59.840263 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910333d-578c-4604-ae21-b1a32c1b384e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:32:59.841749 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910333d-578c-4604-ae21-b1a32c1b384e service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:32:59.858648 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1270/2516] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:32:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:33:09.469774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=91 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:09.848531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=30 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:13.713896 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f0730-3f61-4460-bded-2e9dd3044396 service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:13.780402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f0730-3f61-4460-bded-2e9dd3044396 service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:13.785314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53d54f-94a9-4606-9b2b-e26f629c4d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:13.785959 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53d54f-94a9-4606-9b2b-e26f629c4d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:13.786246 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53d54f-94a9-4606-9b2b-e26f629c4d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:13.786522 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53d54f-94a9-4606-9b2b-e26f629c4d2e admin admin] PATH_INFO: `/v3/users/a08a5270653e41c4b75f6af3d2598a8c` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:13.787735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53d54f-94a9-4606-9b2b-e26f629c4d2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a08a5270653e41c4b75f6af3d2598a8c)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:13.789780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53d54f-94a9-4606-9b2b-e26f629c4d2e admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:14.104420 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-6b53d54f-94a9-4606-9b2b-e26f629c4d2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a08a5270653e41c4b75f6af3d2598a8c'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:14.239734 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-6b53d54f-94a9-4606-9b2b-e26f629c4d2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a08a5270653e41c4b75f6af3d2598a8c'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:14.240985 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-6b53d54f-94a9-4606-9b2b-e26f629c4d2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a08a5270653e41c4b75f6af3d2598a8c'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:14.241620 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-6b53d54f-94a9-4606-9b2b-e26f629c4d2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a08a5270653e41c4b75f6af3d2598a8c'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:14.249784 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-6b53d54f-94a9-4606-9b2b-e26f629c4d2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a08a5270653e41c4b75f6af3d2598a8c'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:14.268464 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1247/2517] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:33:13 2022] DELETE /identity/v3/users/a08a5270653e41c4b75f6af3d2598a8c => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:33:14.273172 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b5ffa-2f08-4ecd-968f-ae4a5e95cbe3 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:14.274506 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b5ffa-2f08-4ecd-968f-ae4a5e95cbe3 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:14.274506 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b5ffa-2f08-4ecd-968f-ae4a5e95cbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:14.293814 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-929b5ffa-2f08-4ecd-968f-ae4a5e95cbe3 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:14.294945 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-929b5ffa-2f08-4ecd-968f-ae4a5e95cbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:14.368813 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1271/2518] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:33:14.383198 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53d54f-94a9-4606-9b2b-e26f629c4d2e admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:14.387007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6b53d54f-94a9-4606-9b2b-e26f629c4d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:14.485266 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53d54f-94a9-4606-9b2b-e26f629c4d2e admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:14.492383 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1043143-c78b-4b86-9889-a4821116a48f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:14.493463 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1043143-c78b-4b86-9889-a4821116a48f service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:14.493952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1043143-c78b-4b86-9889-a4821116a48f service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:14.494444 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1043143-c78b-4b86-9889-a4821116a48f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:14.512043 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1043143-c78b-4b86-9889-a4821116a48f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:14.514862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1043143-c78b-4b86-9889-a4821116a48f service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:14.533626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1248/2519] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:33:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:33:15.103693 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b5ffa-2f08-4ecd-968f-ae4a5e95cbe3 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:15.105180 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-929b5ffa-2f08-4ecd-968f-ae4a5e95cbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:15.119615 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b5ffa-2f08-4ecd-968f-ae4a5e95cbe3 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:15.125305 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b386b3a-ab4e-44e7-8beb-4713c08a4a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:15.125833 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b386b3a-ab4e-44e7-8beb-4713c08a4a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:15.126132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b386b3a-ab4e-44e7-8beb-4713c08a4a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:15.126412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b386b3a-ab4e-44e7-8beb-4713c08a4a20 admin admin] PATH_INFO: `/v3/projects/581b369e80a343b3901b03d102d89645` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:15.128544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b386b3a-ab4e-44e7-8beb-4713c08a4a20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=581b369e80a343b3901b03d102d89645)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:15.133304 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b386b3a-ab4e-44e7-8beb-4713c08a4a20 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:15.281266 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9105d63-5185-4e75-9f64-ed1fe33b08b3 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:15.281826 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9105d63-5185-4e75-9f64-ed1fe33b08b3 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:15.281826 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9105d63-5185-4e75-9f64-ed1fe33b08b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:15.308313 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-f9105d63-5185-4e75-9f64-ed1fe33b08b3 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:15.309135 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f9105d63-5185-4e75-9f64-ed1fe33b08b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:15.325702 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1249/2520] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Sep 6 20:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:33:15.345927 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9105d63-5185-4e75-9f64-ed1fe33b08b3 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:15.347528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f9105d63-5185-4e75-9f64-ed1fe33b08b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:15.378699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:15.386912 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1b386b3a-ab4e-44e7-8beb-4713c08a4a20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '581b369e80a343b3901b03d102d89645', 'request_id': 'req-1b386b3a-ab4e-44e7-8beb-4713c08a4a20'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:15.398752 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1b386b3a-ab4e-44e7-8beb-4713c08a4a20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '581b369e80a343b3901b03d102d89645', 'request_id': 'req-1b386b3a-ab4e-44e7-8beb-4713c08a4a20'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:15.456050 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9105d63-5185-4e75-9f64-ed1fe33b08b3 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:15.534541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156561bf-6d70-4aef-a30b-5a333411b03d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:15.535193 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156561bf-6d70-4aef-a30b-5a333411b03d service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:15.535516 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156561bf-6d70-4aef-a30b-5a333411b03d service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:15.535805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156561bf-6d70-4aef-a30b-5a333411b03d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:15.607738 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156561bf-6d70-4aef-a30b-5a333411b03d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:15.609449 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156561bf-6d70-4aef-a30b-5a333411b03d service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:15.620192 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1250/2521] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:33:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:33:15.626276 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1b386b3a-ab4e-44e7-8beb-4713c08a4a20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '581b369e80a343b3901b03d102d89645', 'request_id': 'req-1b386b3a-ab4e-44e7-8beb-4713c08a4a20'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:15.641263 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1b386b3a-ab4e-44e7-8beb-4713c08a4a20 admin admin] The token cache is being invalidate because project 581b369e80a343b3901b03d102d89645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:33:15.641688 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1b386b3a-ab4e-44e7-8beb-4713c08a4a20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:15.642533 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1b386b3a-ab4e-44e7-8beb-4713c08a4a20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:15.644103 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1272/2522] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:33:15 2022] DELETE /identity/v3/projects/581b369e80a343b3901b03d102d89645 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:33:15.648684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156561bf-6d70-4aef-a30b-5a333411b03d service nova] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:15.660693 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156561bf-6d70-4aef-a30b-5a333411b03d service nova] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:15.666247 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397a4d7-9bf7-49ce-afd4-19eb74c4fedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:15.667168 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397a4d7-9bf7-49ce-afd4-19eb74c4fedb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:15.667346 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397a4d7-9bf7-49ce-afd4-19eb74c4fedb admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:15.667741 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397a4d7-9bf7-49ce-afd4-19eb74c4fedb admin admin] PATH_INFO: `/v3/users/9b00fe4a4df445e0b9b46c7e3e2732cb` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:15.668863 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397a4d7-9bf7-49ce-afd4-19eb74c4fedb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b00fe4a4df445e0b9b46c7e3e2732cb)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:15.671684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397a4d7-9bf7-49ce-afd4-19eb74c4fedb admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:15.968707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-3397a4d7-9bf7-49ce-afd4-19eb74c4fedb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b00fe4a4df445e0b9b46c7e3e2732cb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:16.156000 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-3397a4d7-9bf7-49ce-afd4-19eb74c4fedb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b00fe4a4df445e0b9b46c7e3e2732cb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:16.156770 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-3397a4d7-9bf7-49ce-afd4-19eb74c4fedb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b00fe4a4df445e0b9b46c7e3e2732cb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:16.157492 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-3397a4d7-9bf7-49ce-afd4-19eb74c4fedb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b00fe4a4df445e0b9b46c7e3e2732cb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:16.167880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-3397a4d7-9bf7-49ce-afd4-19eb74c4fedb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b00fe4a4df445e0b9b46c7e3e2732cb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:16.193314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1251/2523] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:33:15 2022] DELETE /identity/v3/users/9b00fe4a4df445e0b9b46c7e3e2732cb => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:33:16.913323 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b386b3a-ab4e-44e7-8beb-4713c08a4a20 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:16.917615 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-1b386b3a-ab4e-44e7-8beb-4713c08a4a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:16.950999 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b386b3a-ab4e-44e7-8beb-4713c08a4a20 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:17.026953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa719c1a-c5c2-40d3-8efb-438cedba4fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:17.027975 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa719c1a-c5c2-40d3-8efb-438cedba4fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:17.028454 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa719c1a-c5c2-40d3-8efb-438cedba4fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:17.028855 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa719c1a-c5c2-40d3-8efb-438cedba4fa8 admin admin] PATH_INFO: `/v3/projects/5f03089306c041efa4a34bd46bf5f468` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:17.030489 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa719c1a-c5c2-40d3-8efb-438cedba4fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f03089306c041efa4a34bd46bf5f468)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:17.032917 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa719c1a-c5c2-40d3-8efb-438cedba4fa8 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:17.059600 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:17.317702 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:17.345803 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-aa719c1a-c5c2-40d3-8efb-438cedba4fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f03089306c041efa4a34bd46bf5f468', 'request_id': 'req-aa719c1a-c5c2-40d3-8efb-438cedba4fa8'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:17.353660 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-aa719c1a-c5c2-40d3-8efb-438cedba4fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f03089306c041efa4a34bd46bf5f468', 'request_id': 'req-aa719c1a-c5c2-40d3-8efb-438cedba4fa8'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:17.462609 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-aa719c1a-c5c2-40d3-8efb-438cedba4fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f03089306c041efa4a34bd46bf5f468', 'request_id': 'req-aa719c1a-c5c2-40d3-8efb-438cedba4fa8'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:17.480448 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-aa719c1a-c5c2-40d3-8efb-438cedba4fa8 admin admin] The token cache is being invalidate because project 5f03089306c041efa4a34bd46bf5f468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:33:17.480956 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-aa719c1a-c5c2-40d3-8efb-438cedba4fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:17.483284 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-aa719c1a-c5c2-40d3-8efb-438cedba4fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:17.484748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1273/2524] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:33:16 2022] DELETE /identity/v3/projects/5f03089306c041efa4a34bd46bf5f468 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:33:17.492677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf504b-97a0-4aba-82b6-a8a0da84f430 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:17.493068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf504b-97a0-4aba-82b6-a8a0da84f430 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:17.493490 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf504b-97a0-4aba-82b6-a8a0da84f430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:17.547245 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-b2cf504b-97a0-4aba-82b6-a8a0da84f430 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:17.550976 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-b2cf504b-97a0-4aba-82b6-a8a0da84f430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:17.689672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1252/2525] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:33:17.698921 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003daed-d3a9-41cd-a614-3b5b8dafd5e8 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:17.699669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003daed-d3a9-41cd-a614-3b5b8dafd5e8 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:17.700038 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003daed-d3a9-41cd-a614-3b5b8dafd5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:17.722037 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-a003daed-d3a9-41cd-a614-3b5b8dafd5e8 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:17.733450 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-a003daed-d3a9-41cd-a614-3b5b8dafd5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:17.733450 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1274/2526] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:33:17.739747 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf504b-97a0-4aba-82b6-a8a0da84f430 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:17.753057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf504b-97a0-4aba-82b6-a8a0da84f430 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:17.770885 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d7d2b-3e6e-4970-aed7-6fb96431ee89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:17.770885 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d7d2b-3e6e-4970-aed7-6fb96431ee89 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:17.770885 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d7d2b-3e6e-4970-aed7-6fb96431ee89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:17.770885 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d7d2b-3e6e-4970-aed7-6fb96431ee89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:17.771627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d7d2b-3e6e-4970-aed7-6fb96431ee89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:33:17.771627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d7d2b-3e6e-4970-aed7-6fb96431ee89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:17.771627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d7d2b-3e6e-4970-aed7-6fb96431ee89 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:17.786638 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1253/2527] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:33:17.792118 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003daed-d3a9-41cd-a614-3b5b8dafd5e8 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:17.804416 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003daed-d3a9-41cd-a614-3b5b8dafd5e8 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:17.810126 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a522624-489b-4c23-84a6-d4e06c993196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:17.810932 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a522624-489b-4c23-84a6-d4e06c993196 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:17.811351 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a522624-489b-4c23-84a6-d4e06c993196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:17.819104 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a522624-489b-4c23-84a6-d4e06c993196 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:17.819104 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a522624-489b-4c23-84a6-d4e06c993196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:17.819104 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a522624-489b-4c23-84a6-d4e06c993196 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:17.985057 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1275/2528] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:33:17 2022] POST /identity/v3/projects => generated 363 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:33:17.992261 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d7d2b-3e6e-4970-aed7-6fb96431ee89 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:18.013333 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d7d2b-3e6e-4970-aed7-6fb96431ee89 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:18.112531 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38329df-2e2a-496d-abe1-f997daea8079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:18.113376 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38329df-2e2a-496d-abe1-f997daea8079 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:18.113523 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38329df-2e2a-496d-abe1-f997daea8079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:18.113751 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38329df-2e2a-496d-abe1-f997daea8079 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:18.114580 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38329df-2e2a-496d-abe1-f997daea8079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:18.117470 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38329df-2e2a-496d-abe1-f997daea8079 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:18.297586 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1254/2529] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:33:17 2022] POST /identity/v3/users => generated 282 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:33:18.300839 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a522624-489b-4c23-84a6-d4e06c993196 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:18.316186 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a522624-489b-4c23-84a6-d4e06c993196 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:18.321653 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837a280-ccd2-4e1b-883f-64b2296c890d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:18.322372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837a280-ccd2-4e1b-883f-64b2296c890d admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:18.322650 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837a280-ccd2-4e1b-883f-64b2296c890d admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:18.322928 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837a280-ccd2-4e1b-883f-64b2296c890d admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:18.323673 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837a280-ccd2-4e1b-883f-64b2296c890d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:18.325957 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837a280-ccd2-4e1b-883f-64b2296c890d admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:18.340935 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1276/2530] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:33:18.346583 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38329df-2e2a-496d-abe1-f997daea8079 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:18.359539 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38329df-2e2a-496d-abe1-f997daea8079 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:18.366122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0a05b-7f62-4c8f-9777-8d1824053d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:18.366884 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0a05b-7f62-4c8f-9777-8d1824053d73 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:18.367276 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0a05b-7f62-4c8f-9777-8d1824053d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:18.367782 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0a05b-7f62-4c8f-9777-8d1824053d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:18.368676 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0a05b-7f62-4c8f-9777-8d1824053d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:18.370705 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0a05b-7f62-4c8f-9777-8d1824053d73 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:18.391501 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1255/2531] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:33:18.418022 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837a280-ccd2-4e1b-883f-64b2296c890d admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:18.433195 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837a280-ccd2-4e1b-883f-64b2296c890d admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:18.439237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c47cd-b747-4e2e-9a8e-598bb93105d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:18.440135 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c47cd-b747-4e2e-9a8e-598bb93105d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:18.440573 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c47cd-b747-4e2e-9a8e-598bb93105d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:18.440982 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c47cd-b747-4e2e-9a8e-598bb93105d4 admin admin] PATH_INFO: `/v3/projects/40c15902f5bf4b61a2bec3259659ef6d/users/2442ea41d33841f6a67aa8fc4b4d9f59/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:18.469143 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c47cd-b747-4e2e-9a8e-598bb93105d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c15902f5bf4b61a2bec3259659ef6d, user_id=2442ea41d33841f6a67aa8fc4b4d9f59, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:18.472430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c47cd-b747-4e2e-9a8e-598bb93105d4 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:18.575830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1277/2532] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:33:18 2022] PUT /identity/v3/projects/40c15902f5bf4b61a2bec3259659ef6d/users/2442ea41d33841f6a67aa8fc4b4d9f59/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:33:18.588957 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dd716-f45c-4e5b-9b35-c8db41c9a1c1 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:18.589405 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dd716-f45c-4e5b-9b35-c8db41c9a1c1 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:18.590100 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dd716-f45c-4e5b-9b35-c8db41c9a1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:18.644390 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-648dd716-f45c-4e5b-9b35-c8db41c9a1c1 None None] MFA Rules not processed for user `2442ea41d33841f6a67aa8fc4b4d9f59`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:18.647105 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-648dd716-f45c-4e5b-9b35-c8db41c9a1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:18.670037 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:18.760240 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1256/2533] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:33:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:33:18.767364 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c47cd-b747-4e2e-9a8e-598bb93105d4 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:18.950054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c47cd-b747-4e2e-9a8e-598bb93105d4 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:18.957149 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec357c5-0c55-4ab8-a334-c1a13cce7c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:18.958363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec357c5-0c55-4ab8-a334-c1a13cce7c08 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:18.959232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec357c5-0c55-4ab8-a334-c1a13cce7c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:18.959665 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec357c5-0c55-4ab8-a334-c1a13cce7c08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:18.960452 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec357c5-0c55-4ab8-a334-c1a13cce7c08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:18.963574 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec357c5-0c55-4ab8-a334-c1a13cce7c08 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:19.214488 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1278/2534] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:33:18 2022] POST /identity/v3/projects => generated 363 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:33:19.221580 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648dd716-f45c-4e5b-9b35-c8db41c9a1c1 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:19.245264 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648dd716-f45c-4e5b-9b35-c8db41c9a1c1 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:19.366227 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9814285-10c8-4834-a270-814b05f1e802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:19.368784 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9814285-10c8-4834-a270-814b05f1e802 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:19.369692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9814285-10c8-4834-a270-814b05f1e802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:19.370421 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9814285-10c8-4834-a270-814b05f1e802 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:19.372167 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9814285-10c8-4834-a270-814b05f1e802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:19.387707 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec357c5-0c55-4ab8-a334-c1a13cce7c08 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:19.389307 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9814285-10c8-4834-a270-814b05f1e802 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:19.390083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-7ec357c5-0c55-4ab8-a334-c1a13cce7c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:19.497458 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:19.558456 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1257/2535] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:33:19 2022] POST /identity/v3/users => generated 288 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:33:19.565772 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9814285-10c8-4834-a270-814b05f1e802 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:19.572193 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec357c5-0c55-4ab8-a334-c1a13cce7c08 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:19.578868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9814285-10c8-4834-a270-814b05f1e802 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:19.580537 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35917e8-c568-49e6-85df-3722f31d7b57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:19.581165 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35917e8-c568-49e6-85df-3722f31d7b57 service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:19.581437 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35917e8-c568-49e6-85df-3722f31d7b57 service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:19.581705 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35917e8-c568-49e6-85df-3722f31d7b57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:19.586587 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-c35917e8-c568-49e6-85df-3722f31d7b57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:19.591130 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3ead2-af91-4d00-9f39-364337f1c517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:19.592898 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3ead2-af91-4d00-9f39-364337f1c517 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:19.592898 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3ead2-af91-4d00-9f39-364337f1c517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:19.592898 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3ead2-af91-4d00-9f39-364337f1c517 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:19.593217 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3ead2-af91-4d00-9f39-364337f1c517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:19.597582 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3ead2-af91-4d00-9f39-364337f1c517 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:19.620573 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35917e8-c568-49e6-85df-3722f31d7b57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:19.622926 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35917e8-c568-49e6-85df-3722f31d7b57 service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:19.623143 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1258/2536] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:33:19.627110 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3ead2-af91-4d00-9f39-364337f1c517 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:19.643330 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3ead2-af91-4d00-9f39-364337f1c517 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:19.644240 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1279/2537] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:33:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:33:19.669559 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb8f16-0821-45db-8930-3edd56fef3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:19.673087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb8f16-0821-45db-8930-3edd56fef3df admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:19.673087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb8f16-0821-45db-8930-3edd56fef3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:19.673087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb8f16-0821-45db-8930-3edd56fef3df admin admin] PATH_INFO: `/v3/projects/58fa317301144380be13a85ac5a5bdd1/users/d4b61d84f93d4c32a6a231884d4cb197/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:19.704819 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb8f16-0821-45db-8930-3edd56fef3df admin admin] RBAC: Authorizing `identity:create_grant(project_id=58fa317301144380be13a85ac5a5bdd1, user_id=d4b61d84f93d4c32a6a231884d4cb197, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:19.711135 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb8f16-0821-45db-8930-3edd56fef3df admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:19.918238 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1259/2538] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:33:19 2022] PUT /identity/v3/projects/58fa317301144380be13a85ac5a5bdd1/users/d4b61d84f93d4c32a6a231884d4cb197/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:33:19.925271 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35917e8-c568-49e6-85df-3722f31d7b57 service nova] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:19.952408 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35917e8-c568-49e6-85df-3722f31d7b57 service nova] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:20.093576 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bc197-e65e-4919-a68f-0246e84bb08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:20.094233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bc197-e65e-4919-a68f-0246e84bb08e admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:20.094518 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bc197-e65e-4919-a68f-0246e84bb08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:20.094841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bc197-e65e-4919-a68f-0246e84bb08e admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:20.095747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731bc197-e65e-4919-a68f-0246e84bb08e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:20.107210 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731bc197-e65e-4919-a68f-0246e84bb08e admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:20.111023 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1280/2539] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:33:20.118381 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb8f16-0821-45db-8930-3edd56fef3df admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:20.132207 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb8f16-0821-45db-8930-3edd56fef3df admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:20.140793 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e223267-5003-4f98-97c6-a9566c618ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:20.142536 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e223267-5003-4f98-97c6-a9566c618ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:20.143212 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e223267-5003-4f98-97c6-a9566c618ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:20.144373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e223267-5003-4f98-97c6-a9566c618ef4 admin admin] PATH_INFO: `/v3/projects/58fa317301144380be13a85ac5a5bdd1/users/d4b61d84f93d4c32a6a231884d4cb197/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:20.148750 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e223267-5003-4f98-97c6-a9566c618ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58fa317301144380be13a85ac5a5bdd1, user_id=d4b61d84f93d4c32a6a231884d4cb197, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:20.155144 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e223267-5003-4f98-97c6-a9566c618ef4 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:20.174805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1260/2540] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:33:20 2022] PUT /identity/v3/projects/58fa317301144380be13a85ac5a5bdd1/users/d4b61d84f93d4c32a6a231884d4cb197/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:33:20.194877 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f40d0-bb35-41ab-91e8-5a850185ed51 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:20.195667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f40d0-bb35-41ab-91e8-5a850185ed51 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:20.196235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f40d0-bb35-41ab-91e8-5a850185ed51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:20.249078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-a59f40d0-bb35-41ab-91e8-5a850185ed51 None None] MFA Rules not processed for user `d4b61d84f93d4c32a6a231884d4cb197`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:20.251016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-a59f40d0-bb35-41ab-91e8-5a850185ed51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:20.358491 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1281/2541] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:33:20 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:33:20.711666 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e223267-5003-4f98-97c6-a9566c618ef4 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:20.715190 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-7e223267-5003-4f98-97c6-a9566c618ef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:20.874084 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e223267-5003-4f98-97c6-a9566c618ef4 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:20.877503 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e982119-210d-413d-9c57-b810960b9571 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:20.878595 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e982119-210d-413d-9c57-b810960b9571 service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:20.879086 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e982119-210d-413d-9c57-b810960b9571 service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:20.879664 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e982119-210d-413d-9c57-b810960b9571 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:20.899493 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e982119-210d-413d-9c57-b810960b9571 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:20.903869 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e982119-210d-413d-9c57-b810960b9571 service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:20.923098 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1261/2542] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:33:20 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:33:21.529514 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42bcc7-b2e7-4e43-a79f-cb1f894798b5 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:21.530200 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42bcc7-b2e7-4e43-a79f-cb1f894798b5 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:21.530716 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42bcc7-b2e7-4e43-a79f-cb1f894798b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:21.564773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-3d42bcc7-b2e7-4e43-a79f-cb1f894798b5 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:21.566536 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-3d42bcc7-b2e7-4e43-a79f-cb1f894798b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:21.621863 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:21.695561 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1282/2543] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Sep 6 20:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:33:21.783717 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e982119-210d-413d-9c57-b810960b9571 service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:21.783717 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-3e982119-210d-413d-9c57-b810960b9571 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:21.890787 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e982119-210d-413d-9c57-b810960b9571 service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:21.900127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ac929-e1a4-4ea5-8adb-66b02b5ab58e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:21.904029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ac929-e1a4-4ea5-8adb-66b02b5ab58e service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:21.904029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ac929-e1a4-4ea5-8adb-66b02b5ab58e service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:21.904029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ac929-e1a4-4ea5-8adb-66b02b5ab58e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:21.914592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ac929-e1a4-4ea5-8adb-66b02b5ab58e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:21.916707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ac929-e1a4-4ea5-8adb-66b02b5ab58e service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:21.928810 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1262/2544] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:33:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:33:22.199667 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53871d6f-2844-4ba1-ab6b-dacd6d6fbf6f None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:22.200612 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53871d6f-2844-4ba1-ab6b-dacd6d6fbf6f None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:22.201369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53871d6f-2844-4ba1-ab6b-dacd6d6fbf6f None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:22.210755 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1283/2545] 10.222.0.77 () {54 vars in 921 bytes} [Tue Sep 6 20:33:22 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 20:33:22.220195 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae6c75-0ab4-4652-a225-5888a58d3ed7 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:22.224163 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae6c75-0ab4-4652-a225-5888a58d3ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:22.225526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae6c75-0ab4-4652-a225-5888a58d3ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:22.286222 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-7eae6c75-0ab4-4652-a225-5888a58d3ed7 None None] MFA Rules not processed for user `b09ce16da49b4af38491ad4eb6287d70`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:22.294170 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-7eae6c75-0ab4-4652-a225-5888a58d3ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:22.336123 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1263/2546] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Sep 6 20:33:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:33:22.360099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53871d6f-2844-4ba1-ab6b-dacd6d6fbf6f None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:22.363891 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-53871d6f-2844-4ba1-ab6b-dacd6d6fbf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:22.488811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53871d6f-2844-4ba1-ab6b-dacd6d6fbf6f None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:22.494011 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23d8d9-229c-4907-b01e-47824fb29acc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '871f208a13ba435491022b9ea9b735e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:22.494850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23d8d9-229c-4907-b01e-47824fb29acc service glance] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:22.495199 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23d8d9-229c-4907-b01e-47824fb29acc service glance] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:22.495611 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23d8d9-229c-4907-b01e-47824fb29acc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:22.514873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23d8d9-229c-4907-b01e-47824fb29acc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:22.517477 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23d8d9-229c-4907-b01e-47824fb29acc service glance] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:22.537666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1284/2547] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:33:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:33:22.893883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60d005-8633-47f0-ad59-7b5781c145e7 None None] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:22.894435 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60d005-8633-47f0-ad59-7b5781c145e7 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:22.894435 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60d005-8633-47f0-ad59-7b5781c145e7 None None] PATH_INFO: `/` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:22.896049 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1264/2548] 10.222.0.77 () {54 vars in 921 bytes} [Tue Sep 6 20:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:33:22.902416 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23921f9c-f249-4017-8d87-9a2694312481 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:22.902722 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23921f9c-f249-4017-8d87-9a2694312481 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:22.903134 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23921f9c-f249-4017-8d87-9a2694312481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:22.941821 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-23921f9c-f249-4017-8d87-9a2694312481 None None] MFA Rules not processed for user `5a876d70d9634bf59af5f138e856f75f`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:22.942007 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-23921f9c-f249-4017-8d87-9a2694312481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:22.984060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60d005-8633-47f0-ad59-7b5781c145e7 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:23.013965 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60d005-8633-47f0-ad59-7b5781c145e7 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:23.019848 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47161cef-c3ff-4090-a46f-0ae65d20c320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:23.020736 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47161cef-c3ff-4090-a46f-0ae65d20c320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:23.021042 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47161cef-c3ff-4090-a46f-0ae65d20c320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:23.021480 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47161cef-c3ff-4090-a46f-0ae65d20c320 admin admin] PATH_INFO: `/v3/users/2442ea41d33841f6a67aa8fc4b4d9f59` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:23.022944 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47161cef-c3ff-4090-a46f-0ae65d20c320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2442ea41d33841f6a67aa8fc4b4d9f59)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:23.025006 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47161cef-c3ff-4090-a46f-0ae65d20c320 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:23.056192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1285/2549] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Sep 6 20:33:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:33:23.069359 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23921f9c-f249-4017-8d87-9a2694312481 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:23.070960 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-23921f9c-f249-4017-8d87-9a2694312481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:23.083291 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23921f9c-f249-4017-8d87-9a2694312481 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:23.087907 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4e8a4-38c6-48e3-b8a8-59b4a081ee9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:23.088543 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4e8a4-38c6-48e3-b8a8-59b4a081ee9c service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:23.088819 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4e8a4-38c6-48e3-b8a8-59b4a081ee9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:23.089093 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4e8a4-38c6-48e3-b8a8-59b4a081ee9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:23.097449 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4e8a4-38c6-48e3-b8a8-59b4a081ee9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:23.098922 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4e8a4-38c6-48e3-b8a8-59b4a081ee9c service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:23.109799 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1286/2550] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:33:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:33:23.211559 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd4740-1fd1-40f6-926e-fd5f60d85102 None None] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:23.211559 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd4740-1fd1-40f6-926e-fd5f60d85102 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:23.211559 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd4740-1fd1-40f6-926e-fd5f60d85102 None None] PATH_INFO: `/` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:23.211559 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1287/2551] 10.222.0.77 () {54 vars in 921 bytes} [Tue Sep 6 20:33:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 20:33:23.214609 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f078b-bb0b-42bf-81dd-173a7bb88ced None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:23.214895 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f078b-bb0b-42bf-81dd-173a7bb88ced None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:23.215298 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f078b-bb0b-42bf-81dd-173a7bb88ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:23.238041 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-934f078b-bb0b-42bf-81dd-173a7bb88ced None None] MFA Rules not processed for user `b09ce16da49b4af38491ad4eb6287d70`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:23.239283 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-934f078b-bb0b-42bf-81dd-173a7bb88ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:23.249128 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1288/2552] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Sep 6 20:33:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:33:23.261834 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f078b-bb0b-42bf-81dd-173a7bb88ced None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:23.263320 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-934f078b-bb0b-42bf-81dd-173a7bb88ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:23.277799 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f078b-bb0b-42bf-81dd-173a7bb88ced None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:23.281661 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53aaac2-659f-4d6d-ad55-2ef292637a27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:23.282332 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53aaac2-659f-4d6d-ad55-2ef292637a27 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:23.282657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53aaac2-659f-4d6d-ad55-2ef292637a27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:23.282976 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53aaac2-659f-4d6d-ad55-2ef292637a27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:23.295378 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53aaac2-659f-4d6d-ad55-2ef292637a27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:23.296861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53aaac2-659f-4d6d-ad55-2ef292637a27 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:23.309274 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1289/2553] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:33:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:33:23.342832 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-47161cef-c3ff-4090-a46f-0ae65d20c320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2442ea41d33841f6a67aa8fc4b4d9f59'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:23.481110 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-47161cef-c3ff-4090-a46f-0ae65d20c320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2442ea41d33841f6a67aa8fc4b4d9f59'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:23.481976 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-47161cef-c3ff-4090-a46f-0ae65d20c320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2442ea41d33841f6a67aa8fc4b4d9f59'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:23.482817 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-47161cef-c3ff-4090-a46f-0ae65d20c320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2442ea41d33841f6a67aa8fc4b4d9f59'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:23.495649 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-47161cef-c3ff-4090-a46f-0ae65d20c320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2442ea41d33841f6a67aa8fc4b4d9f59'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:23.535491 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1265/2554] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:33:22 2022] DELETE /identity/v3/users/2442ea41d33841f6a67aa8fc4b4d9f59 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:33:23.541336 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010e448-3978-4a2d-b875-2cf118ee9e4a None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:23.549105 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010e448-3978-4a2d-b875-2cf118ee9e4a None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:23.549105 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010e448-3978-4a2d-b875-2cf118ee9e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:23.589885 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-7010e448-3978-4a2d-b875-2cf118ee9e4a None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:23.592191 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-7010e448-3978-4a2d-b875-2cf118ee9e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:23.677746 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1290/2555] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:33:23.689475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47161cef-c3ff-4090-a46f-0ae65d20c320 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:23.691121 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-47161cef-c3ff-4090-a46f-0ae65d20c320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:23.773691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47161cef-c3ff-4090-a46f-0ae65d20c320 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:23.777905 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6191d-fb36-4a4c-a14f-a470e93a9b15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:23.778800 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6191d-fb36-4a4c-a14f-a470e93a9b15 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:23.779085 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6191d-fb36-4a4c-a14f-a470e93a9b15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:23.779360 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6191d-fb36-4a4c-a14f-a470e93a9b15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:23.791916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6191d-fb36-4a4c-a14f-a470e93a9b15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:23.793459 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6191d-fb36-4a4c-a14f-a470e93a9b15 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:23.805831 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1266/2556] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:33:23.909702 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:24.502911 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010e448-3978-4a2d-b875-2cf118ee9e4a None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:24.506234 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-7010e448-3978-4a2d-b875-2cf118ee9e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:24.545622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:24.554972 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010e448-3978-4a2d-b875-2cf118ee9e4a None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:24.578314 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751570c-6608-4ed1-a565-8ecd3a6f42a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:24.580231 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751570c-6608-4ed1-a565-8ecd3a6f42a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:24.581526 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751570c-6608-4ed1-a565-8ecd3a6f42a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:24.582666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751570c-6608-4ed1-a565-8ecd3a6f42a1 admin admin] PATH_INFO: `/v3/projects/40c15902f5bf4b61a2bec3259659ef6d` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:24.587546 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751570c-6608-4ed1-a565-8ecd3a6f42a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40c15902f5bf4b61a2bec3259659ef6d)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:24.592727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751570c-6608-4ed1-a565-8ecd3a6f42a1 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:24.784014 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f751570c-6608-4ed1-a565-8ecd3a6f42a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40c15902f5bf4b61a2bec3259659ef6d', 'request_id': 'req-f751570c-6608-4ed1-a565-8ecd3a6f42a1'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:24.793557 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f751570c-6608-4ed1-a565-8ecd3a6f42a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40c15902f5bf4b61a2bec3259659ef6d', 'request_id': 'req-f751570c-6608-4ed1-a565-8ecd3a6f42a1'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:25.007921 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f751570c-6608-4ed1-a565-8ecd3a6f42a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40c15902f5bf4b61a2bec3259659ef6d', 'request_id': 'req-f751570c-6608-4ed1-a565-8ecd3a6f42a1'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:25.036604 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f751570c-6608-4ed1-a565-8ecd3a6f42a1 admin admin] The token cache is being invalidate because project 40c15902f5bf4b61a2bec3259659ef6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:33:25.037061 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f751570c-6608-4ed1-a565-8ecd3a6f42a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:25.038540 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f751570c-6608-4ed1-a565-8ecd3a6f42a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:25.040722 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1291/2557] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:33:24 2022] DELETE /identity/v3/projects/40c15902f5bf4b61a2bec3259659ef6d => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:33:25.061974 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6191d-fb36-4a4c-a14f-a470e93a9b15 service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:25.069771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6191d-fb36-4a4c-a14f-a470e93a9b15 service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:25.151091 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a96719-7523-478e-b8a6-cda04d06cf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:25.152035 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a96719-7523-478e-b8a6-cda04d06cf51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:25.152035 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a96719-7523-478e-b8a6-cda04d06cf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:25.152356 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a96719-7523-478e-b8a6-cda04d06cf51 admin admin] PATH_INFO: `/v3/users/d4b61d84f93d4c32a6a231884d4cb197` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:25.153675 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a96719-7523-478e-b8a6-cda04d06cf51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4b61d84f93d4c32a6a231884d4cb197)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:25.156213 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a96719-7523-478e-b8a6-cda04d06cf51 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:25.243160 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:25.521504 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-95a96719-7523-478e-b8a6-cda04d06cf51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4b61d84f93d4c32a6a231884d4cb197'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:25.618302 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-95a96719-7523-478e-b8a6-cda04d06cf51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4b61d84f93d4c32a6a231884d4cb197'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:25.619290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-95a96719-7523-478e-b8a6-cda04d06cf51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4b61d84f93d4c32a6a231884d4cb197'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:25.620028 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-95a96719-7523-478e-b8a6-cda04d06cf51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4b61d84f93d4c32a6a231884d4cb197'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:25.629713 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-95a96719-7523-478e-b8a6-cda04d06cf51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4b61d84f93d4c32a6a231884d4cb197'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:25.652739 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1267/2558] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:33:25 2022] DELETE /identity/v3/users/d4b61d84f93d4c32a6a231884d4cb197 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:33:26.435307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751570c-6608-4ed1-a565-8ecd3a6f42a1 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:26.438319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-f751570c-6608-4ed1-a565-8ecd3a6f42a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:26.466384 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751570c-6608-4ed1-a565-8ecd3a6f42a1 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:26.508760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec0888-df4b-4c41-b1f8-9869aaadb4a3 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:26.508760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec0888-df4b-4c41-b1f8-9869aaadb4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:26.508760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec0888-df4b-4c41-b1f8-9869aaadb4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:26.532898 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-36ec0888-df4b-4c41-b1f8-9869aaadb4a3 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:26.534790 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-36ec0888-df4b-4c41-b1f8-9869aaadb4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:26.609652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb100ff-7813-4e73-9306-4db64b6288d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:26.612208 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb100ff-7813-4e73-9306-4db64b6288d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:26.612530 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb100ff-7813-4e73-9306-4db64b6288d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:26.612957 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb100ff-7813-4e73-9306-4db64b6288d2 admin admin] PATH_INFO: `/v3/projects/58fa317301144380be13a85ac5a5bdd1` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:26.615033 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb100ff-7813-4e73-9306-4db64b6288d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58fa317301144380be13a85ac5a5bdd1)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:26.618201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb100ff-7813-4e73-9306-4db64b6288d2 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:26.648823 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1268/2559] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Sep 6 20:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:33:26.672815 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec0888-df4b-4c41-b1f8-9869aaadb4a3 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:26.674889 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-36ec0888-df4b-4c41-b1f8-9869aaadb4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:26.795843 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1eb100ff-7813-4e73-9306-4db64b6288d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58fa317301144380be13a85ac5a5bdd1', 'request_id': 'req-1eb100ff-7813-4e73-9306-4db64b6288d2'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:26.803468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1eb100ff-7813-4e73-9306-4db64b6288d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58fa317301144380be13a85ac5a5bdd1', 'request_id': 'req-1eb100ff-7813-4e73-9306-4db64b6288d2'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:26.812509 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec0888-df4b-4c41-b1f8-9869aaadb4a3 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:26.931731 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616f5dd-41c6-46c9-90b1-ca90c1aea623 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:26.932610 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616f5dd-41c6-46c9-90b1-ca90c1aea623 service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:26.933046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616f5dd-41c6-46c9-90b1-ca90c1aea623 service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:26.933736 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616f5dd-41c6-46c9-90b1-ca90c1aea623 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:26.944286 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1eb100ff-7813-4e73-9306-4db64b6288d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58fa317301144380be13a85ac5a5bdd1', 'request_id': 'req-1eb100ff-7813-4e73-9306-4db64b6288d2'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:26.967512 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1eb100ff-7813-4e73-9306-4db64b6288d2 admin admin] The token cache is being invalidate because project 58fa317301144380be13a85ac5a5bdd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:33:26.968312 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1eb100ff-7813-4e73-9306-4db64b6288d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:26.973069 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1eb100ff-7813-4e73-9306-4db64b6288d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:26.977770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1292/2560] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:33:26 2022] DELETE /identity/v3/projects/58fa317301144380be13a85ac5a5bdd1 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:33:26.987086 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7e628-93eb-4251-abaa-db9572a085d7 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:26.988653 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7e628-93eb-4251-abaa-db9572a085d7 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:26.990510 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7e628-93eb-4251-abaa-db9572a085d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:27.027948 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-fed7e628-93eb-4251-abaa-db9572a085d7 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:27.030383 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-fed7e628-93eb-4251-abaa-db9572a085d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:27.046805 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:27.065638 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616f5dd-41c6-46c9-90b1-ca90c1aea623 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:27.069402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616f5dd-41c6-46c9-90b1-ca90c1aea623 service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:27.089913 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1269/2561] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:33:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:33:27.148339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1293/2562] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:33:27.159772 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e9d74-e1d3-4d68-9ce7-bfdec2bfb701 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:27.159772 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e9d74-e1d3-4d68-9ce7-bfdec2bfb701 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:27.159772 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e9d74-e1d3-4d68-9ce7-bfdec2bfb701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:27.175183 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7e628-93eb-4251-abaa-db9572a085d7 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:27.177735 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-fed7e628-93eb-4251-abaa-db9572a085d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:27.185468 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-043e9d74-e1d3-4d68-9ce7-bfdec2bfb701 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:27.186980 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-043e9d74-e1d3-4d68-9ce7-bfdec2bfb701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:27.202141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1270/2563] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:33:27.206324 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7e628-93eb-4251-abaa-db9572a085d7 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:27.207596 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e9d74-e1d3-4d68-9ce7-bfdec2bfb701 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:27.217122 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879dbacc-07d7-4c65-a632-5967e69e4d30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:27.218213 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dbacc-07d7-4c65-a632-5967e69e4d30 service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:27.218712 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dbacc-07d7-4c65-a632-5967e69e4d30 service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:27.219239 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dbacc-07d7-4c65-a632-5967e69e4d30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:27.221405 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e9d74-e1d3-4d68-9ce7-bfdec2bfb701 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:27.235119 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-879dbacc-07d7-4c65-a632-5967e69e4d30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:27.237144 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf777d9-c86d-442f-924e-51b7c87fb154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:27.239427 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf777d9-c86d-442f-924e-51b7c87fb154 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:27.239841 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf777d9-c86d-442f-924e-51b7c87fb154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:27.240303 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf777d9-c86d-442f-924e-51b7c87fb154 admin admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:27.241299 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf777d9-c86d-442f-924e-51b7c87fb154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:33:27.242208 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf777d9-c86d-442f-924e-51b7c87fb154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:27.247287 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf777d9-c86d-442f-924e-51b7c87fb154 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:27.272780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1271/2564] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:33:27.274107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf777d9-c86d-442f-924e-51b7c87fb154 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:27.285246 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf777d9-c86d-442f-924e-51b7c87fb154 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:27.290881 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba88e79-17a0-491f-b097-ecf453c37ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:27.291689 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba88e79-17a0-491f-b097-ecf453c37ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:27.292100 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba88e79-17a0-491f-b097-ecf453c37ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:27.292423 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba88e79-17a0-491f-b097-ecf453c37ec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:27.293214 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba88e79-17a0-491f-b097-ecf453c37ec3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:27.295311 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba88e79-17a0-491f-b097-ecf453c37ec3 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:27.357274 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879dbacc-07d7-4c65-a632-5967e69e4d30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:27.361058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879dbacc-07d7-4c65-a632-5967e69e4d30 service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:27.379993 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1294/2565] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:33:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:33:27.525291 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1272/2566] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:33:27 2022] POST /identity/v3/projects => generated 363 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:33:27.532704 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879dbacc-07d7-4c65-a632-5967e69e4d30 service nova] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:27.577375 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879dbacc-07d7-4c65-a632-5967e69e4d30 service nova] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:27.714065 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a35a55-31c1-4911-be1a-c352e3374646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:27.715661 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a35a55-31c1-4911-be1a-c352e3374646 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:27.720198 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a35a55-31c1-4911-be1a-c352e3374646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:27.720198 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a35a55-31c1-4911-be1a-c352e3374646 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:27.720198 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a35a55-31c1-4911-be1a-c352e3374646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:27.722972 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a35a55-31c1-4911-be1a-c352e3374646 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:27.866908 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1295/2567] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:33:27 2022] POST /identity/v3/users => generated 282 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:33:27.871702 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba88e79-17a0-491f-b097-ecf453c37ec3 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:27.887625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba88e79-17a0-491f-b097-ecf453c37ec3 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:27.895039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e5edc-7497-42b6-a404-0189936dce6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:27.896101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e5edc-7497-42b6-a404-0189936dce6d admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:27.896601 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e5edc-7497-42b6-a404-0189936dce6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:27.897084 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e5edc-7497-42b6-a404-0189936dce6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:27.898280 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e5edc-7497-42b6-a404-0189936dce6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:27.901211 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e5edc-7497-42b6-a404-0189936dce6d admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:27.920778 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1273/2568] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:33:27.924892 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a35a55-31c1-4911-be1a-c352e3374646 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:27.936913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a35a55-31c1-4911-be1a-c352e3374646 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:27.942561 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a64cd-d02a-4cb3-887a-ad9d7ae0d6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:27.943888 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a64cd-d02a-4cb3-887a-ad9d7ae0d6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:27.944170 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a64cd-d02a-4cb3-887a-ad9d7ae0d6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:27.944439 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a64cd-d02a-4cb3-887a-ad9d7ae0d6e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:27.945120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a64cd-d02a-4cb3-887a-ad9d7ae0d6e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:27.946993 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a64cd-d02a-4cb3-887a-ad9d7ae0d6e1 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:27.960007 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1296/2569] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:33:27.964671 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e5edc-7497-42b6-a404-0189936dce6d admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:27.976503 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e5edc-7497-42b6-a404-0189936dce6d admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:27.982107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5fde3-0752-44da-9713-95ffe84c1bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:27.982800 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5fde3-0752-44da-9713-95ffe84c1bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:27.983080 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5fde3-0752-44da-9713-95ffe84c1bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:27.983352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5fde3-0752-44da-9713-95ffe84c1bb5 admin admin] PATH_INFO: `/v3/projects/30e122b753c344168cb325849de43e9f/users/0b120e36230546b4aee09cca36c84f6d/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:27.990920 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:28.010328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5fde3-0752-44da-9713-95ffe84c1bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30e122b753c344168cb325849de43e9f, user_id=0b120e36230546b4aee09cca36c84f6d, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:28.013477 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5fde3-0752-44da-9713-95ffe84c1bb5 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:28.226403 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1274/2570] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:33:27 2022] PUT /identity/v3/projects/30e122b753c344168cb325849de43e9f/users/0b120e36230546b4aee09cca36c84f6d/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:33:28.246605 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02177eba-e288-4c5c-a13e-4b9f0b2ef601 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:28.246957 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02177eba-e288-4c5c-a13e-4b9f0b2ef601 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:28.247167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02177eba-e288-4c5c-a13e-4b9f0b2ef601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:28.281380 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-02177eba-e288-4c5c-a13e-4b9f0b2ef601 None None] MFA Rules not processed for user `0b120e36230546b4aee09cca36c84f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:28.282662 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-02177eba-e288-4c5c-a13e-4b9f0b2ef601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:28.372171 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1297/2571] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:33:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:33:28.387156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5fde3-0752-44da-9713-95ffe84c1bb5 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:28.493341 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5fde3-0752-44da-9713-95ffe84c1bb5 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:28.500167 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155f1b0-31de-4dc5-9836-1fdfe70ba8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:28.507283 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155f1b0-31de-4dc5-9836-1fdfe70ba8a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:28.507283 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155f1b0-31de-4dc5-9836-1fdfe70ba8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:28.507283 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155f1b0-31de-4dc5-9836-1fdfe70ba8a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:28.507283 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155f1b0-31de-4dc5-9836-1fdfe70ba8a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:28.507283 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155f1b0-31de-4dc5-9836-1fdfe70ba8a3 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:28.670908 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1275/2572] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:33:28 2022] POST /identity/v3/projects => generated 363 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:33:28.676923 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02177eba-e288-4c5c-a13e-4b9f0b2ef601 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:28.691347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02177eba-e288-4c5c-a13e-4b9f0b2ef601 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:28.792441 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9923972-ab14-4616-a2f9-f5ac110b61b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:28.793411 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9923972-ab14-4616-a2f9-f5ac110b61b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:28.793872 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9923972-ab14-4616-a2f9-f5ac110b61b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:28.799496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9923972-ab14-4616-a2f9-f5ac110b61b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:28.799496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9923972-ab14-4616-a2f9-f5ac110b61b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:28.799496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9923972-ab14-4616-a2f9-f5ac110b61b2 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:28.938739 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1298/2573] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:33:28 2022] POST /identity/v3/users => generated 288 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:33:28.943430 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155f1b0-31de-4dc5-9836-1fdfe70ba8a3 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:28.961905 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:28.962223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155f1b0-31de-4dc5-9836-1fdfe70ba8a3 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:28.968338 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826f9d0-0e94-45e8-811b-87d812dc0c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:28.969324 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826f9d0-0e94-45e8-811b-87d812dc0c3d admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:28.969635 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826f9d0-0e94-45e8-811b-87d812dc0c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:28.970193 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826f9d0-0e94-45e8-811b-87d812dc0c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:28.973112 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826f9d0-0e94-45e8-811b-87d812dc0c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:28.973455 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826f9d0-0e94-45e8-811b-87d812dc0c3d admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:28.989968 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1276/2574] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:33:28.996116 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9923972-ab14-4616-a2f9-f5ac110b61b2 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:29.014363 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9923972-ab14-4616-a2f9-f5ac110b61b2 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:29.023064 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe409ab-82ea-4462-bcfd-cb5d3a1e516a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:29.024267 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe409ab-82ea-4462-bcfd-cb5d3a1e516a admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:29.024750 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe409ab-82ea-4462-bcfd-cb5d3a1e516a admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:29.026046 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe409ab-82ea-4462-bcfd-cb5d3a1e516a admin admin] PATH_INFO: `/v3/projects/1786e0f3338c4393b31fcaa621a1b144/users/0a719cf53c774087b2a2e76fd44f7d1f/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:29.055754 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe409ab-82ea-4462-bcfd-cb5d3a1e516a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1786e0f3338c4393b31fcaa621a1b144, user_id=0a719cf53c774087b2a2e76fd44f7d1f, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:29.061304 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe409ab-82ea-4462-bcfd-cb5d3a1e516a admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:29.191295 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1299/2575] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:33:28 2022] PUT /identity/v3/projects/1786e0f3338c4393b31fcaa621a1b144/users/0a719cf53c774087b2a2e76fd44f7d1f/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:33:29.196500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826f9d0-0e94-45e8-811b-87d812dc0c3d admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:29.214048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826f9d0-0e94-45e8-811b-87d812dc0c3d admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:29.303726 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3c232-905b-449b-b445-52db65a48371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:29.304500 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3c232-905b-449b-b445-52db65a48371 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:29.304927 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3c232-905b-449b-b445-52db65a48371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:29.305302 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3c232-905b-449b-b445-52db65a48371 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:29.306144 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3c232-905b-449b-b445-52db65a48371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:29.308399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3c232-905b-449b-b445-52db65a48371 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:29.321411 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1277/2576] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:33:29.326537 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe409ab-82ea-4462-bcfd-cb5d3a1e516a admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:29.339847 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe409ab-82ea-4462-bcfd-cb5d3a1e516a admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:29.347103 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37a2ca-9e75-426b-afbe-0b059f9bdb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:29.347964 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37a2ca-9e75-426b-afbe-0b059f9bdb3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:29.348392 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37a2ca-9e75-426b-afbe-0b059f9bdb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:29.348783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37a2ca-9e75-426b-afbe-0b059f9bdb3b admin admin] PATH_INFO: `/v3/projects/1786e0f3338c4393b31fcaa621a1b144/users/0a719cf53c774087b2a2e76fd44f7d1f/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:29.351491 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37a2ca-9e75-426b-afbe-0b059f9bdb3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1786e0f3338c4393b31fcaa621a1b144, user_id=0a719cf53c774087b2a2e76fd44f7d1f, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:29.355219 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37a2ca-9e75-426b-afbe-0b059f9bdb3b admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:29.371062 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1300/2577] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:33:29 2022] PUT /identity/v3/projects/1786e0f3338c4393b31fcaa621a1b144/users/0a719cf53c774087b2a2e76fd44f7d1f/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:33:29.384309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35796a-2519-4289-8673-da7ddbcd1e30 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:29.384709 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35796a-2519-4289-8673-da7ddbcd1e30 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:29.384991 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35796a-2519-4289-8673-da7ddbcd1e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:29.427974 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-2b35796a-2519-4289-8673-da7ddbcd1e30 None None] MFA Rules not processed for user `0a719cf53c774087b2a2e76fd44f7d1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:29.430081 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-2b35796a-2519-4289-8673-da7ddbcd1e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:29.533695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1278/2578] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:33:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:33:29.552373 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37a2ca-9e75-426b-afbe-0b059f9bdb3b admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:29.555967 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ba37a2ca-9e75-426b-afbe-0b059f9bdb3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:29.661975 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37a2ca-9e75-426b-afbe-0b059f9bdb3b admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:29.677671 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803ab4e-006c-42cf-8996-dcccaa5c3d26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:29.679325 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803ab4e-006c-42cf-8996-dcccaa5c3d26 service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:29.679325 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803ab4e-006c-42cf-8996-dcccaa5c3d26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:29.679325 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803ab4e-006c-42cf-8996-dcccaa5c3d26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:29.698455 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803ab4e-006c-42cf-8996-dcccaa5c3d26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:29.700633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803ab4e-006c-42cf-8996-dcccaa5c3d26 service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:29.717672 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1301/2579] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:33:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:33:30.035177 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:30.174337 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35796a-2519-4289-8673-da7ddbcd1e30 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:30.208681 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35796a-2519-4289-8673-da7ddbcd1e30 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:30.225566 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903f431-a8df-4c76-b965-bf77d2127850 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:30.227082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903f431-a8df-4c76-b965-bf77d2127850 service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:30.227881 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903f431-a8df-4c76-b965-bf77d2127850 service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:30.228745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903f431-a8df-4c76-b965-bf77d2127850 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:30.353963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903f431-a8df-4c76-b965-bf77d2127850 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:30.357319 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903f431-a8df-4c76-b965-bf77d2127850 service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:30.372265 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1279/2580] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:33:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:33:30.401643 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:33.535666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff22e06-1c02-4a17-961c-2f4aa05b10a4 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:33.537150 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff22e06-1c02-4a17-961c-2f4aa05b10a4 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:33.537150 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff22e06-1c02-4a17-961c-2f4aa05b10a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:33.561505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-4ff22e06-1c02-4a17-961c-2f4aa05b10a4 None None] MFA Rules not processed for user `c314372147b2491cb4481d538056472c`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:33.563003 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-4ff22e06-1c02-4a17-961c-2f4aa05b10a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:33.586060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:33.676452 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1302/2581] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Sep 6 20:33:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:33:33.700633 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903f431-a8df-4c76-b965-bf77d2127850 service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:33.703600 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-b903f431-a8df-4c76-b965-bf77d2127850 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:33.885629 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903f431-a8df-4c76-b965-bf77d2127850 service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:33.898081 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5a3f0-11fd-4d05-9c7c-ce70235dee8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6c4f91a59548fd979e7232a2afd6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:33.899265 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5a3f0-11fd-4d05-9c7c-ce70235dee8a service swift] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:33.899775 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5a3f0-11fd-4d05-9c7c-ce70235dee8a service swift] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:33.900123 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5a3f0-11fd-4d05-9c7c-ce70235dee8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:33.912150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5a3f0-11fd-4d05-9c7c-ce70235dee8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:33.913913 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5a3f0-11fd-4d05-9c7c-ce70235dee8a service swift] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:33.934839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1280/2582] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Sep 6 20:33:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 20:33:34.263125 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf763e09-e68f-48b9-b698-0aa3d9714ec3 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:34.263609 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf763e09-e68f-48b9-b698-0aa3d9714ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:34.263948 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf763e09-e68f-48b9-b698-0aa3d9714ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:34.312753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-cf763e09-e68f-48b9-b698-0aa3d9714ec3 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:34.314111 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-cf763e09-e68f-48b9-b698-0aa3d9714ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:34.466361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1303/2583] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Sep 6 20:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:33:34.488375 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5a3f0-11fd-4d05-9c7c-ce70235dee8a service swift] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:34.682952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:34.772766 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5a3f0-11fd-4d05-9c7c-ce70235dee8a service swift] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:34.802526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40869c94-563e-483d-88de-309509d898c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:34.803832 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40869c94-563e-483d-88de-309509d898c9 service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:34.804598 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40869c94-563e-483d-88de-309509d898c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:34.805270 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40869c94-563e-483d-88de-309509d898c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:34.822286 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40869c94-563e-483d-88de-309509d898c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:34.824692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40869c94-563e-483d-88de-309509d898c9 service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:34.845229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1281/2584] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:33:35.157782 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf763e09-e68f-48b9-b698-0aa3d9714ec3 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:35.179547 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf763e09-e68f-48b9-b698-0aa3d9714ec3 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:35.207765 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ff2c2-9ed0-4f8d-b855-0f0f63195fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:35.210316 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ff2c2-9ed0-4f8d-b855-0f0f63195fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:35.211120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ff2c2-9ed0-4f8d-b855-0f0f63195fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:35.211929 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ff2c2-9ed0-4f8d-b855-0f0f63195fa3 admin admin] PATH_INFO: `/v3/users/0b120e36230546b4aee09cca36c84f6d` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:35.214256 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ff2c2-9ed0-4f8d-b855-0f0f63195fa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b120e36230546b4aee09cca36c84f6d)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:35.216612 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ff2c2-9ed0-4f8d-b855-0f0f63195fa3 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:35.636875 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d42ff2c2-9ed0-4f8d-b855-0f0f63195fa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b120e36230546b4aee09cca36c84f6d'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:35.738635 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d42ff2c2-9ed0-4f8d-b855-0f0f63195fa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b120e36230546b4aee09cca36c84f6d'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:35.740040 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d42ff2c2-9ed0-4f8d-b855-0f0f63195fa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b120e36230546b4aee09cca36c84f6d'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:35.742057 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d42ff2c2-9ed0-4f8d-b855-0f0f63195fa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b120e36230546b4aee09cca36c84f6d'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:35.770858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d42ff2c2-9ed0-4f8d-b855-0f0f63195fa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b120e36230546b4aee09cca36c84f6d'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:35.813658 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1304/2585] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:33:35 2022] DELETE /identity/v3/users/0b120e36230546b4aee09cca36c84f6d => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:33:35.819938 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad422908-19ab-40a5-aef7-8a02f43fd871 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:35.824542 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad422908-19ab-40a5-aef7-8a02f43fd871 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:35.824946 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad422908-19ab-40a5-aef7-8a02f43fd871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:35.871521 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-ad422908-19ab-40a5-aef7-8a02f43fd871 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:35.873660 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-ad422908-19ab-40a5-aef7-8a02f43fd871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:35.955763 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1282/2586] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:33:35.970602 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ff2c2-9ed0-4f8d-b855-0f0f63195fa3 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:35.972579 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-d42ff2c2-9ed0-4f8d-b855-0f0f63195fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:36.043784 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:36.079456 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ff2c2-9ed0-4f8d-b855-0f0f63195fa3 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:36.085018 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3cc92-584e-4302-a9a2-43d107905ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:36.091590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3cc92-584e-4302-a9a2-43d107905ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:36.091590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3cc92-584e-4302-a9a2-43d107905ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:36.091590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3cc92-584e-4302-a9a2-43d107905ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:36.106327 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3cc92-584e-4302-a9a2-43d107905ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:36.108374 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3cc92-584e-4302-a9a2-43d107905ac3 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:36.122358 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1305/2587] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:33:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:33:37.065826 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad422908-19ab-40a5-aef7-8a02f43fd871 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:37.071127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-ad422908-19ab-40a5-aef7-8a02f43fd871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:37.137417 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad422908-19ab-40a5-aef7-8a02f43fd871 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:37.153580 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b1847-f2b0-4385-9fa8-f0d945086cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:37.154869 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b1847-f2b0-4385-9fa8-f0d945086cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:37.156135 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b1847-f2b0-4385-9fa8-f0d945086cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:37.157036 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b1847-f2b0-4385-9fa8-f0d945086cff admin admin] PATH_INFO: `/v3/projects/30e122b753c344168cb325849de43e9f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:37.160764 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b1847-f2b0-4385-9fa8-f0d945086cff admin admin] RBAC: Authorizing `identity:delete_project(project_id=30e122b753c344168cb325849de43e9f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:37.169988 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b1847-f2b0-4385-9fa8-f0d945086cff admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:37.376971 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-761b1847-f2b0-4385-9fa8-f0d945086cff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30e122b753c344168cb325849de43e9f', 'request_id': 'req-761b1847-f2b0-4385-9fa8-f0d945086cff'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:37.403003 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-761b1847-f2b0-4385-9fa8-f0d945086cff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30e122b753c344168cb325849de43e9f', 'request_id': 'req-761b1847-f2b0-4385-9fa8-f0d945086cff'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:37.511529 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-761b1847-f2b0-4385-9fa8-f0d945086cff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30e122b753c344168cb325849de43e9f', 'request_id': 'req-761b1847-f2b0-4385-9fa8-f0d945086cff'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:37.547293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-761b1847-f2b0-4385-9fa8-f0d945086cff admin admin] The token cache is being invalidate because project 30e122b753c344168cb325849de43e9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:33:37.548327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-761b1847-f2b0-4385-9fa8-f0d945086cff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:37.549868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-761b1847-f2b0-4385-9fa8-f0d945086cff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:37.554506 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1283/2588] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:33:37 2022] DELETE /identity/v3/projects/30e122b753c344168cb325849de43e9f => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:33:37.560828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3cc92-584e-4302-a9a2-43d107905ac3 service neutron] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:37.579343 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3cc92-584e-4302-a9a2-43d107905ac3 service neutron] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:37.732316 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ad314-f8eb-4cc1-aab3-d93fbed68732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:37.733353 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ad314-f8eb-4cc1-aab3-d93fbed68732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:37.733855 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ad314-f8eb-4cc1-aab3-d93fbed68732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:37.734346 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ad314-f8eb-4cc1-aab3-d93fbed68732 admin admin] PATH_INFO: `/v3/users/0a719cf53c774087b2a2e76fd44f7d1f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:37.736664 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ad314-f8eb-4cc1-aab3-d93fbed68732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a719cf53c774087b2a2e76fd44f7d1f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:37.740464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ad314-f8eb-4cc1-aab3-d93fbed68732 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:38.027381 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-3e3ad314-f8eb-4cc1-aab3-d93fbed68732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a719cf53c774087b2a2e76fd44f7d1f'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:38.112768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-3e3ad314-f8eb-4cc1-aab3-d93fbed68732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a719cf53c774087b2a2e76fd44f7d1f'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:38.115412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-3e3ad314-f8eb-4cc1-aab3-d93fbed68732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a719cf53c774087b2a2e76fd44f7d1f'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:38.116657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-3e3ad314-f8eb-4cc1-aab3-d93fbed68732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a719cf53c774087b2a2e76fd44f7d1f'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:38.160957 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-3e3ad314-f8eb-4cc1-aab3-d93fbed68732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a719cf53c774087b2a2e76fd44f7d1f'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:38.232101 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1306/2589] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:33:37 2022] DELETE /identity/v3/users/0a719cf53c774087b2a2e76fd44f7d1f => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:33:39.035031 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b1847-f2b0-4385-9fa8-f0d945086cff admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:39.038413 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-761b1847-f2b0-4385-9fa8-f0d945086cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:39.071320 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b1847-f2b0-4385-9fa8-f0d945086cff admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:39.225099 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:39.234954 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a471a-23b9-475e-9261-5aa851fa704e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:39.235686 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a471a-23b9-475e-9261-5aa851fa704e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:39.238306 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a471a-23b9-475e-9261-5aa851fa704e admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:39.238306 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a471a-23b9-475e-9261-5aa851fa704e admin admin] PATH_INFO: `/v3/projects/1786e0f3338c4393b31fcaa621a1b144` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:39.238306 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a471a-23b9-475e-9261-5aa851fa704e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1786e0f3338c4393b31fcaa621a1b144)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:39.240196 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a471a-23b9-475e-9261-5aa851fa704e admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:39.471401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-4f6a471a-23b9-475e-9261-5aa851fa704e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1786e0f3338c4393b31fcaa621a1b144', 'request_id': 'req-4f6a471a-23b9-475e-9261-5aa851fa704e'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:39.483381 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-4f6a471a-23b9-475e-9261-5aa851fa704e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1786e0f3338c4393b31fcaa621a1b144', 'request_id': 'req-4f6a471a-23b9-475e-9261-5aa851fa704e'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:39.594745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-4f6a471a-23b9-475e-9261-5aa851fa704e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1786e0f3338c4393b31fcaa621a1b144', 'request_id': 'req-4f6a471a-23b9-475e-9261-5aa851fa704e'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:39.625355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-4f6a471a-23b9-475e-9261-5aa851fa704e admin admin] The token cache is being invalidate because project 1786e0f3338c4393b31fcaa621a1b144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:33:39.625848 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-4f6a471a-23b9-475e-9261-5aa851fa704e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:39.655194 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-4f6a471a-23b9-475e-9261-5aa851fa704e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:39.659667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1284/2590] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:33:39 2022] DELETE /identity/v3/projects/1786e0f3338c4393b31fcaa621a1b144 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:33:39.678340 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf77988-42d6-406d-aa8a-7148e08937cb None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:39.679249 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf77988-42d6-406d-aa8a-7148e08937cb None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:39.679249 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf77988-42d6-406d-aa8a-7148e08937cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:39.718018 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-daf77988-42d6-406d-aa8a-7148e08937cb None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:39.720311 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-daf77988-42d6-406d-aa8a-7148e08937cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:39.854845 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:39.877293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1307/2591] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:33:39.890206 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b858bda-ab1d-4746-851e-77b7b712a7c3 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:39.890570 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b858bda-ab1d-4746-851e-77b7b712a7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:39.891352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b858bda-ab1d-4746-851e-77b7b712a7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:39.953613 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-6b858bda-ab1d-4746-851e-77b7b712a7c3 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:39.956445 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6b858bda-ab1d-4746-851e-77b7b712a7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:39.974350 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1285/2592] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:33:39.992411 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf77988-42d6-406d-aa8a-7148e08937cb None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:40.005740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf77988-42d6-406d-aa8a-7148e08937cb None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:40.012095 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96f0b4-5c91-4fda-a5e9-09e32e43ed88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:40.012828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96f0b4-5c91-4fda-a5e9-09e32e43ed88 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:40.013106 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96f0b4-5c91-4fda-a5e9-09e32e43ed88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:40.013370 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96f0b4-5c91-4fda-a5e9-09e32e43ed88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:40.014170 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96f0b4-5c91-4fda-a5e9-09e32e43ed88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:33:40.014347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96f0b4-5c91-4fda-a5e9-09e32e43ed88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:40.016473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96f0b4-5c91-4fda-a5e9-09e32e43ed88 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:40.039423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1308/2593] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:33:40.049918 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b858bda-ab1d-4746-851e-77b7b712a7c3 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:40.079172 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b858bda-ab1d-4746-851e-77b7b712a7c3 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:40.089625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a949b-8925-4c5b-a7ff-cbc8f1c80866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:40.090160 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a949b-8925-4c5b-a7ff-cbc8f1c80866 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:40.090636 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a949b-8925-4c5b-a7ff-cbc8f1c80866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:40.091169 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a949b-8925-4c5b-a7ff-cbc8f1c80866 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:40.092501 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a949b-8925-4c5b-a7ff-cbc8f1c80866 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:40.096219 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a949b-8925-4c5b-a7ff-cbc8f1c80866 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:40.251910 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1286/2594] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:33:40 2022] POST /identity/v3/projects => generated 389 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:33:40.259970 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96f0b4-5c91-4fda-a5e9-09e32e43ed88 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:40.295643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96f0b4-5c91-4fda-a5e9-09e32e43ed88 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:40.399936 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13c77d-b96f-42e6-b7d7-7f0967554cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:40.401021 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13c77d-b96f-42e6-b7d7-7f0967554cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:40.401422 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13c77d-b96f-42e6-b7d7-7f0967554cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:40.401969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13c77d-b96f-42e6-b7d7-7f0967554cb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:40.403480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13c77d-b96f-42e6-b7d7-7f0967554cb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:40.408031 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13c77d-b96f-42e6-b7d7-7f0967554cb2 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:40.527922 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1309/2595] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:33:40 2022] POST /identity/v3/users => generated 295 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:33:40.534612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a949b-8925-4c5b-a7ff-cbc8f1c80866 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:40.556652 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a949b-8925-4c5b-a7ff-cbc8f1c80866 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:40.578498 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f424756-e369-419e-8c6f-7dd01c7bf5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:40.579706 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f424756-e369-419e-8c6f-7dd01c7bf5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:40.580174 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f424756-e369-419e-8c6f-7dd01c7bf5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:40.580704 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f424756-e369-419e-8c6f-7dd01c7bf5d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:40.588222 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f424756-e369-419e-8c6f-7dd01c7bf5d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:40.591557 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f424756-e369-419e-8c6f-7dd01c7bf5d0 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:40.634935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1287/2596] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:33:40.640321 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13c77d-b96f-42e6-b7d7-7f0967554cb2 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:40.666940 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13c77d-b96f-42e6-b7d7-7f0967554cb2 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:40.666940 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d47121-f959-42e6-96a6-9469b130f1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:40.666940 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d47121-f959-42e6-96a6-9469b130f1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:40.666940 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d47121-f959-42e6-96a6-9469b130f1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:40.667976 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d47121-f959-42e6-96a6-9469b130f1b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:40.667976 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d47121-f959-42e6-96a6-9469b130f1b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:40.667976 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d47121-f959-42e6-96a6-9469b130f1b6 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:40.681591 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1310/2597] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:33:40.688255 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f424756-e369-419e-8c6f-7dd01c7bf5d0 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:40.710729 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f424756-e369-419e-8c6f-7dd01c7bf5d0 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:40.718803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442e391-86ef-4b09-a9b5-0e0e0a107082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:40.720569 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442e391-86ef-4b09-a9b5-0e0e0a107082 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:40.721100 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442e391-86ef-4b09-a9b5-0e0e0a107082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:40.721696 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442e391-86ef-4b09-a9b5-0e0e0a107082 admin admin] PATH_INFO: `/v3/projects/371520b7d26441ab91dedd763ea113d7/users/7af6ade1bb38414a8d3e95017ab221aa/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:40.756215 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d442e391-86ef-4b09-a9b5-0e0e0a107082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=371520b7d26441ab91dedd763ea113d7, user_id=7af6ade1bb38414a8d3e95017ab221aa, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:40.761614 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d442e391-86ef-4b09-a9b5-0e0e0a107082 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:40.933140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1288/2598] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:33:40 2022] PUT /identity/v3/projects/371520b7d26441ab91dedd763ea113d7/users/7af6ade1bb38414a8d3e95017ab221aa/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:33:40.953251 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739e027-4662-4c3a-9a90-ed25f4233f5b None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:40.953570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739e027-4662-4c3a-9a90-ed25f4233f5b None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:40.953842 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739e027-4662-4c3a-9a90-ed25f4233f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:40.996202 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-4739e027-4662-4c3a-9a90-ed25f4233f5b None None] MFA Rules not processed for user `7af6ade1bb38414a8d3e95017ab221aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:40.997652 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-4739e027-4662-4c3a-9a90-ed25f4233f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:41.104038 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1311/2599] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:33:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:33:41.109060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442e391-86ef-4b09-a9b5-0e0e0a107082 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:41.227215 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442e391-86ef-4b09-a9b5-0e0e0a107082 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:41.239870 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85aa47-30cb-4c26-bfa5-4f2fe6190a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:41.241959 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85aa47-30cb-4c26-bfa5-4f2fe6190a58 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:41.242664 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85aa47-30cb-4c26-bfa5-4f2fe6190a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:41.243357 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85aa47-30cb-4c26-bfa5-4f2fe6190a58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:41.244784 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85aa47-30cb-4c26-bfa5-4f2fe6190a58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:41.248868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85aa47-30cb-4c26-bfa5-4f2fe6190a58 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:41.440317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1289/2600] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:33:41 2022] POST /identity/v3/projects => generated 389 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:33:41.445039 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739e027-4662-4c3a-9a90-ed25f4233f5b None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:41.462867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739e027-4662-4c3a-9a90-ed25f4233f5b None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:41.604923 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:41.629140 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74a194-acca-467b-87fa-95d441ae55ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:41.630499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74a194-acca-467b-87fa-95d441ae55ff admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:41.630783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74a194-acca-467b-87fa-95d441ae55ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:41.631069 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74a194-acca-467b-87fa-95d441ae55ff admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:41.631791 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74a194-acca-467b-87fa-95d441ae55ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:41.634161 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74a194-acca-467b-87fa-95d441ae55ff admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:41.826462 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1312/2601] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:33:41 2022] POST /identity/v3/users => generated 301 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:33:41.845780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85aa47-30cb-4c26-bfa5-4f2fe6190a58 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:41.857352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85aa47-30cb-4c26-bfa5-4f2fe6190a58 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:41.863632 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb9a3f-f9e5-458c-b1d1-58c8df4c62be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:41.864880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb9a3f-f9e5-458c-b1d1-58c8df4c62be admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:41.865199 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb9a3f-f9e5-458c-b1d1-58c8df4c62be admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:41.865468 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb9a3f-f9e5-458c-b1d1-58c8df4c62be admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:41.866186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb9a3f-f9e5-458c-b1d1-58c8df4c62be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:41.867943 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb9a3f-f9e5-458c-b1d1-58c8df4c62be admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:41.871318 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:41.890417 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74a194-acca-467b-87fa-95d441ae55ff admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:41.897624 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1290/2602] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:33:41.905848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74a194-acca-467b-87fa-95d441ae55ff admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:41.911574 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33af41f-6da0-45b7-a131-8e23e17a7512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:41.912370 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33af41f-6da0-45b7-a131-8e23e17a7512 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:41.912824 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33af41f-6da0-45b7-a131-8e23e17a7512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:41.913220 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33af41f-6da0-45b7-a131-8e23e17a7512 admin admin] PATH_INFO: `/v3/projects/ffa445eabfe9448b866e185f962ce38d/users/7b50df0ae0e14d489425ce3c596c7c6d/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:41.952828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33af41f-6da0-45b7-a131-8e23e17a7512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffa445eabfe9448b866e185f962ce38d, user_id=7b50df0ae0e14d489425ce3c596c7c6d, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:41.958407 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33af41f-6da0-45b7-a131-8e23e17a7512 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:42.077390 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1313/2603] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:33:41 2022] PUT /identity/v3/projects/ffa445eabfe9448b866e185f962ce38d/users/7b50df0ae0e14d489425ce3c596c7c6d/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:33:42.082893 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb9a3f-f9e5-458c-b1d1-58c8df4c62be admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:42.120398 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb9a3f-f9e5-458c-b1d1-58c8df4c62be admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:42.227705 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4c257-f9b2-4492-a1de-ff3c60e8c39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:42.228210 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4c257-f9b2-4492-a1de-ff3c60e8c39f admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:42.228488 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4c257-f9b2-4492-a1de-ff3c60e8c39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:42.229045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4c257-f9b2-4492-a1de-ff3c60e8c39f admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:42.229819 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4c257-f9b2-4492-a1de-ff3c60e8c39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:42.231808 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4c257-f9b2-4492-a1de-ff3c60e8c39f admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:42.255795 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1291/2604] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:33:42.264239 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33af41f-6da0-45b7-a131-8e23e17a7512 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:42.293568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33af41f-6da0-45b7-a131-8e23e17a7512 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:42.305644 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427fe5e6-72aa-4a9a-9e80-9c35307e43c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:42.307633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fe5e6-72aa-4a9a-9e80-9c35307e43c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:42.308491 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fe5e6-72aa-4a9a-9e80-9c35307e43c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:42.309955 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fe5e6-72aa-4a9a-9e80-9c35307e43c5 admin admin] PATH_INFO: `/v3/projects/ffa445eabfe9448b866e185f962ce38d/users/7b50df0ae0e14d489425ce3c596c7c6d/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:42.315367 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427fe5e6-72aa-4a9a-9e80-9c35307e43c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffa445eabfe9448b866e185f962ce38d, user_id=7b50df0ae0e14d489425ce3c596c7c6d, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:42.322075 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427fe5e6-72aa-4a9a-9e80-9c35307e43c5 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:42.338989 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1314/2605] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:33:42 2022] PUT /identity/v3/projects/ffa445eabfe9448b866e185f962ce38d/users/7b50df0ae0e14d489425ce3c596c7c6d/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:33:42.350870 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b1f16-768a-46d1-a198-2d0a98f3036f None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:42.351142 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b1f16-768a-46d1-a198-2d0a98f3036f None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:42.351407 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b1f16-768a-46d1-a198-2d0a98f3036f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:42.385627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-440b1f16-768a-46d1-a198-2d0a98f3036f None None] MFA Rules not processed for user `7b50df0ae0e14d489425ce3c596c7c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:42.386922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-440b1f16-768a-46d1-a198-2d0a98f3036f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:42.516105 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1292/2606] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:33:42 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:33:42.527980 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427fe5e6-72aa-4a9a-9e80-9c35307e43c5 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:42.529769 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-427fe5e6-72aa-4a9a-9e80-9c35307e43c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:42.697499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427fe5e6-72aa-4a9a-9e80-9c35307e43c5 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:42.724507 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe174a-15fe-4c6a-a2e9-c34ff873963e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:42.724507 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe174a-15fe-4c6a-a2e9-c34ff873963e service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:42.742526 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe174a-15fe-4c6a-a2e9-c34ff873963e service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:42.743049 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe174a-15fe-4c6a-a2e9-c34ff873963e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:42.790763 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe174a-15fe-4c6a-a2e9-c34ff873963e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:42.790763 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe174a-15fe-4c6a-a2e9-c34ff873963e service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:42.811921 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1315/2607] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:33:42 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:33:43.141365 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b1f16-768a-46d1-a198-2d0a98f3036f None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:43.278637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b1f16-768a-46d1-a198-2d0a98f3036f None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:43.286325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a34ab9-a252-4157-9174-747243f29616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:43.287528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a34ab9-a252-4157-9174-747243f29616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:43.287935 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a34ab9-a252-4157-9174-747243f29616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:43.288308 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a34ab9-a252-4157-9174-747243f29616 admin admin] PATH_INFO: `/v3/users/7af6ade1bb38414a8d3e95017ab221aa` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:43.289907 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a34ab9-a252-4157-9174-747243f29616 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7af6ade1bb38414a8d3e95017ab221aa)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:43.292087 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a34ab9-a252-4157-9174-747243f29616 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:43.327762 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:43.534098 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-68a34ab9-a252-4157-9174-747243f29616 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7af6ade1bb38414a8d3e95017ab221aa'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:43.623969 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-68a34ab9-a252-4157-9174-747243f29616 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7af6ade1bb38414a8d3e95017ab221aa'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:43.624998 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-68a34ab9-a252-4157-9174-747243f29616 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7af6ade1bb38414a8d3e95017ab221aa'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:43.627314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-68a34ab9-a252-4157-9174-747243f29616 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7af6ade1bb38414a8d3e95017ab221aa'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:43.639928 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-68a34ab9-a252-4157-9174-747243f29616 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7af6ade1bb38414a8d3e95017ab221aa'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:43.666490 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1293/2608] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:33:43 2022] DELETE /identity/v3/users/7af6ade1bb38414a8d3e95017ab221aa => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:33:43.672106 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394caa4b-391e-4f93-b5c2-1094dde35dfa None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:43.673072 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394caa4b-391e-4f93-b5c2-1094dde35dfa None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:43.673072 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394caa4b-391e-4f93-b5c2-1094dde35dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:43.700159 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-394caa4b-391e-4f93-b5c2-1094dde35dfa None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:43.701456 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-394caa4b-391e-4f93-b5c2-1094dde35dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:43.832018 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1316/2609] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:33:43.840037 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a34ab9-a252-4157-9174-747243f29616 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:43.842330 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-68a34ab9-a252-4157-9174-747243f29616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:43.982955 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a34ab9-a252-4157-9174-747243f29616 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:43.987132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21155c-142f-4984-aa15-56c9586fab8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:43.987872 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21155c-142f-4984-aa15-56c9586fab8a service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:43.988162 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21155c-142f-4984-aa15-56c9586fab8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:43.988430 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21155c-142f-4984-aa15-56c9586fab8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:44.000063 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21155c-142f-4984-aa15-56c9586fab8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:44.001485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21155c-142f-4984-aa15-56c9586fab8a service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:44.012842 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1294/2610] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:33:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:33:44.985344 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394caa4b-391e-4f93-b5c2-1094dde35dfa None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:44.990684 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-394caa4b-391e-4f93-b5c2-1094dde35dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:45.029833 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394caa4b-391e-4f93-b5c2-1094dde35dfa None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:45.053726 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65683a0b-0207-4aa5-a2c7-62a61979af08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:45.056552 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65683a0b-0207-4aa5-a2c7-62a61979af08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:45.058134 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65683a0b-0207-4aa5-a2c7-62a61979af08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:45.059416 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65683a0b-0207-4aa5-a2c7-62a61979af08 admin admin] PATH_INFO: `/v3/projects/371520b7d26441ab91dedd763ea113d7` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:45.065229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65683a0b-0207-4aa5-a2c7-62a61979af08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=371520b7d26441ab91dedd763ea113d7)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:45.067300 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65683a0b-0207-4aa5-a2c7-62a61979af08 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:45.256606 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:45.284241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-65683a0b-0207-4aa5-a2c7-62a61979af08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '371520b7d26441ab91dedd763ea113d7', 'request_id': 'req-65683a0b-0207-4aa5-a2c7-62a61979af08'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:45.321347 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-65683a0b-0207-4aa5-a2c7-62a61979af08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '371520b7d26441ab91dedd763ea113d7', 'request_id': 'req-65683a0b-0207-4aa5-a2c7-62a61979af08'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:46.594321 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-65683a0b-0207-4aa5-a2c7-62a61979af08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '371520b7d26441ab91dedd763ea113d7', 'request_id': 'req-65683a0b-0207-4aa5-a2c7-62a61979af08'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:46.609627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-65683a0b-0207-4aa5-a2c7-62a61979af08 admin admin] The token cache is being invalidate because project 371520b7d26441ab91dedd763ea113d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:33:46.609925 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-65683a0b-0207-4aa5-a2c7-62a61979af08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:46.610607 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-65683a0b-0207-4aa5-a2c7-62a61979af08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:46.612182 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1317/2611] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:33:44 2022] DELETE /identity/v3/projects/371520b7d26441ab91dedd763ea113d7 => generated 0 bytes in 1628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:33:46.617849 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21155c-142f-4984-aa15-56c9586fab8a service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:46.635505 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21155c-142f-4984-aa15-56c9586fab8a service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:46.715972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0f77b-684e-4bdf-ad20-3a284b6c3bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:46.716645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0f77b-684e-4bdf-ad20-3a284b6c3bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:46.716932 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0f77b-684e-4bdf-ad20-3a284b6c3bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:46.717211 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0f77b-684e-4bdf-ad20-3a284b6c3bea admin admin] PATH_INFO: `/v3/users/7b50df0ae0e14d489425ce3c596c7c6d` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:46.718757 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0f77b-684e-4bdf-ad20-3a284b6c3bea admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b50df0ae0e14d489425ce3c596c7c6d)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:46.720792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0f77b-684e-4bdf-ad20-3a284b6c3bea admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:47.068365 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:47.077323 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-e5b0f77b-684e-4bdf-ad20-3a284b6c3bea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b50df0ae0e14d489425ce3c596c7c6d'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:47.211361 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-e5b0f77b-684e-4bdf-ad20-3a284b6c3bea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b50df0ae0e14d489425ce3c596c7c6d'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:47.212429 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-e5b0f77b-684e-4bdf-ad20-3a284b6c3bea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b50df0ae0e14d489425ce3c596c7c6d'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:47.213014 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-e5b0f77b-684e-4bdf-ad20-3a284b6c3bea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b50df0ae0e14d489425ce3c596c7c6d'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:47.222154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-e5b0f77b-684e-4bdf-ad20-3a284b6c3bea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b50df0ae0e14d489425ce3c596c7c6d'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:47.243234 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1295/2612] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:33:46 2022] DELETE /identity/v3/users/7b50df0ae0e14d489425ce3c596c7c6d => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:33:48.064661 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65683a0b-0207-4aa5-a2c7-62a61979af08 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:48.067888 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-65683a0b-0207-4aa5-a2c7-62a61979af08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:48.089337 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65683a0b-0207-4aa5-a2c7-62a61979af08 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:48.167227 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a01f4-3215-49f3-be65-9d51e3bcc576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:48.168079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a01f4-3215-49f3-be65-9d51e3bcc576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:48.168568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a01f4-3215-49f3-be65-9d51e3bcc576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:48.169055 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a01f4-3215-49f3-be65-9d51e3bcc576 admin admin] PATH_INFO: `/v3/projects/ffa445eabfe9448b866e185f962ce38d` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:48.170680 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a01f4-3215-49f3-be65-9d51e3bcc576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffa445eabfe9448b866e185f962ce38d)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:48.173185 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a01f4-3215-49f3-be65-9d51e3bcc576 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:48.445665 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f77a01f4-3215-49f3-be65-9d51e3bcc576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffa445eabfe9448b866e185f962ce38d', 'request_id': 'req-f77a01f4-3215-49f3-be65-9d51e3bcc576'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:48.453677 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f77a01f4-3215-49f3-be65-9d51e3bcc576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffa445eabfe9448b866e185f962ce38d', 'request_id': 'req-f77a01f4-3215-49f3-be65-9d51e3bcc576'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:48.593250 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f77a01f4-3215-49f3-be65-9d51e3bcc576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffa445eabfe9448b866e185f962ce38d', 'request_id': 'req-f77a01f4-3215-49f3-be65-9d51e3bcc576'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:48.607802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f77a01f4-3215-49f3-be65-9d51e3bcc576 admin admin] The token cache is being invalidate because project ffa445eabfe9448b866e185f962ce38d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:33:48.608092 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f77a01f4-3215-49f3-be65-9d51e3bcc576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:48.608774 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f77a01f4-3215-49f3-be65-9d51e3bcc576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:33:48.610354 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1318/2613] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:33:48 2022] DELETE /identity/v3/projects/ffa445eabfe9448b866e185f962ce38d => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:33:48.615486 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7575f48-0f81-4eb3-a9c9-d10832df9806 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:48.616612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7575f48-0f81-4eb3-a9c9-d10832df9806 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:48.616612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7575f48-0f81-4eb3-a9c9-d10832df9806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:48.638105 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-c7575f48-0f81-4eb3-a9c9-d10832df9806 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:48.639260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c7575f48-0f81-4eb3-a9c9-d10832df9806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:48.702416 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1296/2614] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:33:48.774320 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960cf6c-38a5-46e9-96f1-5527e4107739 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:48.774610 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960cf6c-38a5-46e9-96f1-5527e4107739 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:48.774888 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960cf6c-38a5-46e9-96f1-5527e4107739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:48.807813 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-a960cf6c-38a5-46e9-96f1-5527e4107739 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:48.809825 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-a960cf6c-38a5-46e9-96f1-5527e4107739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:48.828797 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1319/2615] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:33:48.832175 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7575f48-0f81-4eb3-a9c9-d10832df9806 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:48.843945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7575f48-0f81-4eb3-a9c9-d10832df9806 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:48.850372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bc4c0-1a85-4708-b359-b4080bf52e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:48.851012 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bc4c0-1a85-4708-b359-b4080bf52e92 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:48.851294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bc4c0-1a85-4708-b359-b4080bf52e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:48.852273 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bc4c0-1a85-4708-b359-b4080bf52e92 admin admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:48.852273 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bc4c0-1a85-4708-b359-b4080bf52e92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:33:48.852750 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bc4c0-1a85-4708-b359-b4080bf52e92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:48.854299 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bc4c0-1a85-4708-b359-b4080bf52e92 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:48.868726 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1297/2616] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:33:48.883846 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960cf6c-38a5-46e9-96f1-5527e4107739 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:48.894619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960cf6c-38a5-46e9-96f1-5527e4107739 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:48.901522 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea01f58-c19d-4cd0-a28f-70a904d87df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:48.902581 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea01f58-c19d-4cd0-a28f-70a904d87df0 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:48.903076 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea01f58-c19d-4cd0-a28f-70a904d87df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:48.903604 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea01f58-c19d-4cd0-a28f-70a904d87df0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:48.904913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea01f58-c19d-4cd0-a28f-70a904d87df0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:48.916630 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea01f58-c19d-4cd0-a28f-70a904d87df0 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:49.039292 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1320/2617] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:33:48 2022] POST /identity/v3/projects => generated 407 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:33:49.043721 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bc4c0-1a85-4708-b359-b4080bf52e92 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:49.058055 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bc4c0-1a85-4708-b359-b4080bf52e92 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:49.180720 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f662bd-20ba-4ec2-bb5f-ea53ec11a5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:49.181406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f662bd-20ba-4ec2-bb5f-ea53ec11a5f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:49.181685 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f662bd-20ba-4ec2-bb5f-ea53ec11a5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:49.181954 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f662bd-20ba-4ec2-bb5f-ea53ec11a5f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:49.183115 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f662bd-20ba-4ec2-bb5f-ea53ec11a5f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:49.184642 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f662bd-20ba-4ec2-bb5f-ea53ec11a5f8 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:49.205343 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492e93c-c20b-429b-a8a3-40b3ebea8159 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:49.213064 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492e93c-c20b-429b-a8a3-40b3ebea8159 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:49.213064 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492e93c-c20b-429b-a8a3-40b3ebea8159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:49.232334 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-d492e93c-c20b-429b-a8a3-40b3ebea8159 None None] MFA Rules not processed for user `c314372147b2491cb4481d538056472c`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:49.233765 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-d492e93c-c20b-429b-a8a3-40b3ebea8159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:49.297634 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:49.357967 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1321/2618] 10.222.0.77 () {58 vars in 967 bytes} [Tue Sep 6 20:33:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:33:49.359974 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7e410-418b-40a1-8f59-70eebbf25fbb None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:49.360557 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7e410-418b-40a1-8f59-70eebbf25fbb None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:49.361102 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7e410-418b-40a1-8f59-70eebbf25fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:49.397059 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1298/2619] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:33:49 2022] POST /identity/v3/users => generated 304 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:33:49.400102 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-8dd7e410-418b-40a1-8f59-70eebbf25fbb None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:49.401422 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-8dd7e410-418b-40a1-8f59-70eebbf25fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:49.401605 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f662bd-20ba-4ec2-bb5f-ea53ec11a5f8 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:49.414072 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-10f662bd-20ba-4ec2-bb5f-ea53ec11a5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:49.415543 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1322/2620] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Sep 6 20:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:33:49.417516 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7e410-418b-40a1-8f59-70eebbf25fbb None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:49.433308 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7e410-418b-40a1-8f59-70eebbf25fbb None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:49.439591 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf49bc-6b9a-4e6d-99d4-68294c442d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:49.440679 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf49bc-6b9a-4e6d-99d4-68294c442d0f admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:49.441499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf49bc-6b9a-4e6d-99d4-68294c442d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:49.442770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf49bc-6b9a-4e6d-99d4-68294c442d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:49.445197 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf49bc-6b9a-4e6d-99d4-68294c442d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:49.447946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf49bc-6b9a-4e6d-99d4-68294c442d0f admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:49.465617 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1323/2621] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:33:49.467108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf49bc-6b9a-4e6d-99d4-68294c442d0f admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:49.470809 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-a8bf49bc-6b9a-4e6d-99d4-68294c442d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:49.523992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:49.577679 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f662bd-20ba-4ec2-bb5f-ea53ec11a5f8 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:49.585231 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf49bc-6b9a-4e6d-99d4-68294c442d0f admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:49.587637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348997a7-388d-458c-b3aa-ce4a8440ef81 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6c4f91a59548fd979e7232a2afd6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:49.588579 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348997a7-388d-458c-b3aa-ce4a8440ef81 service swift] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:49.589147 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348997a7-388d-458c-b3aa-ce4a8440ef81 service swift] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:49.589819 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348997a7-388d-458c-b3aa-ce4a8440ef81 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:49.595365 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734fb8d-3df5-4410-9bee-8b517df36f0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:49.596475 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734fb8d-3df5-4410-9bee-8b517df36f0b service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:49.596978 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734fb8d-3df5-4410-9bee-8b517df36f0b service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:49.597463 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734fb8d-3df5-4410-9bee-8b517df36f0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:49.604880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348997a7-388d-458c-b3aa-ce4a8440ef81 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:49.608530 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348997a7-388d-458c-b3aa-ce4a8440ef81 service swift] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:49.614141 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734fb8d-3df5-4410-9bee-8b517df36f0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:49.616994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734fb8d-3df5-4410-9bee-8b517df36f0b service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:49.626242 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1299/2622] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Sep 6 20:33:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 20:33:49.627922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348997a7-388d-458c-b3aa-ce4a8440ef81 service swift] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:49.648417 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1324/2623] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:33:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:33:49.661471 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348997a7-388d-458c-b3aa-ce4a8440ef81 service swift] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:49.670387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf71640-e6dd-43f5-8c79-a88eb460b106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:49.671077 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf71640-e6dd-43f5-8c79-a88eb460b106 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:49.671356 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf71640-e6dd-43f5-8c79-a88eb460b106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:49.671809 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf71640-e6dd-43f5-8c79-a88eb460b106 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:49.674080 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf71640-e6dd-43f5-8c79-a88eb460b106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:49.681760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf71640-e6dd-43f5-8c79-a88eb460b106 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:49.717961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1300/2624] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:33:49.724193 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734fb8d-3df5-4410-9bee-8b517df36f0b service nova] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:49.749427 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734fb8d-3df5-4410-9bee-8b517df36f0b service nova] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:49.766060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1edd05-028a-4f4b-88f3-2f56ed420bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:49.766060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1edd05-028a-4f4b-88f3-2f56ed420bd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:49.766060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1edd05-028a-4f4b-88f3-2f56ed420bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:49.766060 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1edd05-028a-4f4b-88f3-2f56ed420bd8 admin admin] PATH_INFO: `/v3/projects/aa6006e5cec4429b85df22f89c75be88/users/3d169206c85e4ee1ad0fe4bb9c97668c/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:49.791095 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1edd05-028a-4f4b-88f3-2f56ed420bd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa6006e5cec4429b85df22f89c75be88, user_id=3d169206c85e4ee1ad0fe4bb9c97668c, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:49.795016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1edd05-028a-4f4b-88f3-2f56ed420bd8 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:49.922145 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1325/2625] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:33:49 2022] PUT /identity/v3/projects/aa6006e5cec4429b85df22f89c75be88/users/3d169206c85e4ee1ad0fe4bb9c97668c/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:33:49.932565 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811449b-bd27-41e5-b157-ff59a12a3af0 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:49.932853 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811449b-bd27-41e5-b157-ff59a12a3af0 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:49.933136 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811449b-bd27-41e5-b157-ff59a12a3af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:49.982567 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-0811449b-bd27-41e5-b157-ff59a12a3af0 None None] MFA Rules not processed for user `3d169206c85e4ee1ad0fe4bb9c97668c`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:49.983888 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-0811449b-bd27-41e5-b157-ff59a12a3af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:50.082053 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1301/2626] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:33:49 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:33:50.088392 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1edd05-028a-4f4b-88f3-2f56ed420bd8 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:50.248972 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1edd05-028a-4f4b-88f3-2f56ed420bd8 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:50.261533 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30807b5d-9802-4cab-8309-d2e1454f1430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:50.261967 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30807b5d-9802-4cab-8309-d2e1454f1430 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:50.262321 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30807b5d-9802-4cab-8309-d2e1454f1430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:50.262611 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30807b5d-9802-4cab-8309-d2e1454f1430 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:50.263342 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30807b5d-9802-4cab-8309-d2e1454f1430 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:50.267970 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30807b5d-9802-4cab-8309-d2e1454f1430 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:50.556814 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1326/2627] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:33:50 2022] POST /identity/v3/projects => generated 409 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:33:50.561151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811449b-bd27-41e5-b157-ff59a12a3af0 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:50.573966 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811449b-bd27-41e5-b157-ff59a12a3af0 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:50.666311 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d88068-e8b1-4db9-963f-45dab6de1776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:50.667565 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d88068-e8b1-4db9-963f-45dab6de1776 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:50.668075 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d88068-e8b1-4db9-963f-45dab6de1776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:50.668549 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d88068-e8b1-4db9-963f-45dab6de1776 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:50.669692 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d88068-e8b1-4db9-963f-45dab6de1776 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:50.674546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d88068-e8b1-4db9-963f-45dab6de1776 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:50.827724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1302/2628] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:33:50 2022] POST /identity/v3/users => generated 311 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:33:50.836497 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30807b5d-9802-4cab-8309-d2e1454f1430 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:50.849243 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30807b5d-9802-4cab-8309-d2e1454f1430 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:50.857625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a07977-4b2a-4c0d-874f-b304c7b84558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:50.858303 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a07977-4b2a-4c0d-874f-b304c7b84558 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:50.858588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a07977-4b2a-4c0d-874f-b304c7b84558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:50.858858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a07977-4b2a-4c0d-874f-b304c7b84558 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:50.859602 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a07977-4b2a-4c0d-874f-b304c7b84558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:50.861345 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a07977-4b2a-4c0d-874f-b304c7b84558 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:50.862906 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:50.889466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1327/2629] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:33:50.893412 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d88068-e8b1-4db9-963f-45dab6de1776 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:50.904789 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d88068-e8b1-4db9-963f-45dab6de1776 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:50.909986 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854607c-7416-4c6a-aac5-ec8ced77e247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:50.910715 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854607c-7416-4c6a-aac5-ec8ced77e247 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:50.910994 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854607c-7416-4c6a-aac5-ec8ced77e247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:50.911268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854607c-7416-4c6a-aac5-ec8ced77e247 admin admin] PATH_INFO: `/v3/projects/697debe363ea4fc88fdd227a26ea71dc/users/bf885fbad8d247879fe6b820942f8168/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:50.934420 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854607c-7416-4c6a-aac5-ec8ced77e247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=697debe363ea4fc88fdd227a26ea71dc, user_id=bf885fbad8d247879fe6b820942f8168, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:50.940419 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854607c-7416-4c6a-aac5-ec8ced77e247 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:51.169468 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1303/2630] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:33:50 2022] PUT /identity/v3/projects/697debe363ea4fc88fdd227a26ea71dc/users/bf885fbad8d247879fe6b820942f8168/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:33:51.175342 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a07977-4b2a-4c0d-874f-b304c7b84558 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:51.190071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a07977-4b2a-4c0d-874f-b304c7b84558 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:51.262085 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e6bf6-2105-4ed4-9046-1907fdf609c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:51.262770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e6bf6-2105-4ed4-9046-1907fdf609c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:51.263072 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e6bf6-2105-4ed4-9046-1907fdf609c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:51.263361 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e6bf6-2105-4ed4-9046-1907fdf609c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:51.264069 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e6bf6-2105-4ed4-9046-1907fdf609c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:51.266017 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e6bf6-2105-4ed4-9046-1907fdf609c1 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:51.292875 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1328/2631] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:33:51.298007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854607c-7416-4c6a-aac5-ec8ced77e247 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:51.315943 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854607c-7416-4c6a-aac5-ec8ced77e247 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:51.316883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb40604-694d-4e49-8cee-603ade0e9f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:51.317266 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb40604-694d-4e49-8cee-603ade0e9f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:51.317460 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb40604-694d-4e49-8cee-603ade0e9f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:51.317686 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb40604-694d-4e49-8cee-603ade0e9f3b admin admin] PATH_INFO: `/v3/projects/697debe363ea4fc88fdd227a26ea71dc/users/bf885fbad8d247879fe6b820942f8168/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:51.320190 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb40604-694d-4e49-8cee-603ade0e9f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=697debe363ea4fc88fdd227a26ea71dc, user_id=bf885fbad8d247879fe6b820942f8168, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:51.323603 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb40604-694d-4e49-8cee-603ade0e9f3b admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:51.337915 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:51.362954 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1304/2632] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:33:51 2022] PUT /identity/v3/projects/697debe363ea4fc88fdd227a26ea71dc/users/bf885fbad8d247879fe6b820942f8168/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:33:51.367973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc38ea-a030-4518-ad5a-33d9270bb9da None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:51.368637 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc38ea-a030-4518-ad5a-33d9270bb9da None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:51.369255 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc38ea-a030-4518-ad5a-33d9270bb9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:51.452653 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-e0fc38ea-a030-4518-ad5a-33d9270bb9da None None] MFA Rules not processed for user `bf885fbad8d247879fe6b820942f8168`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:51.454398 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-e0fc38ea-a030-4518-ad5a-33d9270bb9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:51.580571 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1329/2633] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:33:51 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:33:51.594120 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb40604-694d-4e49-8cee-603ade0e9f3b admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:51.597959 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-8bb40604-694d-4e49-8cee-603ade0e9f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:51.733273 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb40604-694d-4e49-8cee-603ade0e9f3b admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:51.738610 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af29b41-53e3-4817-a4ec-658e63af21f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:51.739312 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af29b41-53e3-4817-a4ec-658e63af21f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:51.739732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af29b41-53e3-4817-a4ec-658e63af21f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:51.740055 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af29b41-53e3-4817-a4ec-658e63af21f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:51.762327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af29b41-53e3-4817-a4ec-658e63af21f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:51.764194 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af29b41-53e3-4817-a4ec-658e63af21f5 service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:51.782735 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1305/2634] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:33:51 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:33:52.511497 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc38ea-a030-4518-ad5a-33d9270bb9da None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:52.513813 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-e0fc38ea-a030-4518-ad5a-33d9270bb9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:52.532095 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc38ea-a030-4518-ad5a-33d9270bb9da None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:52.537866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bc242-2fcc-4c1a-8ed3-8b9db015c789 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:52.538673 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bc242-2fcc-4c1a-8ed3-8b9db015c789 service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:52.539059 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bc242-2fcc-4c1a-8ed3-8b9db015c789 service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:52.539484 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bc242-2fcc-4c1a-8ed3-8b9db015c789 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:52.636001 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63bc242-2fcc-4c1a-8ed3-8b9db015c789 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:52.637881 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63bc242-2fcc-4c1a-8ed3-8b9db015c789 service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:52.674003 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1330/2635] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:33:52 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:33:54.354431 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8181a3-1cfa-4503-a0a2-52f768a85d37 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:54.356015 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8181a3-1cfa-4503-a0a2-52f768a85d37 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:54.356406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8181a3-1cfa-4503-a0a2-52f768a85d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:54.381662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-de8181a3-1cfa-4503-a0a2-52f768a85d37 None None] MFA Rules not processed for user `c314372147b2491cb4481d538056472c`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:54.384050 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-de8181a3-1cfa-4503-a0a2-52f768a85d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:54.483358 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1306/2636] 10.222.0.77 () {58 vars in 967 bytes} [Tue Sep 6 20:33:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:33:54.510612 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bc242-2fcc-4c1a-8ed3-8b9db015c789 service cinder] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:54.547808 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=100 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:33:54.664717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bc242-2fcc-4c1a-8ed3-8b9db015c789 service cinder] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:54.684355 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3f7a1-3a60-42cb-9714-9f955a9465c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6c4f91a59548fd979e7232a2afd6ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:54.685566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3f7a1-3a60-42cb-9714-9f955a9465c0 service swift] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:54.685848 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3f7a1-3a60-42cb-9714-9f955a9465c0 service swift] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:54.686123 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3f7a1-3a60-42cb-9714-9f955a9465c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:54.710461 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3f7a1-3a60-42cb-9714-9f955a9465c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:54.710461 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3f7a1-3a60-42cb-9714-9f955a9465c0 service swift] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:54.719161 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1331/2637] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Sep 6 20:33:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 20:33:54.927122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff984d7a-65e0-4a0f-b977-6ced327f369b None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:54.927562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff984d7a-65e0-4a0f-b977-6ced327f369b None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:54.928248 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff984d7a-65e0-4a0f-b977-6ced327f369b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:54.966070 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-ff984d7a-65e0-4a0f-b977-6ced327f369b None None] MFA Rules not processed for user `87d974bb5cf94567b1493fa54e804374`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:33:54.969339 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-ff984d7a-65e0-4a0f-b977-6ced327f369b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:55.108189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1307/2638] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:33:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:33:57.933867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3f7a1-3a60-42cb-9714-9f955a9465c0 service swift] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:33:57.935511 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-a8a3f7a1-3a60-42cb-9714-9f955a9465c0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:58.021566 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3f7a1-3a60-42cb-9714-9f955a9465c0 service swift] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:33:58.026993 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433e84f-8876-45de-b206-4ce2f1ca0fb8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a486663ec144db0bbde6bf3deb35a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:33:58.027661 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433e84f-8876-45de-b206-4ce2f1ca0fb8 service placement] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:33:58.027943 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433e84f-8876-45de-b206-4ce2f1ca0fb8 service placement] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:33:58.028220 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433e84f-8876-45de-b206-4ce2f1ca0fb8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:33:58.030103 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-2433e84f-8876-45de-b206-4ce2f1ca0fb8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:33:58.043237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2433e84f-8876-45de-b206-4ce2f1ca0fb8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:33:58.045768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2433e84f-8876-45de-b206-4ce2f1ca0fb8 service placement] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:33:58.060054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1332/2639] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:33:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:34:03.612836 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff984d7a-65e0-4a0f-b977-6ced327f369b None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:03.653785 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433e84f-8876-45de-b206-4ce2f1ca0fb8 service placement] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:03.656016 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-2433e84f-8876-45de-b206-4ce2f1ca0fb8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:03.722039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=100 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:34:03.764655 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff984d7a-65e0-4a0f-b977-6ced327f369b None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:03.764655 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3228ec-bd0e-4cba-bd2e-34581294f4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:03.764655 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3228ec-bd0e-4cba-bd2e-34581294f4cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:03.764655 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3228ec-bd0e-4cba-bd2e-34581294f4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:03.765272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3228ec-bd0e-4cba-bd2e-34581294f4cd admin admin] PATH_INFO: `/v3/users/3d169206c85e4ee1ad0fe4bb9c97668c` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:03.765272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3228ec-bd0e-4cba-bd2e-34581294f4cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d169206c85e4ee1ad0fe4bb9c97668c)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:03.767255 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3228ec-bd0e-4cba-bd2e-34581294f4cd admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:03.769922 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433e84f-8876-45de-b206-4ce2f1ca0fb8 service placement] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:03.774871 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca07d7-3d94-4abc-a63c-0cabcdb87cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:03.775629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca07d7-3d94-4abc-a63c-0cabcdb87cbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:03.776043 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca07d7-3d94-4abc-a63c-0cabcdb87cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:03.776322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca07d7-3d94-4abc-a63c-0cabcdb87cbc admin admin] PATH_INFO: `/v3/users/3a9c5777bcc149ea9a30f3fd1fca12ef` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:03.777536 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca07d7-3d94-4abc-a63c-0cabcdb87cbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a9c5777bcc149ea9a30f3fd1fca12ef)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:03.779587 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca07d7-3d94-4abc-a63c-0cabcdb87cbc admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:04.177215 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:34:04.198556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f8ca07d7-3d94-4abc-a63c-0cabcdb87cbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a9c5777bcc149ea9a30f3fd1fca12ef'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:04.203660 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-6b3228ec-bd0e-4cba-bd2e-34581294f4cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d169206c85e4ee1ad0fe4bb9c97668c'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:04.491030 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f8ca07d7-3d94-4abc-a63c-0cabcdb87cbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a9c5777bcc149ea9a30f3fd1fca12ef'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:04.496145 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f8ca07d7-3d94-4abc-a63c-0cabcdb87cbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a9c5777bcc149ea9a30f3fd1fca12ef'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:04.496891 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f8ca07d7-3d94-4abc-a63c-0cabcdb87cbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a9c5777bcc149ea9a30f3fd1fca12ef'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:04.519077 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f8ca07d7-3d94-4abc-a63c-0cabcdb87cbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a9c5777bcc149ea9a30f3fd1fca12ef'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:04.541934 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1333/2640] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:34:03 2022] DELETE /identity/v3/users/3a9c5777bcc149ea9a30f3fd1fca12ef => generated 0 bytes in 889 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:34:04.953287 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-6b3228ec-bd0e-4cba-bd2e-34581294f4cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d169206c85e4ee1ad0fe4bb9c97668c'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:04.954307 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-6b3228ec-bd0e-4cba-bd2e-34581294f4cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d169206c85e4ee1ad0fe4bb9c97668c'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:04.954980 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-6b3228ec-bd0e-4cba-bd2e-34581294f4cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d169206c85e4ee1ad0fe4bb9c97668c'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:04.964083 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-6b3228ec-bd0e-4cba-bd2e-34581294f4cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d169206c85e4ee1ad0fe4bb9c97668c'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:04.984299 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1308/2641] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:34:03 2022] DELETE /identity/v3/users/3d169206c85e4ee1ad0fe4bb9c97668c => generated 0 bytes in 1372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:34:04.988636 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96223a-2b8e-49a4-8d71-7d7167dcd21e None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:04.989193 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96223a-2b8e-49a4-8d71-7d7167dcd21e None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:04.989193 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96223a-2b8e-49a4-8d71-7d7167dcd21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:05.009660 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-1e96223a-2b8e-49a4-8d71-7d7167dcd21e None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:34:05.010986 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-1e96223a-2b8e-49a4-8d71-7d7167dcd21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:05.044202 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3228ec-bd0e-4cba-bd2e-34581294f4cd admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:05.046339 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6b3228ec-bd0e-4cba-bd2e-34581294f4cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:05.108638 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1334/2642] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:34:05.121896 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96223a-2b8e-49a4-8d71-7d7167dcd21e None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:05.123288 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-1e96223a-2b8e-49a4-8d71-7d7167dcd21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:05.171833 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3228ec-bd0e-4cba-bd2e-34581294f4cd admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:05.171833 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386ce78-3ac6-4b7d-a356-96a970407f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:05.171833 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386ce78-3ac6-4b7d-a356-96a970407f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:05.171833 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386ce78-3ac6-4b7d-a356-96a970407f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:05.172224 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386ce78-3ac6-4b7d-a356-96a970407f75 admin admin] PATH_INFO: `/v3/projects/c94581b77a6d4ebb8bdd5d9db2eee048` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:05.174827 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386ce78-3ac6-4b7d-a356-96a970407f75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c94581b77a6d4ebb8bdd5d9db2eee048)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:05.177312 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386ce78-3ac6-4b7d-a356-96a970407f75 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:05.195017 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96223a-2b8e-49a4-8d71-7d7167dcd21e None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:05.200365 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712179f3-45d3-4d8e-8e30-6769f496db05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:05.201006 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712179f3-45d3-4d8e-8e30-6769f496db05 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:05.201283 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712179f3-45d3-4d8e-8e30-6769f496db05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:05.201556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712179f3-45d3-4d8e-8e30-6769f496db05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:05.213642 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712179f3-45d3-4d8e-8e30-6769f496db05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:05.225387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712179f3-45d3-4d8e-8e30-6769f496db05 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:05.230751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1335/2643] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:34:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:34:05.466574 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-b386ce78-3ac6-4b7d-a356-96a970407f75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c94581b77a6d4ebb8bdd5d9db2eee048', 'request_id': 'req-b386ce78-3ac6-4b7d-a356-96a970407f75'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:05.476575 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-b386ce78-3ac6-4b7d-a356-96a970407f75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c94581b77a6d4ebb8bdd5d9db2eee048', 'request_id': 'req-b386ce78-3ac6-4b7d-a356-96a970407f75'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:05.697506 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-b386ce78-3ac6-4b7d-a356-96a970407f75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c94581b77a6d4ebb8bdd5d9db2eee048', 'request_id': 'req-b386ce78-3ac6-4b7d-a356-96a970407f75'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:05.713926 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:34:05.718889 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-b386ce78-3ac6-4b7d-a356-96a970407f75 admin admin] The token cache is being invalidate because project c94581b77a6d4ebb8bdd5d9db2eee048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:34:05.719573 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-b386ce78-3ac6-4b7d-a356-96a970407f75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:05.720527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-b386ce78-3ac6-4b7d-a356-96a970407f75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:05.722787 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1309/2644] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:34:05 2022] DELETE /identity/v3/projects/c94581b77a6d4ebb8bdd5d9db2eee048 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:34:05.728281 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712179f3-45d3-4d8e-8e30-6769f496db05 service neutron] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:05.745796 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712179f3-45d3-4d8e-8e30-6769f496db05 service neutron] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:05.931530 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d68fb9-9d04-4407-924a-8213fa93cdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:05.932418 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d68fb9-9d04-4407-924a-8213fa93cdfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:05.933465 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d68fb9-9d04-4407-924a-8213fa93cdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:05.933983 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d68fb9-9d04-4407-924a-8213fa93cdfd admin admin] PATH_INFO: `/v3/users/97a85f348c4d4eaea66042ecf4999daa` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:05.936182 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d68fb9-9d04-4407-924a-8213fa93cdfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=97a85f348c4d4eaea66042ecf4999daa)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:05.938643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d68fb9-9d04-4407-924a-8213fa93cdfd admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:06.117813 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386ce78-3ac6-4b7d-a356-96a970407f75 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:06.119895 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-b386ce78-3ac6-4b7d-a356-96a970407f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:06.156009 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386ce78-3ac6-4b7d-a356-96a970407f75 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:06.160825 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e649afa-e315-4be5-a5b8-9c04682a2ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:06.162209 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e649afa-e315-4be5-a5b8-9c04682a2ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:06.162705 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e649afa-e315-4be5-a5b8-9c04682a2ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:06.163200 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e649afa-e315-4be5-a5b8-9c04682a2ceb admin admin] PATH_INFO: `/v3/projects/aa6006e5cec4429b85df22f89c75be88` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:06.166209 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e649afa-e315-4be5-a5b8-9c04682a2ceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa6006e5cec4429b85df22f89c75be88)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:06.170963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e649afa-e315-4be5-a5b8-9c04682a2ceb admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:06.344980 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c7d68fb9-9d04-4407-924a-8213fa93cdfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97a85f348c4d4eaea66042ecf4999daa'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:06.496640 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-8e649afa-e315-4be5-a5b8-9c04682a2ceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa6006e5cec4429b85df22f89c75be88', 'request_id': 'req-8e649afa-e315-4be5-a5b8-9c04682a2ceb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:06.506566 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-8e649afa-e315-4be5-a5b8-9c04682a2ceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa6006e5cec4429b85df22f89c75be88', 'request_id': 'req-8e649afa-e315-4be5-a5b8-9c04682a2ceb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:06.576520 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c7d68fb9-9d04-4407-924a-8213fa93cdfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97a85f348c4d4eaea66042ecf4999daa'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:06.577178 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c7d68fb9-9d04-4407-924a-8213fa93cdfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97a85f348c4d4eaea66042ecf4999daa'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:06.578004 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c7d68fb9-9d04-4407-924a-8213fa93cdfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97a85f348c4d4eaea66042ecf4999daa'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:06.586761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-c7d68fb9-9d04-4407-924a-8213fa93cdfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97a85f348c4d4eaea66042ecf4999daa'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:06.606731 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1336/2645] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:34:05 2022] DELETE /identity/v3/users/97a85f348c4d4eaea66042ecf4999daa => generated 0 bytes in 880 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:34:06.724823 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-8e649afa-e315-4be5-a5b8-9c04682a2ceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa6006e5cec4429b85df22f89c75be88', 'request_id': 'req-8e649afa-e315-4be5-a5b8-9c04682a2ceb'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:06.743608 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-8e649afa-e315-4be5-a5b8-9c04682a2ceb admin admin] The token cache is being invalidate because project aa6006e5cec4429b85df22f89c75be88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:34:06.743976 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-8e649afa-e315-4be5-a5b8-9c04682a2ceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:06.745295 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-8e649afa-e315-4be5-a5b8-9c04682a2ceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:06.751578 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1310/2646] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:34:06 2022] DELETE /identity/v3/projects/aa6006e5cec4429b85df22f89c75be88 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:34:06.753423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d68fb9-9d04-4407-924a-8213fa93cdfd admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:06.762214 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-c7d68fb9-9d04-4407-924a-8213fa93cdfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:06.841912 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:34:06.859062 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d68fb9-9d04-4407-924a-8213fa93cdfd admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:06.864795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd2de0-b768-42e0-b066-4a976dc0dcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:06.865549 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd2de0-b768-42e0-b066-4a976dc0dcee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:06.865834 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd2de0-b768-42e0-b066-4a976dc0dcee admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:06.866377 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd2de0-b768-42e0-b066-4a976dc0dcee admin admin] PATH_INFO: `/v3/users/bf885fbad8d247879fe6b820942f8168` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:06.867477 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd2de0-b768-42e0-b066-4a976dc0dcee admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf885fbad8d247879fe6b820942f8168)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:06.869644 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd2de0-b768-42e0-b066-4a976dc0dcee admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:06.976467 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e649afa-e315-4be5-a5b8-9c04682a2ceb admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:06.977914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-8e649afa-e315-4be5-a5b8-9c04682a2ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:07.105357 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e649afa-e315-4be5-a5b8-9c04682a2ceb admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:07.110495 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864e9ce-5123-47f1-9695-bf19831ee982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:07.111145 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864e9ce-5123-47f1-9695-bf19831ee982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:07.112151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864e9ce-5123-47f1-9695-bf19831ee982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:07.112151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864e9ce-5123-47f1-9695-bf19831ee982 admin admin] PATH_INFO: `/v3/projects/54126cdbb91c479286bc2fd86c7e21bf` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:07.113287 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864e9ce-5123-47f1-9695-bf19831ee982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54126cdbb91c479286bc2fd86c7e21bf)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:07.115468 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864e9ce-5123-47f1-9695-bf19831ee982 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:07.203742 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-84bd2de0-b768-42e0-b066-4a976dc0dcee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf885fbad8d247879fe6b820942f8168'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:07.311691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9864e9ce-5123-47f1-9695-bf19831ee982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54126cdbb91c479286bc2fd86c7e21bf', 'request_id': 'req-9864e9ce-5123-47f1-9695-bf19831ee982'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:07.319268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9864e9ce-5123-47f1-9695-bf19831ee982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54126cdbb91c479286bc2fd86c7e21bf', 'request_id': 'req-9864e9ce-5123-47f1-9695-bf19831ee982'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:07.342898 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-84bd2de0-b768-42e0-b066-4a976dc0dcee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf885fbad8d247879fe6b820942f8168'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:07.343973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-84bd2de0-b768-42e0-b066-4a976dc0dcee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf885fbad8d247879fe6b820942f8168'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:07.345938 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-84bd2de0-b768-42e0-b066-4a976dc0dcee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf885fbad8d247879fe6b820942f8168'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:07.358486 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-84bd2de0-b768-42e0-b066-4a976dc0dcee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf885fbad8d247879fe6b820942f8168'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:07.383951 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1337/2647] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:34:06 2022] DELETE /identity/v3/users/bf885fbad8d247879fe6b820942f8168 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:34:07.531291 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9864e9ce-5123-47f1-9695-bf19831ee982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54126cdbb91c479286bc2fd86c7e21bf', 'request_id': 'req-9864e9ce-5123-47f1-9695-bf19831ee982'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:07.553810 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9864e9ce-5123-47f1-9695-bf19831ee982 admin admin] The token cache is being invalidate because project 54126cdbb91c479286bc2fd86c7e21bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:34:07.554324 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9864e9ce-5123-47f1-9695-bf19831ee982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:07.555726 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-9864e9ce-5123-47f1-9695-bf19831ee982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:07.560039 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1311/2648] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:34:06 2022] DELETE /identity/v3/projects/54126cdbb91c479286bc2fd86c7e21bf => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:34:07.568465 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779e360-d200-42d9-8921-728d631b50b5 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:07.569195 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779e360-d200-42d9-8921-728d631b50b5 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:07.569537 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779e360-d200-42d9-8921-728d631b50b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:07.608672 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-2779e360-d200-42d9-8921-728d631b50b5 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:34:07.610945 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-2779e360-d200-42d9-8921-728d631b50b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:07.723614 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1338/2649] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:34:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:34:07.732011 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa2d72-ce35-4baf-84d3-895d7de0bcbf None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:07.732425 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa2d72-ce35-4baf-84d3-895d7de0bcbf None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:07.732745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa2d72-ce35-4baf-84d3-895d7de0bcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:07.780659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-8eaa2d72-ce35-4baf-84d3-895d7de0bcbf None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:34:07.782339 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-8eaa2d72-ce35-4baf-84d3-895d7de0bcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:07.805987 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1312/2650] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:34:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:34:07.813229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779e360-d200-42d9-8921-728d631b50b5 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:07.836735 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779e360-d200-42d9-8921-728d631b50b5 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:07.846362 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5deb1c4-c429-4dcc-b583-8f0a032d899a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:07.847898 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deb1c4-c429-4dcc-b583-8f0a032d899a admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:07.848364 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deb1c4-c429-4dcc-b583-8f0a032d899a admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:07.849371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deb1c4-c429-4dcc-b583-8f0a032d899a admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:07.850814 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5deb1c4-c429-4dcc-b583-8f0a032d899a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:34:07.851510 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5deb1c4-c429-4dcc-b583-8f0a032d899a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:07.854722 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5deb1c4-c429-4dcc-b583-8f0a032d899a admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:07.877688 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1339/2651] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:34:07.879411 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa2d72-ce35-4baf-84d3-895d7de0bcbf None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:07.891559 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa2d72-ce35-4baf-84d3-895d7de0bcbf None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:07.898468 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52f09e-4ef8-4de5-9e91-f24ff42540bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:07.899113 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52f09e-4ef8-4de5-9e91-f24ff42540bf admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:07.904956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52f09e-4ef8-4de5-9e91-f24ff42540bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:07.904956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52f09e-4ef8-4de5-9e91-f24ff42540bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:07.904956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52f09e-4ef8-4de5-9e91-f24ff42540bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:07.904956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52f09e-4ef8-4de5-9e91-f24ff42540bf admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:08.020749 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1313/2652] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:34:07 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:34:08.030568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5deb1c4-c429-4dcc-b583-8f0a032d899a admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:08.030568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-d5deb1c4-c429-4dcc-b583-8f0a032d899a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:08.035143 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52f09e-4ef8-4de5-9e91-f24ff42540bf admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:08.050089 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5deb1c4-c429-4dcc-b583-8f0a032d899a admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:08.152227 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8e234-1c55-4586-bd22-393442aa80d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:08.153236 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8e234-1c55-4586-bd22-393442aa80d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:08.154183 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52f09e-4ef8-4de5-9e91-f24ff42540bf admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:08.154391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8e234-1c55-4586-bd22-393442aa80d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:08.154965 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8e234-1c55-4586-bd22-393442aa80d7 admin admin] PATH_INFO: `/v3/projects/697debe363ea4fc88fdd227a26ea71dc` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:08.157210 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb8e234-1c55-4586-bd22-393442aa80d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=697debe363ea4fc88fdd227a26ea71dc)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:08.160743 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb8e234-1c55-4586-bd22-393442aa80d7 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:08.164037 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48ce1c-6ffe-4a54-b492-6117572c352b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:08.165516 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48ce1c-6ffe-4a54-b492-6117572c352b admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:08.165971 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48ce1c-6ffe-4a54-b492-6117572c352b admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:08.166412 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48ce1c-6ffe-4a54-b492-6117572c352b admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:08.167536 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48ce1c-6ffe-4a54-b492-6117572c352b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:08.171312 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48ce1c-6ffe-4a54-b492-6117572c352b admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:08.281059 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1314/2653] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:34:08 2022] POST /identity/v3/users => generated 287 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:34:08.286174 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48ce1c-6ffe-4a54-b492-6117572c352b admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:08.299379 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48ce1c-6ffe-4a54-b492-6117572c352b admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:08.301854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-8fb8e234-1c55-4586-bd22-393442aa80d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '697debe363ea4fc88fdd227a26ea71dc', 'request_id': 'req-8fb8e234-1c55-4586-bd22-393442aa80d7'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:08.309896 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-8fb8e234-1c55-4586-bd22-393442aa80d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '697debe363ea4fc88fdd227a26ea71dc', 'request_id': 'req-8fb8e234-1c55-4586-bd22-393442aa80d7'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:08.407134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d55a28-9330-489e-a641-0681ff26eb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:08.408267 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d55a28-9330-489e-a641-0681ff26eb63 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:08.408776 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d55a28-9330-489e-a641-0681ff26eb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:08.409259 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d55a28-9330-489e-a641-0681ff26eb63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:08.411426 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d55a28-9330-489e-a641-0681ff26eb63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:08.415184 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d55a28-9330-489e-a641-0681ff26eb63 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:08.440490 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-8fb8e234-1c55-4586-bd22-393442aa80d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '697debe363ea4fc88fdd227a26ea71dc', 'request_id': 'req-8fb8e234-1c55-4586-bd22-393442aa80d7'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:08.443937 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1315/2654] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:34:08.445862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d55a28-9330-489e-a641-0681ff26eb63 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:08.469092 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-8fb8e234-1c55-4586-bd22-393442aa80d7 admin admin] The token cache is being invalidate because project 697debe363ea4fc88fdd227a26ea71dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:34:08.469092 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-8fb8e234-1c55-4586-bd22-393442aa80d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:08.469092 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-8fb8e234-1c55-4586-bd22-393442aa80d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:08.469092 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1340/2655] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:34:08 2022] DELETE /identity/v3/projects/697debe363ea4fc88fdd227a26ea71dc => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:34:08.474242 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b9ead-7323-4d02-baa4-f1d20e75de86 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:08.475145 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b9ead-7323-4d02-baa4-f1d20e75de86 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:08.475959 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b9ead-7323-4d02-baa4-f1d20e75de86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:08.483561 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d55a28-9330-489e-a641-0681ff26eb63 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:08.492560 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20de453-5d4b-44cc-825c-f35f5952f172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:08.493621 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20de453-5d4b-44cc-825c-f35f5952f172 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:08.494117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20de453-5d4b-44cc-825c-f35f5952f172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:08.494615 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20de453-5d4b-44cc-825c-f35f5952f172 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:08.495865 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20de453-5d4b-44cc-825c-f35f5952f172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:08.499327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20de453-5d4b-44cc-825c-f35f5952f172 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:08.506218 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-337b9ead-7323-4d02-baa4-f1d20e75de86 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:34:08.511603 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-337b9ead-7323-4d02-baa4-f1d20e75de86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:08.524445 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1341/2656] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:34:08.524941 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1316/2657] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:34:08.532091 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b9ead-7323-4d02-baa4-f1d20e75de86 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:08.534526 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-337b9ead-7323-4d02-baa4-f1d20e75de86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:08.536050 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27905e89-a247-4232-97c7-88e3118a3599 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:08.536583 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27905e89-a247-4232-97c7-88e3118a3599 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:08.536940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27905e89-a247-4232-97c7-88e3118a3599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:08.559972 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b9ead-7323-4d02-baa4-f1d20e75de86 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:08.566308 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a643c-eb9a-4ad9-a532-4f8a470cb8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:08.567053 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a643c-eb9a-4ad9-a532-4f8a470cb8f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:08.567336 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a643c-eb9a-4ad9-a532-4f8a470cb8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:08.567720 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a643c-eb9a-4ad9-a532-4f8a470cb8f5 admin admin] PATH_INFO: `/v3/projects/efb1e75cc0bf464789bcb3e41623197d/users/aa0bb9aa1ac741faa2ea3ab0ae0f334d/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:08.585446 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-27905e89-a247-4232-97c7-88e3118a3599 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:34:08.588763 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-27905e89-a247-4232-97c7-88e3118a3599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:08.589831 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a643c-eb9a-4ad9-a532-4f8a470cb8f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb1e75cc0bf464789bcb3e41623197d, user_id=aa0bb9aa1ac741faa2ea3ab0ae0f334d, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:08.592901 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a643c-eb9a-4ad9-a532-4f8a470cb8f5 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:08.604497 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1317/2658] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:34:08.610086 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27905e89-a247-4232-97c7-88e3118a3599 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:08.628366 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27905e89-a247-4232-97c7-88e3118a3599 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:08.637142 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e45e29-0941-4a5d-ab21-af9865690289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:08.638355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e45e29-0941-4a5d-ab21-af9865690289 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:08.638791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e45e29-0941-4a5d-ab21-af9865690289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:08.639281 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e45e29-0941-4a5d-ab21-af9865690289 admin admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:08.640636 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e45e29-0941-4a5d-ab21-af9865690289 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:34:08.641183 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e45e29-0941-4a5d-ab21-af9865690289 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:08.644672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e45e29-0941-4a5d-ab21-af9865690289 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:08.667633 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1318/2659] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:34:08.674530 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e45e29-0941-4a5d-ab21-af9865690289 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:08.695542 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e45e29-0941-4a5d-ab21-af9865690289 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:08.702868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a651a2f-f180-4555-bb88-0d5e839adaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:08.703611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a651a2f-f180-4555-bb88-0d5e839adaec admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:08.704046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a651a2f-f180-4555-bb88-0d5e839adaec admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:08.704815 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a651a2f-f180-4555-bb88-0d5e839adaec admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:08.705043 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a651a2f-f180-4555-bb88-0d5e839adaec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:08.707101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a651a2f-f180-4555-bb88-0d5e839adaec admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:08.713577 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1342/2660] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:34:08 2022] PUT /identity/v3/projects/efb1e75cc0bf464789bcb3e41623197d/users/aa0bb9aa1ac741faa2ea3ab0ae0f334d/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:34:08.720574 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020e65f-9fc6-4acd-8e24-58a6f5137945 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:08.733022 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020e65f-9fc6-4acd-8e24-58a6f5137945 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:08.733022 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020e65f-9fc6-4acd-8e24-58a6f5137945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:08.751619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-e020e65f-9fc6-4acd-8e24-58a6f5137945 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:34:08.752898 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-e020e65f-9fc6-4acd-8e24-58a6f5137945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:08.829423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1343/2661] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:34:08.838315 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1319/2662] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:34:08 2022] POST /identity/v3/projects => generated 367 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:34:08.842406 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020e65f-9fc6-4acd-8e24-58a6f5137945 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:08.846012 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a651a2f-f180-4555-bb88-0d5e839adaec admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:08.848796 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6a651a2f-f180-4555-bb88-0d5e839adaec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:08.853501 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020e65f-9fc6-4acd-8e24-58a6f5137945 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:08.926297 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a651a2f-f180-4555-bb88-0d5e839adaec admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:08.927493 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003f585-845d-4d67-8730-84d6b69b2d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:08.928111 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003f585-845d-4d67-8730-84d6b69b2d80 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:08.928386 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003f585-845d-4d67-8730-84d6b69b2d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:08.928660 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003f585-845d-4d67-8730-84d6b69b2d80 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:08.929484 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003f585-845d-4d67-8730-84d6b69b2d80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:08.931605 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003f585-845d-4d67-8730-84d6b69b2d80 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:08.932557 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6123ab-842c-48d6-83e2-d744dd0768f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:08.933611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6123ab-842c-48d6-83e2-d744dd0768f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:08.934078 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6123ab-842c-48d6-83e2-d744dd0768f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:08.934524 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6123ab-842c-48d6-83e2-d744dd0768f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:08.949787 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6123ab-842c-48d6-83e2-d744dd0768f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:08.952660 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6123ab-842c-48d6-83e2-d744dd0768f3 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:08.966495 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1320/2663] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:34:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:34:09.080287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1344/2664] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:34:08 2022] POST /identity/v3/users => generated 284 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:34:09.087960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6123ab-842c-48d6-83e2-d744dd0768f3 service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:09.100114 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6123ab-842c-48d6-83e2-d744dd0768f3 service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:09.105167 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf50f0-38a7-44b7-a114-b3e942fd85a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:09.105772 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf50f0-38a7-44b7-a114-b3e942fd85a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:09.106089 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf50f0-38a7-44b7-a114-b3e942fd85a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:09.106363 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf50f0-38a7-44b7-a114-b3e942fd85a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:09.107005 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf50f0-38a7-44b7-a114-b3e942fd85a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:09.108722 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf50f0-38a7-44b7-a114-b3e942fd85a6 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:09.122565 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1321/2665] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:34:09.127355 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003f585-845d-4d67-8730-84d6b69b2d80 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:09.138703 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003f585-845d-4d67-8730-84d6b69b2d80 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:09.143881 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b951c-6d9e-41f5-bdd3-f8450a224006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:09.144526 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b951c-6d9e-41f5-bdd3-f8450a224006 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:09.144867 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b951c-6d9e-41f5-bdd3-f8450a224006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:09.145173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b951c-6d9e-41f5-bdd3-f8450a224006 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:09.145986 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b951c-6d9e-41f5-bdd3-f8450a224006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:09.147757 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b951c-6d9e-41f5-bdd3-f8450a224006 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:09.159239 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1345/2666] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:34:09.166473 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf50f0-38a7-44b7-a114-b3e942fd85a6 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:09.178509 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf50f0-38a7-44b7-a114-b3e942fd85a6 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:09.184156 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717dcfc-48d8-4549-8d36-491e49f030ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:09.184906 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717dcfc-48d8-4549-8d36-491e49f030ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:09.185282 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717dcfc-48d8-4549-8d36-491e49f030ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:09.185602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717dcfc-48d8-4549-8d36-491e49f030ae admin admin] PATH_INFO: `/v3/projects/07bb1022acde409587c37d1b5e16629f/users/9277158987af42af9586c0d9f0d6193c/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:09.205517 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717dcfc-48d8-4549-8d36-491e49f030ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=07bb1022acde409587c37d1b5e16629f, user_id=9277158987af42af9586c0d9f0d6193c, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:09.208777 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717dcfc-48d8-4549-8d36-491e49f030ae admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:09.292245 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1322/2667] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:34:09 2022] PUT /identity/v3/projects/07bb1022acde409587c37d1b5e16629f/users/9277158987af42af9586c0d9f0d6193c/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:34:09.312124 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e04ea0-908d-4953-91cb-3f510b328084 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:09.312646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e04ea0-908d-4953-91cb-3f510b328084 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:09.313121 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e04ea0-908d-4953-91cb-3f510b328084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:09.365499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-58e04ea0-908d-4953-91cb-3f510b328084 None None] MFA Rules not processed for user `9277158987af42af9586c0d9f0d6193c`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:34:09.366791 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-58e04ea0-908d-4953-91cb-3f510b328084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:09.449504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1346/2668] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:34:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:34:09.453648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:34:09.462722 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717dcfc-48d8-4549-8d36-491e49f030ae admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:09.572852 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717dcfc-48d8-4549-8d36-491e49f030ae admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:09.578128 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb610e1b-3671-4ec4-b2f3-8b2b4ac5227b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:09.578869 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb610e1b-3671-4ec4-b2f3-8b2b4ac5227b admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:09.579145 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb610e1b-3671-4ec4-b2f3-8b2b4ac5227b admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:09.579434 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb610e1b-3671-4ec4-b2f3-8b2b4ac5227b admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:09.580402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb610e1b-3671-4ec4-b2f3-8b2b4ac5227b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:09.583295 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb610e1b-3671-4ec4-b2f3-8b2b4ac5227b admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:09.730440 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1323/2669] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:34:09 2022] POST /identity/v3/projects => generated 365 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:34:09.737170 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e04ea0-908d-4953-91cb-3f510b328084 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:09.758178 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e04ea0-908d-4953-91cb-3f510b328084 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:09.870874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb3667-8a01-4a23-ac19-d2bbf2632f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:09.877321 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb3667-8a01-4a23-ac19-d2bbf2632f9f admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:09.877321 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb3667-8a01-4a23-ac19-d2bbf2632f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:09.877321 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb3667-8a01-4a23-ac19-d2bbf2632f9f admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:09.877321 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb3667-8a01-4a23-ac19-d2bbf2632f9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:09.879079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb3667-8a01-4a23-ac19-d2bbf2632f9f admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:10.082646 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1347/2670] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:34:09 2022] POST /identity/v3/users => generated 289 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:34:10.087604 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb610e1b-3671-4ec4-b2f3-8b2b4ac5227b admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:10.104151 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb610e1b-3671-4ec4-b2f3-8b2b4ac5227b admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:10.109579 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad725058-d322-4f2f-9222-95b30badc316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:10.113352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad725058-d322-4f2f-9222-95b30badc316 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:10.113352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad725058-d322-4f2f-9222-95b30badc316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:10.113352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad725058-d322-4f2f-9222-95b30badc316 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:10.113352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad725058-d322-4f2f-9222-95b30badc316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:10.114974 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad725058-d322-4f2f-9222-95b30badc316 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:10.133727 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1324/2671] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:34:10.139620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb3667-8a01-4a23-ac19-d2bbf2632f9f admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:10.152819 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb3667-8a01-4a23-ac19-d2bbf2632f9f admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:10.163511 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ff639-7083-48e1-be12-793c14e7cfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:10.165106 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ff639-7083-48e1-be12-793c14e7cfc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:10.165600 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ff639-7083-48e1-be12-793c14e7cfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:10.166092 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ff639-7083-48e1-be12-793c14e7cfc3 admin admin] PATH_INFO: `/v3/projects/6dc2b92e8db8495b89eda9fc004d41d6/users/5e3f52748fee463aa6d81ceef7e4d4c3/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:10.193450 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ff639-7083-48e1-be12-793c14e7cfc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc2b92e8db8495b89eda9fc004d41d6, user_id=5e3f52748fee463aa6d81ceef7e4d4c3, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:10.196549 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ff639-7083-48e1-be12-793c14e7cfc3 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:10.452697 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1348/2672] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:34:10 2022] PUT /identity/v3/projects/6dc2b92e8db8495b89eda9fc004d41d6/users/5e3f52748fee463aa6d81ceef7e4d4c3/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:34:10.459242 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad725058-d322-4f2f-9222-95b30badc316 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:10.475330 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad725058-d322-4f2f-9222-95b30badc316 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:10.541280 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddbe5c-ac07-4dc0-9c82-b2ff11e77f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:10.542003 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddbe5c-ac07-4dc0-9c82-b2ff11e77f99 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:10.542293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddbe5c-ac07-4dc0-9c82-b2ff11e77f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:10.542688 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddbe5c-ac07-4dc0-9c82-b2ff11e77f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:10.543483 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ddbe5c-ac07-4dc0-9c82-b2ff11e77f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:10.545953 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ddbe5c-ac07-4dc0-9c82-b2ff11e77f99 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:10.560036 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1325/2673] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:34:10.564319 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ff639-7083-48e1-be12-793c14e7cfc3 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:10.594278 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ff639-7083-48e1-be12-793c14e7cfc3 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:10.601560 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc99460-4269-4d16-824c-6da86575d313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:10.603821 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc99460-4269-4d16-824c-6da86575d313 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:10.604107 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc99460-4269-4d16-824c-6da86575d313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:10.604383 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc99460-4269-4d16-824c-6da86575d313 admin admin] PATH_INFO: `/v3/projects/6dc2b92e8db8495b89eda9fc004d41d6/users/5e3f52748fee463aa6d81ceef7e4d4c3/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:10.606944 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc99460-4269-4d16-824c-6da86575d313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc2b92e8db8495b89eda9fc004d41d6, user_id=5e3f52748fee463aa6d81ceef7e4d4c3, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:10.609970 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc99460-4269-4d16-824c-6da86575d313 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:10.638011 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1349/2674] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:34:10 2022] PUT /identity/v3/projects/6dc2b92e8db8495b89eda9fc004d41d6/users/5e3f52748fee463aa6d81ceef7e4d4c3/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:34:10.640310 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c135e-c9e4-4b46-aebe-16703b039a33 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:10.640586 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c135e-c9e4-4b46-aebe-16703b039a33 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:10.640967 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c135e-c9e4-4b46-aebe-16703b039a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:10.658359 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:34:10.677585 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-084c135e-c9e4-4b46-aebe-16703b039a33 None None] MFA Rules not processed for user `5e3f52748fee463aa6d81ceef7e4d4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:34:10.678832 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-084c135e-c9e4-4b46-aebe-16703b039a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:10.790807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1326/2675] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:34:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:34:10.808094 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc99460-4269-4d16-824c-6da86575d313 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:10.809996 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-cdc99460-4269-4d16-824c-6da86575d313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:10.885453 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc99460-4269-4d16-824c-6da86575d313 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:10.890024 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042c7f7-2070-4645-9b5f-08189a0e245c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:10.890726 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042c7f7-2070-4645-9b5f-08189a0e245c service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:10.891135 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042c7f7-2070-4645-9b5f-08189a0e245c service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:10.891488 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042c7f7-2070-4645-9b5f-08189a0e245c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:10.903994 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042c7f7-2070-4645-9b5f-08189a0e245c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:10.905754 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042c7f7-2070-4645-9b5f-08189a0e245c service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:10.918563 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1350/2676] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:34:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:34:11.278678 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c135e-c9e4-4b46-aebe-16703b039a33 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:11.298104 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c135e-c9e4-4b46-aebe-16703b039a33 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:11.305225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb33b74-ba48-46e9-b40e-4ba21e1ab2ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:11.306501 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb33b74-ba48-46e9-b40e-4ba21e1ab2ed service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:11.309511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb33b74-ba48-46e9-b40e-4ba21e1ab2ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:11.309511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb33b74-ba48-46e9-b40e-4ba21e1ab2ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:11.398150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb33b74-ba48-46e9-b40e-4ba21e1ab2ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:11.399712 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb33b74-ba48-46e9-b40e-4ba21e1ab2ed service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:11.411685 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1327/2677] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:34:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:34:13.347654 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:34:14.211038 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:34:15.319268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:34:17.205444 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:34:17.485621 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee56ab8-23a3-4560-98bf-cceae3fc0e79 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:17.485903 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee56ab8-23a3-4560-98bf-cceae3fc0e79 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:17.486178 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee56ab8-23a3-4560-98bf-cceae3fc0e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:17.531198 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-bee56ab8-23a3-4560-98bf-cceae3fc0e79 None None] MFA Rules not processed for user `aa0bb9aa1ac741faa2ea3ab0ae0f334d`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:34:17.547250 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-bee56ab8-23a3-4560-98bf-cceae3fc0e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:17.611104 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1351/2678] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:34:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:34:17.615869 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb33b74-ba48-46e9-b40e-4ba21e1ab2ed service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:17.697593 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb33b74-ba48-46e9-b40e-4ba21e1ab2ed service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:17.702871 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a6ec0-7134-4ccb-809c-4e67240cd480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:17.703910 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a6ec0-7134-4ccb-809c-4e67240cd480 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:17.704427 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a6ec0-7134-4ccb-809c-4e67240cd480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:17.704802 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a6ec0-7134-4ccb-809c-4e67240cd480 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:17.705776 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a6ec0-7134-4ccb-809c-4e67240cd480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:17.708543 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a6ec0-7134-4ccb-809c-4e67240cd480 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:17.955289 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1328/2679] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:34:17 2022] POST /identity/v3/projects => generated 373 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:34:17.959780 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee56ab8-23a3-4560-98bf-cceae3fc0e79 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:17.971262 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee56ab8-23a3-4560-98bf-cceae3fc0e79 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:18.047545 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efab49d-e088-44ce-a679-ff5284110a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:18.048253 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efab49d-e088-44ce-a679-ff5284110a4e admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:18.049264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efab49d-e088-44ce-a679-ff5284110a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:18.049264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efab49d-e088-44ce-a679-ff5284110a4e admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:18.049588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efab49d-e088-44ce-a679-ff5284110a4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:18.052386 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efab49d-e088-44ce-a679-ff5284110a4e admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:18.184772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1352/2680] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:34:17 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:34:18.197759 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a6ec0-7134-4ccb-809c-4e67240cd480 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:18.209418 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:34:18.214108 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a6ec0-7134-4ccb-809c-4e67240cd480 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:18.219220 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b35e5d-3a99-4397-880f-40c0e6a7ff54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:18.220523 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b35e5d-3a99-4397-880f-40c0e6a7ff54 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:18.220888 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b35e5d-3a99-4397-880f-40c0e6a7ff54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:18.221231 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b35e5d-3a99-4397-880f-40c0e6a7ff54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:18.222866 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b35e5d-3a99-4397-880f-40c0e6a7ff54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:18.224673 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b35e5d-3a99-4397-880f-40c0e6a7ff54 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:18.239347 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1329/2681] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:34:18.245600 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efab49d-e088-44ce-a679-ff5284110a4e admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:18.257250 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efab49d-e088-44ce-a679-ff5284110a4e admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:18.262639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed69c24-e7a1-427b-985a-2832970f56ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:18.266350 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed69c24-e7a1-427b-985a-2832970f56ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:18.267594 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed69c24-e7a1-427b-985a-2832970f56ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:18.267983 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed69c24-e7a1-427b-985a-2832970f56ba admin admin] PATH_INFO: `/v3/projects/b78df9af6c4b4ea48098bbb5c27ff0cf/users/db1a0071dfb0436da2221a5d0bdc36ca/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:18.291175 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed69c24-e7a1-427b-985a-2832970f56ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78df9af6c4b4ea48098bbb5c27ff0cf, user_id=db1a0071dfb0436da2221a5d0bdc36ca, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:18.294020 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed69c24-e7a1-427b-985a-2832970f56ba admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:18.418331 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1353/2682] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:34:18 2022] PUT /identity/v3/projects/b78df9af6c4b4ea48098bbb5c27ff0cf/users/db1a0071dfb0436da2221a5d0bdc36ca/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:34:18.423555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b35e5d-3a99-4397-880f-40c0e6a7ff54 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:18.435504 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b35e5d-3a99-4397-880f-40c0e6a7ff54 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:18.605874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c9418-7fb7-48ca-bd24-852427f248cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:18.606566 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c9418-7fb7-48ca-bd24-852427f248cc admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:18.606847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c9418-7fb7-48ca-bd24-852427f248cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:18.607122 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c9418-7fb7-48ca-bd24-852427f248cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:18.608232 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c9418-7fb7-48ca-bd24-852427f248cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:18.610068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c9418-7fb7-48ca-bd24-852427f248cc admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:18.635531 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1330/2683] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:34:18.637741 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed69c24-e7a1-427b-985a-2832970f56ba admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:18.656047 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed69c24-e7a1-427b-985a-2832970f56ba admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:18.663733 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e219d99-8927-49ee-a3d4-ee21a76fed1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:18.664577 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e219d99-8927-49ee-a3d4-ee21a76fed1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:18.664865 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e219d99-8927-49ee-a3d4-ee21a76fed1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:18.665223 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e219d99-8927-49ee-a3d4-ee21a76fed1b admin admin] PATH_INFO: `/v3/projects/b78df9af6c4b4ea48098bbb5c27ff0cf/users/db1a0071dfb0436da2221a5d0bdc36ca/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:18.667683 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e219d99-8927-49ee-a3d4-ee21a76fed1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78df9af6c4b4ea48098bbb5c27ff0cf, user_id=db1a0071dfb0436da2221a5d0bdc36ca, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:18.671327 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e219d99-8927-49ee-a3d4-ee21a76fed1b admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:18.687228 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1354/2684] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:34:18 2022] PUT /identity/v3/projects/b78df9af6c4b4ea48098bbb5c27ff0cf/users/db1a0071dfb0436da2221a5d0bdc36ca/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:34:20.056492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:34:21.372613 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c9418-7fb7-48ca-bd24-852427f248cc admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:21.385994 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c9418-7fb7-48ca-bd24-852427f248cc admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:21.483936 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9686c-bfdf-495a-aa40-f1354149fb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:21.485838 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9686c-bfdf-495a-aa40-f1354149fb69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:21.486381 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9686c-bfdf-495a-aa40-f1354149fb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:21.486880 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9686c-bfdf-495a-aa40-f1354149fb69 admin admin] PATH_INFO: `/v3/users/9277158987af42af9586c0d9f0d6193c` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:21.488803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9686c-bfdf-495a-aa40-f1354149fb69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9277158987af42af9586c0d9f0d6193c)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:21.491564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9686c-bfdf-495a-aa40-f1354149fb69 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:21.778447 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-6df9686c-bfdf-495a-aa40-f1354149fb69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9277158987af42af9586c0d9f0d6193c'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:21.908315 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-6df9686c-bfdf-495a-aa40-f1354149fb69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9277158987af42af9586c0d9f0d6193c'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:21.910023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-6df9686c-bfdf-495a-aa40-f1354149fb69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9277158987af42af9586c0d9f0d6193c'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:21.911079 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-6df9686c-bfdf-495a-aa40-f1354149fb69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9277158987af42af9586c0d9f0d6193c'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:21.942956 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-6df9686c-bfdf-495a-aa40-f1354149fb69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9277158987af42af9586c0d9f0d6193c'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:22.020315 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6739b2a-9413-4487-b885-57817085c7fd None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:22.021114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6739b2a-9413-4487-b885-57817085c7fd None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:22.021441 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6739b2a-9413-4487-b885-57817085c7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:22.026482 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1331/2685] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:34:21 2022] DELETE /identity/v3/users/9277158987af42af9586c0d9f0d6193c => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:34:22.060932 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-b6739b2a-9413-4487-b885-57817085c7fd None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:34:22.064367 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-b6739b2a-9413-4487-b885-57817085c7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:22.306152 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1355/2686] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:34:22.307220 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9686c-bfdf-495a-aa40-f1354149fb69 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:22.307220 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6df9686c-bfdf-495a-aa40-f1354149fb69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:22.307220 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:34:22.372957 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9686c-bfdf-495a-aa40-f1354149fb69 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:22.388233 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37810c43-dd2a-46eb-83ce-a93adf6cf591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:22.389422 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37810c43-dd2a-46eb-83ce-a93adf6cf591 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:22.389917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37810c43-dd2a-46eb-83ce-a93adf6cf591 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:22.390546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37810c43-dd2a-46eb-83ce-a93adf6cf591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:22.419756 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37810c43-dd2a-46eb-83ce-a93adf6cf591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:22.422368 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37810c43-dd2a-46eb-83ce-a93adf6cf591 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:22.455972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1332/2687] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:34:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:34:23.366279 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6739b2a-9413-4487-b885-57817085c7fd None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:23.369657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-b6739b2a-9413-4487-b885-57817085c7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:23.387339 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6739b2a-9413-4487-b885-57817085c7fd None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:23.412447 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292eaade-908d-479a-9e51-1b83ea85fd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:23.412447 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292eaade-908d-479a-9e51-1b83ea85fd9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:23.412447 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292eaade-908d-479a-9e51-1b83ea85fd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:23.412447 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292eaade-908d-479a-9e51-1b83ea85fd9b admin admin] PATH_INFO: `/v3/projects/07bb1022acde409587c37d1b5e16629f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:23.412928 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292eaade-908d-479a-9e51-1b83ea85fd9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=07bb1022acde409587c37d1b5e16629f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:23.412928 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292eaade-908d-479a-9e51-1b83ea85fd9b admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:23.497608 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:34:23.604545 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-292eaade-908d-479a-9e51-1b83ea85fd9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07bb1022acde409587c37d1b5e16629f', 'request_id': 'req-292eaade-908d-479a-9e51-1b83ea85fd9b'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:23.614243 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-292eaade-908d-479a-9e51-1b83ea85fd9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07bb1022acde409587c37d1b5e16629f', 'request_id': 'req-292eaade-908d-479a-9e51-1b83ea85fd9b'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:23.808468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-292eaade-908d-479a-9e51-1b83ea85fd9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07bb1022acde409587c37d1b5e16629f', 'request_id': 'req-292eaade-908d-479a-9e51-1b83ea85fd9b'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:23.831778 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-292eaade-908d-479a-9e51-1b83ea85fd9b admin admin] The token cache is being invalidate because project 07bb1022acde409587c37d1b5e16629f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:34:23.831778 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-292eaade-908d-479a-9e51-1b83ea85fd9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:23.831778 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-292eaade-908d-479a-9e51-1b83ea85fd9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:23.839914 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1356/2688] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:34:23 2022] DELETE /identity/v3/projects/07bb1022acde409587c37d1b5e16629f => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:34:23.844873 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37810c43-dd2a-46eb-83ce-a93adf6cf591 service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:23.866728 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37810c43-dd2a-46eb-83ce-a93adf6cf591 service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:24.001186 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a69a30-d140-4002-a831-3a3ac07db088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:24.001963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a69a30-d140-4002-a831-3a3ac07db088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:24.002373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a69a30-d140-4002-a831-3a3ac07db088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:24.002671 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a69a30-d140-4002-a831-3a3ac07db088 admin admin] PATH_INFO: `/v3/users/5e3f52748fee463aa6d81ceef7e4d4c3` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:24.004255 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a69a30-d140-4002-a831-3a3ac07db088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e3f52748fee463aa6d81ceef7e4d4c3)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:24.006288 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a69a30-d140-4002-a831-3a3ac07db088 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:24.347955 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-d3a69a30-d140-4002-a831-3a3ac07db088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e3f52748fee463aa6d81ceef7e4d4c3'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:24.468662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-d3a69a30-d140-4002-a831-3a3ac07db088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e3f52748fee463aa6d81ceef7e4d4c3'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:24.469359 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-d3a69a30-d140-4002-a831-3a3ac07db088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e3f52748fee463aa6d81ceef7e4d4c3'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:24.470262 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-d3a69a30-d140-4002-a831-3a3ac07db088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e3f52748fee463aa6d81ceef7e4d4c3'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:24.487430 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-d3a69a30-d140-4002-a831-3a3ac07db088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e3f52748fee463aa6d81ceef7e4d4c3'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:24.513338 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1333/2689] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:34:23 2022] DELETE /identity/v3/users/5e3f52748fee463aa6d81ceef7e4d4c3 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:34:25.221239 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292eaade-908d-479a-9e51-1b83ea85fd9b admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:25.223714 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-292eaade-908d-479a-9e51-1b83ea85fd9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:25.241669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292eaade-908d-479a-9e51-1b83ea85fd9b admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:25.333557 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ae542-f8cb-470a-9888-b463743a4985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:25.334431 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ae542-f8cb-470a-9888-b463743a4985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:25.334768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ae542-f8cb-470a-9888-b463743a4985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:25.336484 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ae542-f8cb-470a-9888-b463743a4985 admin admin] PATH_INFO: `/v3/projects/6dc2b92e8db8495b89eda9fc004d41d6` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:25.336484 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ae542-f8cb-470a-9888-b463743a4985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dc2b92e8db8495b89eda9fc004d41d6)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:25.338802 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ae542-f8cb-470a-9888-b463743a4985 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:25.508238 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f78ae542-f8cb-470a-9888-b463743a4985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dc2b92e8db8495b89eda9fc004d41d6', 'request_id': 'req-f78ae542-f8cb-470a-9888-b463743a4985'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:25.517015 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f78ae542-f8cb-470a-9888-b463743a4985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dc2b92e8db8495b89eda9fc004d41d6', 'request_id': 'req-f78ae542-f8cb-470a-9888-b463743a4985'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:25.632862 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f78ae542-f8cb-470a-9888-b463743a4985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dc2b92e8db8495b89eda9fc004d41d6', 'request_id': 'req-f78ae542-f8cb-470a-9888-b463743a4985'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:25.648844 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f78ae542-f8cb-470a-9888-b463743a4985 admin admin] The token cache is being invalidate because project 6dc2b92e8db8495b89eda9fc004d41d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:34:25.649376 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f78ae542-f8cb-470a-9888-b463743a4985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:25.650291 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-f78ae542-f8cb-470a-9888-b463743a4985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:25.652896 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1357/2690] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:34:25 2022] DELETE /identity/v3/projects/6dc2b92e8db8495b89eda9fc004d41d6 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:34:25.660566 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0f4ef-e2c4-48dd-8ad3-196fa48390fd None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:25.661336 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0f4ef-e2c4-48dd-8ad3-196fa48390fd None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:25.661514 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0f4ef-e2c4-48dd-8ad3-196fa48390fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:25.701590 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-32d0f4ef-e2c4-48dd-8ad3-196fa48390fd None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:34:25.703223 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-32d0f4ef-e2c4-48dd-8ad3-196fa48390fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:25.821786 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1334/2691] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:34:25.829722 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1423e-7d20-42ad-bd54-09800ef306de None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:25.830129 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1423e-7d20-42ad-bd54-09800ef306de None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:25.830561 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1423e-7d20-42ad-bd54-09800ef306de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:25.876704 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-0fe1423e-7d20-42ad-bd54-09800ef306de None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:34:25.876704 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-0fe1423e-7d20-42ad-bd54-09800ef306de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:25.894878 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1358/2692] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:34:25.896528 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0f4ef-e2c4-48dd-8ad3-196fa48390fd None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:25.916488 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0f4ef-e2c4-48dd-8ad3-196fa48390fd None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:25.928403 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea20619-4339-4862-8365-4d5401cbcc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:25.928403 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea20619-4339-4862-8365-4d5401cbcc08 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:25.928403 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea20619-4339-4862-8365-4d5401cbcc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:25.928403 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea20619-4339-4862-8365-4d5401cbcc08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:25.929010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea20619-4339-4862-8365-4d5401cbcc08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:34:25.929010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea20619-4339-4862-8365-4d5401cbcc08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:25.929010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea20619-4339-4862-8365-4d5401cbcc08 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:25.947232 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1335/2693] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:34:25.953556 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1423e-7d20-42ad-bd54-09800ef306de None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:25.966115 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1423e-7d20-42ad-bd54-09800ef306de None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:25.973653 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b006879-eff1-422d-a3bc-74327f7ba9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:25.974982 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b006879-eff1-422d-a3bc-74327f7ba9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:25.975524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b006879-eff1-422d-a3bc-74327f7ba9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:25.975949 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b006879-eff1-422d-a3bc-74327f7ba9e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:25.976808 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b006879-eff1-422d-a3bc-74327f7ba9e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:25.980195 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b006879-eff1-422d-a3bc-74327f7ba9e2 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:26.107884 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1359/2694] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:34:25 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:34:26.115096 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea20619-4339-4862-8365-4d5401cbcc08 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:26.129125 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea20619-4339-4862-8365-4d5401cbcc08 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:26.228805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79642cc-1146-4d5b-a186-3b727a187b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:26.233325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79642cc-1146-4d5b-a186-3b727a187b15 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:26.233325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79642cc-1146-4d5b-a186-3b727a187b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:26.233325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79642cc-1146-4d5b-a186-3b727a187b15 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:26.233325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79642cc-1146-4d5b-a186-3b727a187b15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:26.233325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79642cc-1146-4d5b-a186-3b727a187b15 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:26.387546 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1336/2695] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:34:26 2022] POST /identity/v3/users => generated 289 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:34:26.392541 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b006879-eff1-422d-a3bc-74327f7ba9e2 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:26.414518 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b006879-eff1-422d-a3bc-74327f7ba9e2 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:26.424512 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0d1a1-e613-404e-ab8c-f3d2c8d99918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:26.425976 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0d1a1-e613-404e-ab8c-f3d2c8d99918 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:26.426724 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0d1a1-e613-404e-ab8c-f3d2c8d99918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:26.427675 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0d1a1-e613-404e-ab8c-f3d2c8d99918 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:26.429388 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0d1a1-e613-404e-ab8c-f3d2c8d99918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:26.432909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0d1a1-e613-404e-ab8c-f3d2c8d99918 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:26.457954 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1360/2696] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:34:26.462212 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79642cc-1146-4d5b-a186-3b727a187b15 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:26.474132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79642cc-1146-4d5b-a186-3b727a187b15 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:26.480783 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff74f9-af01-47f8-9f0b-18f156d11fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:26.481291 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff74f9-af01-47f8-9f0b-18f156d11fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:26.481647 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff74f9-af01-47f8-9f0b-18f156d11fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:26.481980 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff74f9-af01-47f8-9f0b-18f156d11fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:26.482751 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff74f9-af01-47f8-9f0b-18f156d11fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:26.485168 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff74f9-af01-47f8-9f0b-18f156d11fe2 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:26.499887 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1337/2697] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:34:26.506790 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0d1a1-e613-404e-ab8c-f3d2c8d99918 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:26.519773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0d1a1-e613-404e-ab8c-f3d2c8d99918 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:26.528442 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03facad3-7775-42b5-86d9-dedf5a778d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:26.529117 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03facad3-7775-42b5-86d9-dedf5a778d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:26.529398 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03facad3-7775-42b5-86d9-dedf5a778d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:26.529703 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03facad3-7775-42b5-86d9-dedf5a778d94 admin admin] PATH_INFO: `/v3/projects/903b1430bb9a4e1584551c4f6fa6200d/users/5286400abcd440ff900d126ea6af1c08/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:26.552293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03facad3-7775-42b5-86d9-dedf5a778d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=903b1430bb9a4e1584551c4f6fa6200d, user_id=5286400abcd440ff900d126ea6af1c08, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:26.555336 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03facad3-7775-42b5-86d9-dedf5a778d94 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:26.673531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1361/2698] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:34:26 2022] PUT /identity/v3/projects/903b1430bb9a4e1584551c4f6fa6200d/users/5286400abcd440ff900d126ea6af1c08/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:34:26.684666 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34842bab-0ea5-47c2-9114-8e2ccec09c5e None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:26.685632 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34842bab-0ea5-47c2-9114-8e2ccec09c5e None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:26.686111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34842bab-0ea5-47c2-9114-8e2ccec09c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:26.745870 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-34842bab-0ea5-47c2-9114-8e2ccec09c5e None None] MFA Rules not processed for user `5286400abcd440ff900d126ea6af1c08`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:34:26.750725 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-34842bab-0ea5-47c2-9114-8e2ccec09c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:26.881739 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1338/2699] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:34:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:34:26.890525 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03facad3-7775-42b5-86d9-dedf5a778d94 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:26.893240 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-03facad3-7775-42b5-86d9-dedf5a778d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:26.948714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:34:27.032124 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03facad3-7775-42b5-86d9-dedf5a778d94 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:27.036557 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fe05c-04ae-415a-81fe-c753381ea533 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '871f208a13ba435491022b9ea9b735e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:27.037377 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fe05c-04ae-415a-81fe-c753381ea533 service glance] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:27.037659 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fe05c-04ae-415a-81fe-c753381ea533 service glance] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:27.037934 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fe05c-04ae-415a-81fe-c753381ea533 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:27.060589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48fe05c-04ae-415a-81fe-c753381ea533 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:27.062353 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48fe05c-04ae-415a-81fe-c753381ea533 service glance] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:27.076465 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1362/2700] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:34:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:34:27.382040 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:34:27.471767 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fb1f0-a87b-4aa7-8b27-93eb0f5a01a5 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:27.472025 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fb1f0-a87b-4aa7-8b27-93eb0f5a01a5 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:27.472305 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fb1f0-a87b-4aa7-8b27-93eb0f5a01a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:27.513791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-f03fb1f0-a87b-4aa7-8b27-93eb0f5a01a5 None None] MFA Rules not processed for user `db1a0071dfb0436da2221a5d0bdc36ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:34:27.515190 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f03fb1f0-a87b-4aa7-8b27-93eb0f5a01a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:27.635657 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1339/2701] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:34:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:34:27.664414 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fe05c-04ae-415a-81fe-c753381ea533 service glance] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:27.667515 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-d48fe05c-04ae-415a-81fe-c753381ea533 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:27.795078 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fe05c-04ae-415a-81fe-c753381ea533 service glance] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:27.808719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60747f78-5f4f-4b3e-a0e6-2452c3fcec50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:27.809895 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60747f78-5f4f-4b3e-a0e6-2452c3fcec50 service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:27.810714 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60747f78-5f4f-4b3e-a0e6-2452c3fcec50 service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:27.811120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60747f78-5f4f-4b3e-a0e6-2452c3fcec50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:27.814425 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-60747f78-5f4f-4b3e-a0e6-2452c3fcec50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:27.916665 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60747f78-5f4f-4b3e-a0e6-2452c3fcec50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:27.918320 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60747f78-5f4f-4b3e-a0e6-2452c3fcec50 service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:27.929012 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1363/2702] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:34:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:34:29.749447 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:34:33.122360 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78806f-5b9e-4ed8-aac4-0525a1539d61 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:33.123126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78806f-5b9e-4ed8-aac4-0525a1539d61 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:33.123126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78806f-5b9e-4ed8-aac4-0525a1539d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:33.152111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-2e78806f-5b9e-4ed8-aac4-0525a1539d61 None None] MFA Rules not processed for user `aa0bb9aa1ac741faa2ea3ab0ae0f334d`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:34:33.153354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-2e78806f-5b9e-4ed8-aac4-0525a1539d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:33.161750 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1340/2703] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:34:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:34:36.931355 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60747f78-5f4f-4b3e-a0e6-2452c3fcec50 service nova] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:36.933856 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-60747f78-5f4f-4b3e-a0e6-2452c3fcec50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:36.964425 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:34:37.048161 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60747f78-5f4f-4b3e-a0e6-2452c3fcec50 service nova] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:37.053988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcebc5-1e74-49ca-8d5b-1ddb2999070d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:37.054889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcebc5-1e74-49ca-8d5b-1ddb2999070d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:37.056198 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcebc5-1e74-49ca-8d5b-1ddb2999070d admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:37.056198 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcebc5-1e74-49ca-8d5b-1ddb2999070d admin admin] PATH_INFO: `/v3/users/b1072574dbae4515abdc9632c2979321` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:37.057428 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfcebc5-1e74-49ca-8d5b-1ddb2999070d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1072574dbae4515abdc9632c2979321)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:37.059515 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfcebc5-1e74-49ca-8d5b-1ddb2999070d admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:37.303578 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-cbfcebc5-1e74-49ca-8d5b-1ddb2999070d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1072574dbae4515abdc9632c2979321'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:37.374971 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-cbfcebc5-1e74-49ca-8d5b-1ddb2999070d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1072574dbae4515abdc9632c2979321'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:37.375786 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-cbfcebc5-1e74-49ca-8d5b-1ddb2999070d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1072574dbae4515abdc9632c2979321'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:37.376510 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-cbfcebc5-1e74-49ca-8d5b-1ddb2999070d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1072574dbae4515abdc9632c2979321'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:37.394048 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-cbfcebc5-1e74-49ca-8d5b-1ddb2999070d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1072574dbae4515abdc9632c2979321'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:37.448071 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1364/2704] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:34:36 2022] DELETE /identity/v3/users/b1072574dbae4515abdc9632c2979321 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:34:37.850960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78806f-5b9e-4ed8-aac4-0525a1539d61 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:37.885130 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78806f-5b9e-4ed8-aac4-0525a1539d61 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:38.022486 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e2c1e-9e78-4c4b-990d-14a7f88aaa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:38.023212 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e2c1e-9e78-4c4b-990d-14a7f88aaa1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:38.023705 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e2c1e-9e78-4c4b-990d-14a7f88aaa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:38.024031 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e2c1e-9e78-4c4b-990d-14a7f88aaa1a admin admin] PATH_INFO: `/v3/projects/fe1680a7439749e080ba7c94e7c62117` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:38.025899 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e2c1e-9e78-4c4b-990d-14a7f88aaa1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe1680a7439749e080ba7c94e7c62117)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:38.028441 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e2c1e-9e78-4c4b-990d-14a7f88aaa1a admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:38.179101 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-047e2c1e-9e78-4c4b-990d-14a7f88aaa1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe1680a7439749e080ba7c94e7c62117', 'request_id': 'req-047e2c1e-9e78-4c4b-990d-14a7f88aaa1a'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:38.186450 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-047e2c1e-9e78-4c4b-990d-14a7f88aaa1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe1680a7439749e080ba7c94e7c62117', 'request_id': 'req-047e2c1e-9e78-4c4b-990d-14a7f88aaa1a'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:38.290209 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-047e2c1e-9e78-4c4b-990d-14a7f88aaa1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe1680a7439749e080ba7c94e7c62117', 'request_id': 'req-047e2c1e-9e78-4c4b-990d-14a7f88aaa1a'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:38.306745 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-047e2c1e-9e78-4c4b-990d-14a7f88aaa1a admin admin] The token cache is being invalidate because project fe1680a7439749e080ba7c94e7c62117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:34:38.307108 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-047e2c1e-9e78-4c4b-990d-14a7f88aaa1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:38.307892 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-047e2c1e-9e78-4c4b-990d-14a7f88aaa1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:38.309489 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1341/2705] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:34:37 2022] DELETE /identity/v3/projects/fe1680a7439749e080ba7c94e7c62117 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:34:42.742811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcebc5-1e74-49ca-8d5b-1ddb2999070d admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:42.744544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-cbfcebc5-1e74-49ca-8d5b-1ddb2999070d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:42.825380 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcebc5-1e74-49ca-8d5b-1ddb2999070d admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:42.889008 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb6446-c461-4a3d-9957-11078951b8b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:42.889629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb6446-c461-4a3d-9957-11078951b8b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:42.889910 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb6446-c461-4a3d-9957-11078951b8b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:42.890185 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb6446-c461-4a3d-9957-11078951b8b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:42.892049 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-e0cb6446-c461-4a3d-9957-11078951b8b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:42.912397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:34:42.984077 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb6446-c461-4a3d-9957-11078951b8b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:42.987156 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb6446-c461-4a3d-9957-11078951b8b2 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:43.006925 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1365/2706] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:34:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:34:48.230056 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e2c1e-9e78-4c4b-990d-14a7f88aaa1a admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:48.232613 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-047e2c1e-9e78-4c4b-990d-14a7f88aaa1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:48.296357 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:34:48.353003 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e2c1e-9e78-4c4b-990d-14a7f88aaa1a admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:48.358307 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bd9e7-ca0f-4908-b1b5-2733a2be3f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:48.358965 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bd9e7-ca0f-4908-b1b5-2733a2be3f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:48.359242 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bd9e7-ca0f-4908-b1b5-2733a2be3f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:48.359568 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bd9e7-ca0f-4908-b1b5-2733a2be3f3c admin admin] PATH_INFO: `/v3/users/779846f3313940b388340f1794450e17` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:48.360751 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18bd9e7-ca0f-4908-b1b5-2733a2be3f3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=779846f3313940b388340f1794450e17)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:48.363006 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18bd9e7-ca0f-4908-b1b5-2733a2be3f3c admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:48.662132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-b18bd9e7-ca0f-4908-b1b5-2733a2be3f3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '779846f3313940b388340f1794450e17'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:48.735465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-b18bd9e7-ca0f-4908-b1b5-2733a2be3f3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '779846f3313940b388340f1794450e17'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:48.737395 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-b18bd9e7-ca0f-4908-b1b5-2733a2be3f3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '779846f3313940b388340f1794450e17'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:48.738150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-b18bd9e7-ca0f-4908-b1b5-2733a2be3f3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '779846f3313940b388340f1794450e17'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:48.748568 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-b18bd9e7-ca0f-4908-b1b5-2733a2be3f3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '779846f3313940b388340f1794450e17'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:48.771820 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1342/2707] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:34:48 2022] DELETE /identity/v3/users/779846f3313940b388340f1794450e17 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:34:49.085068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb6446-c461-4a3d-9957-11078951b8b2 service neutron] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:49.158025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb6446-c461-4a3d-9957-11078951b8b2 service neutron] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:49.234554 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd0214-c107-446c-ae17-99bd0194cd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:49.236116 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd0214-c107-446c-ae17-99bd0194cd0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:49.236458 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd0214-c107-446c-ae17-99bd0194cd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:49.236939 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd0214-c107-446c-ae17-99bd0194cd0f admin admin] PATH_INFO: `/v3/projects/56e0c230fb944673be8abc0fbac17df9` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:49.238229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd0214-c107-446c-ae17-99bd0194cd0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=56e0c230fb944673be8abc0fbac17df9)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:49.244161 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd0214-c107-446c-ae17-99bd0194cd0f admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:49.366195 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-57bd0214-c107-446c-ae17-99bd0194cd0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56e0c230fb944673be8abc0fbac17df9', 'request_id': 'req-57bd0214-c107-446c-ae17-99bd0194cd0f'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:49.373294 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-57bd0214-c107-446c-ae17-99bd0194cd0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56e0c230fb944673be8abc0fbac17df9', 'request_id': 'req-57bd0214-c107-446c-ae17-99bd0194cd0f'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:49.466355 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-57bd0214-c107-446c-ae17-99bd0194cd0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56e0c230fb944673be8abc0fbac17df9', 'request_id': 'req-57bd0214-c107-446c-ae17-99bd0194cd0f'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:49.472548 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:34:49.481192 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-57bd0214-c107-446c-ae17-99bd0194cd0f admin admin] The token cache is being invalidate because project 56e0c230fb944673be8abc0fbac17df9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:34:49.481657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-57bd0214-c107-446c-ae17-99bd0194cd0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:49.482504 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-57bd0214-c107-446c-ae17-99bd0194cd0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:49.484096 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1366/2708] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:34:49 2022] DELETE /identity/v3/projects/56e0c230fb944673be8abc0fbac17df9 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:34:49.498628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9ba8c-cbb8-4584-bcb9-6fe17c957f4c None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:49.499196 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9ba8c-cbb8-4584-bcb9-6fe17c957f4c None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:49.499319 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9ba8c-cbb8-4584-bcb9-6fe17c957f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:49.574946 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-01c9ba8c-cbb8-4584-bcb9-6fe17c957f4c None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:34:49.576203 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-01c9ba8c-cbb8-4584-bcb9-6fe17c957f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:49.655581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1343/2709] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:34:49.664654 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1151a98-d835-4513-a4ef-128360ad88df None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:49.665096 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1151a98-d835-4513-a4ef-128360ad88df None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:49.665469 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1151a98-d835-4513-a4ef-128360ad88df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:49.688622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-c1151a98-d835-4513-a4ef-128360ad88df None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:34:49.690461 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-c1151a98-d835-4513-a4ef-128360ad88df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:49.699510 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1367/2710] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:34:49.704318 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9ba8c-cbb8-4584-bcb9-6fe17c957f4c None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:49.716165 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9ba8c-cbb8-4584-bcb9-6fe17c957f4c None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:49.722007 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad49bb3-bb18-462d-8e61-cc3ef9bc1fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:49.722811 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad49bb3-bb18-462d-8e61-cc3ef9bc1fcd admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:49.722985 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad49bb3-bb18-462d-8e61-cc3ef9bc1fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:49.723260 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad49bb3-bb18-462d-8e61-cc3ef9bc1fcd admin admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:49.724031 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad49bb3-bb18-462d-8e61-cc3ef9bc1fcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:34:49.724333 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad49bb3-bb18-462d-8e61-cc3ef9bc1fcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:49.725971 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad49bb3-bb18-462d-8e61-cc3ef9bc1fcd admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:49.741531 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1344/2711] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:34:49.746369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1151a98-d835-4513-a4ef-128360ad88df None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:49.756945 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1151a98-d835-4513-a4ef-128360ad88df None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:49.762120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17ccc4-a410-4d44-a1d1-f612a2d9e17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:49.765912 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17ccc4-a410-4d44-a1d1-f612a2d9e17c admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:49.765912 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17ccc4-a410-4d44-a1d1-f612a2d9e17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:49.765912 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17ccc4-a410-4d44-a1d1-f612a2d9e17c admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:49.765912 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17ccc4-a410-4d44-a1d1-f612a2d9e17c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:49.766496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17ccc4-a410-4d44-a1d1-f612a2d9e17c admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:49.880142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1368/2712] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:34:49 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:34:49.884722 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad49bb3-bb18-462d-8e61-cc3ef9bc1fcd admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:49.890485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:34:49.897388 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad49bb3-bb18-462d-8e61-cc3ef9bc1fcd admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:49.970190 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c68f5-d296-4459-9e19-703e9f9fe76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:49.971488 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c68f5-d296-4459-9e19-703e9f9fe76d admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:49.971890 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c68f5-d296-4459-9e19-703e9f9fe76d admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:49.972307 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c68f5-d296-4459-9e19-703e9f9fe76d admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:49.973160 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c68f5-d296-4459-9e19-703e9f9fe76d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:49.975225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c68f5-d296-4459-9e19-703e9f9fe76d admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:50.126515 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1345/2713] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:34:49 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:34:50.131397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17ccc4-a410-4d44-a1d1-f612a2d9e17c admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:50.144005 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17ccc4-a410-4d44-a1d1-f612a2d9e17c admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:50.150810 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a51e4-e104-43c5-9009-5258d02fb3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:50.151971 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a51e4-e104-43c5-9009-5258d02fb3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:50.152360 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a51e4-e104-43c5-9009-5258d02fb3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:50.152752 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a51e4-e104-43c5-9009-5258d02fb3e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:50.153746 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a51e4-e104-43c5-9009-5258d02fb3e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:50.156081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a51e4-e104-43c5-9009-5258d02fb3e2 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:50.170068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1369/2714] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:34:50.175491 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c68f5-d296-4459-9e19-703e9f9fe76d admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:50.197310 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c68f5-d296-4459-9e19-703e9f9fe76d admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:50.208859 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c2627-3d93-48fc-b8bf-1897bd20c1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:50.209595 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c2627-3d93-48fc-b8bf-1897bd20c1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:50.209964 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c2627-3d93-48fc-b8bf-1897bd20c1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:50.210403 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c2627-3d93-48fc-b8bf-1897bd20c1c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:50.211481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c2627-3d93-48fc-b8bf-1897bd20c1c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:50.213953 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c2627-3d93-48fc-b8bf-1897bd20c1c8 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:50.233974 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1346/2715] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:34:50.239831 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a51e4-e104-43c5-9009-5258d02fb3e2 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:50.255181 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a51e4-e104-43c5-9009-5258d02fb3e2 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:50.260791 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f28c3-f34a-484f-82b0-9c60e2ee8bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:50.261478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f28c3-f34a-484f-82b0-9c60e2ee8bc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:50.261746 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f28c3-f34a-484f-82b0-9c60e2ee8bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:50.262051 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f28c3-f34a-484f-82b0-9c60e2ee8bc8 admin admin] PATH_INFO: `/v3/projects/10c568f9f04d4dd8a8f36e7e05058e8f/users/b64e3a9410554ad1a4478bc9da37dd16/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:50.281865 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f28c3-f34a-484f-82b0-9c60e2ee8bc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10c568f9f04d4dd8a8f36e7e05058e8f, user_id=b64e3a9410554ad1a4478bc9da37dd16, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:50.285038 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f28c3-f34a-484f-82b0-9c60e2ee8bc8 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:50.393892 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1370/2716] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:34:50 2022] PUT /identity/v3/projects/10c568f9f04d4dd8a8f36e7e05058e8f/users/b64e3a9410554ad1a4478bc9da37dd16/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:34:50.401605 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c598b-49bf-44b7-8735-7ad13fe7f3fd None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:50.402036 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c598b-49bf-44b7-8735-7ad13fe7f3fd None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:50.402462 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c598b-49bf-44b7-8735-7ad13fe7f3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:50.448632 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-6a9c598b-49bf-44b7-8735-7ad13fe7f3fd None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:34:50.452280 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6a9c598b-49bf-44b7-8735-7ad13fe7f3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:50.544130 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1347/2717] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:34:50.555398 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f28c3-f34a-484f-82b0-9c60e2ee8bc8 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:50.557183 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-d25f28c3-f34a-484f-82b0-9c60e2ee8bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:50.661524 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f28c3-f34a-484f-82b0-9c60e2ee8bc8 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:50.669749 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590e5f4-d7e4-4a85-aba5-00a8d3d72d9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:50.670612 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590e5f4-d7e4-4a85-aba5-00a8d3d72d9d service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:50.671109 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590e5f4-d7e4-4a85-aba5-00a8d3d72d9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:50.671665 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590e5f4-d7e4-4a85-aba5-00a8d3d72d9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:50.689927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590e5f4-d7e4-4a85-aba5-00a8d3d72d9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:50.693029 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590e5f4-d7e4-4a85-aba5-00a8d3d72d9d service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:50.712358 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1371/2718] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:34:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:34:52.044287 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c598b-49bf-44b7-8735-7ad13fe7f3fd None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:52.045807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6a9c598b-49bf-44b7-8735-7ad13fe7f3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:52.060438 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c598b-49bf-44b7-8735-7ad13fe7f3fd None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:52.065869 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d3a0f-6ce8-4bfd-a730-ff2f85f2c8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:52.066584 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d3a0f-6ce8-4bfd-a730-ff2f85f2c8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:52.066865 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d3a0f-6ce8-4bfd-a730-ff2f85f2c8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:52.067148 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d3a0f-6ce8-4bfd-a730-ff2f85f2c8d3 admin admin] PATH_INFO: `/v3/users/5286400abcd440ff900d126ea6af1c08` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:52.068607 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d3a0f-6ce8-4bfd-a730-ff2f85f2c8d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5286400abcd440ff900d126ea6af1c08)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:52.070611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d3a0f-6ce8-4bfd-a730-ff2f85f2c8d3 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:52.329000 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-6f5d3a0f-6ce8-4bfd-a730-ff2f85f2c8d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5286400abcd440ff900d126ea6af1c08'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:52.443429 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-6f5d3a0f-6ce8-4bfd-a730-ff2f85f2c8d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5286400abcd440ff900d126ea6af1c08'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:52.444086 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-6f5d3a0f-6ce8-4bfd-a730-ff2f85f2c8d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5286400abcd440ff900d126ea6af1c08'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:52.444709 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-6f5d3a0f-6ce8-4bfd-a730-ff2f85f2c8d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5286400abcd440ff900d126ea6af1c08'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:52.453455 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-6f5d3a0f-6ce8-4bfd-a730-ff2f85f2c8d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5286400abcd440ff900d126ea6af1c08'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:52.467187 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:34:52.486903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1348/2719] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:34:52 2022] DELETE /identity/v3/users/5286400abcd440ff900d126ea6af1c08 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:34:52.494328 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80f1d0-57f9-49ff-835c-992ded4c33d6 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:52.495810 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80f1d0-57f9-49ff-835c-992ded4c33d6 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:52.495810 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80f1d0-57f9-49ff-835c-992ded4c33d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:52.526761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-ee80f1d0-57f9-49ff-835c-992ded4c33d6 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:34:52.528772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ee80f1d0-57f9-49ff-835c-992ded4c33d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:52.640527 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1372/2720] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:34:52.655001 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d3a0f-6ce8-4bfd-a730-ff2f85f2c8d3 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:52.656544 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6f5d3a0f-6ce8-4bfd-a730-ff2f85f2c8d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:52.762090 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d3a0f-6ce8-4bfd-a730-ff2f85f2c8d3 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:52.770933 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd3f2b-8f52-4f18-a5e6-dafee9d7c5b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:52.771827 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd3f2b-8f52-4f18-a5e6-dafee9d7c5b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:52.772383 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd3f2b-8f52-4f18-a5e6-dafee9d7c5b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:52.773247 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd3f2b-8f52-4f18-a5e6-dafee9d7c5b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:52.786113 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd3f2b-8f52-4f18-a5e6-dafee9d7c5b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:52.789691 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd3f2b-8f52-4f18-a5e6-dafee9d7c5b2 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:52.799345 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1349/2721] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:34:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:34:53.563214 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80f1d0-57f9-49ff-835c-992ded4c33d6 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:53.573334 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ee80f1d0-57f9-49ff-835c-992ded4c33d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:53.625109 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80f1d0-57f9-49ff-835c-992ded4c33d6 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:53.665717 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a03d4-9022-49b6-9514-98f3a72db58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:53.666839 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a03d4-9022-49b6-9514-98f3a72db58c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:53.667334 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a03d4-9022-49b6-9514-98f3a72db58c admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:53.668142 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a03d4-9022-49b6-9514-98f3a72db58c admin admin] PATH_INFO: `/v3/projects/903b1430bb9a4e1584551c4f6fa6200d` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:53.670482 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a03d4-9022-49b6-9514-98f3a72db58c admin admin] RBAC: Authorizing `identity:delete_project(project_id=903b1430bb9a4e1584551c4f6fa6200d)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:53.675065 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a03d4-9022-49b6-9514-98f3a72db58c admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:53.713579 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:34:53.899200 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9c9a03d4-9022-49b6-9514-98f3a72db58c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '903b1430bb9a4e1584551c4f6fa6200d', 'request_id': 'req-9c9a03d4-9022-49b6-9514-98f3a72db58c'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:53.913275 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9c9a03d4-9022-49b6-9514-98f3a72db58c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '903b1430bb9a4e1584551c4f6fa6200d', 'request_id': 'req-9c9a03d4-9022-49b6-9514-98f3a72db58c'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:53.999129 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9c9a03d4-9022-49b6-9514-98f3a72db58c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '903b1430bb9a4e1584551c4f6fa6200d', 'request_id': 'req-9c9a03d4-9022-49b6-9514-98f3a72db58c'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:54.018772 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9c9a03d4-9022-49b6-9514-98f3a72db58c admin admin] The token cache is being invalidate because project 903b1430bb9a4e1584551c4f6fa6200d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:34:54.019252 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9c9a03d4-9022-49b6-9514-98f3a72db58c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:54.020471 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-9c9a03d4-9022-49b6-9514-98f3a72db58c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:34:54.022658 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1373/2722] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:34:53 2022] DELETE /identity/v3/projects/903b1430bb9a4e1584551c4f6fa6200d => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:34:59.509882 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96753d8c-4e18-4fb3-b03c-c53d1062ca1f None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:59.515816 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96753d8c-4e18-4fb3-b03c-c53d1062ca1f None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:59.516535 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96753d8c-4e18-4fb3-b03c-c53d1062ca1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:59.572410 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-96753d8c-4e18-4fb3-b03c-c53d1062ca1f None None] MFA Rules not processed for user `b64e3a9410554ad1a4478bc9da37dd16`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:34:59.573780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-96753d8c-4e18-4fb3-b03c-c53d1062ca1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:59.663162 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1350/2723] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:34:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:34:59.687252 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a03d4-9022-49b6-9514-98f3a72db58c admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:34:59.692086 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-9c9a03d4-9022-49b6-9514-98f3a72db58c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:34:59.893385 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a03d4-9022-49b6-9514-98f3a72db58c admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:34:59.905725 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b84dc-5a17-4898-bc35-80ee9b0f3f44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:34:59.906861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b84dc-5a17-4898-bc35-80ee9b0f3f44 service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:34:59.907360 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b84dc-5a17-4898-bc35-80ee9b0f3f44 service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:34:59.908466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b84dc-5a17-4898-bc35-80ee9b0f3f44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:34:59.927137 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b84dc-5a17-4898-bc35-80ee9b0f3f44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:34:59.955668 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b84dc-5a17-4898-bc35-80ee9b0f3f44 service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:34:59.962461 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1374/2724] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:34:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:35:01.742803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96753d8c-4e18-4fb3-b03c-c53d1062ca1f None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:01.746796 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-96753d8c-4e18-4fb3-b03c-c53d1062ca1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:35:01.940426 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96753d8c-4e18-4fb3-b03c-c53d1062ca1f None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:01.946774 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad991b7-8508-4f8b-912e-c730cd04dba2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a486663ec144db0bbde6bf3deb35a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:01.947482 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad991b7-8508-4f8b-912e-c730cd04dba2 service placement] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:01.947744 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad991b7-8508-4f8b-912e-c730cd04dba2 service placement] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:01.948018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad991b7-8508-4f8b-912e-c730cd04dba2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:01.950134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-bad991b7-8508-4f8b-912e-c730cd04dba2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:35:01.961132 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:35:01.964507 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad991b7-8508-4f8b-912e-c730cd04dba2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:01.967107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad991b7-8508-4f8b-912e-c730cd04dba2 service placement] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:01.986550 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1351/2725] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:35:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:35:04.027151 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a13cf-10b0-4a17-929a-f3cba5af31b5 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:04.027932 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a13cf-10b0-4a17-929a-f3cba5af31b5 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:04.027932 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a13cf-10b0-4a17-929a-f3cba5af31b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:04.062467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-bc2a13cf-10b0-4a17-929a-f3cba5af31b5 None None] MFA Rules not processed for user `b64e3a9410554ad1a4478bc9da37dd16`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:35:04.064807 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-bc2a13cf-10b0-4a17-929a-f3cba5af31b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:35:04.075471 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1375/2726] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:35:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:35:13.288421 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:35:13.779166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad991b7-8508-4f8b-912e-c730cd04dba2 service placement] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:13.780616 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-bad991b7-8508-4f8b-912e-c730cd04dba2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:35:13.907537 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad991b7-8508-4f8b-912e-c730cd04dba2 service placement] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:13.915708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa343b-0855-4e74-825b-61d7669fb041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:13.916885 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa343b-0855-4e74-825b-61d7669fb041 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:13.917365 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa343b-0855-4e74-825b-61d7669fb041 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:13.917832 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa343b-0855-4e74-825b-61d7669fb041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:13.920810 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-86aa343b-0855-4e74-825b-61d7669fb041 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:35:14.013835 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa343b-0855-4e74-825b-61d7669fb041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:14.015287 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa343b-0855-4e74-825b-61d7669fb041 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:14.027465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1352/2727] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:35:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:35:14.054115 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=68,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:35:24.022099 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=59 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:35:27.036963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a13cf-10b0-4a17-929a-f3cba5af31b5 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:27.053893 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a13cf-10b0-4a17-929a-f3cba5af31b5 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:27.060530 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7450a44-16ab-495d-ae21-07e7a2ccec66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:27.061581 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7450a44-16ab-495d-ae21-07e7a2ccec66 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:27.062050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7450a44-16ab-495d-ae21-07e7a2ccec66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:27.062535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7450a44-16ab-495d-ae21-07e7a2ccec66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:27.066430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-e7450a44-16ab-495d-ae21-07e7a2ccec66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:35:27.185704 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7450a44-16ab-495d-ae21-07e7a2ccec66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:27.187421 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7450a44-16ab-495d-ae21-07e7a2ccec66 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:27.208464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1376/2728] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:35:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:35:31.553497 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa343b-0855-4e74-825b-61d7669fb041 service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:31.555505 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-86aa343b-0855-4e74-825b-61d7669fb041 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:35:31.586553 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa343b-0855-4e74-825b-61d7669fb041 service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:31.595282 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c650254-4544-48b7-b1b8-e023136c2053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:31.596303 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c650254-4544-48b7-b1b8-e023136c2053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:31.596780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c650254-4544-48b7-b1b8-e023136c2053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:31.597232 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c650254-4544-48b7-b1b8-e023136c2053 admin admin] PATH_INFO: `/v3/users/87d974bb5cf94567b1493fa54e804374` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:31.599309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c650254-4544-48b7-b1b8-e023136c2053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87d974bb5cf94567b1493fa54e804374)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:31.602819 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c650254-4544-48b7-b1b8-e023136c2053 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:31.871138 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-1c650254-4544-48b7-b1b8-e023136c2053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87d974bb5cf94567b1493fa54e804374'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:35:32.014045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-1c650254-4544-48b7-b1b8-e023136c2053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87d974bb5cf94567b1493fa54e804374'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:35:32.014685 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-1c650254-4544-48b7-b1b8-e023136c2053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87d974bb5cf94567b1493fa54e804374'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:35:32.015334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-1c650254-4544-48b7-b1b8-e023136c2053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87d974bb5cf94567b1493fa54e804374'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:35:32.023673 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-1c650254-4544-48b7-b1b8-e023136c2053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87d974bb5cf94567b1493fa54e804374'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:35:32.043760 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1353/2729] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:35:31 2022] DELETE /identity/v3/users/87d974bb5cf94567b1493fa54e804374 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:35:32.349608 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7450a44-16ab-495d-ae21-07e7a2ccec66 service neutron] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:32.365909 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7450a44-16ab-495d-ae21-07e7a2ccec66 service neutron] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:32.443165 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818c911-0d29-4f60-929a-110dcdc7ba67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:32.443863 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818c911-0d29-4f60-929a-110dcdc7ba67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:32.444155 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818c911-0d29-4f60-929a-110dcdc7ba67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:32.444430 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818c911-0d29-4f60-929a-110dcdc7ba67 admin admin] PATH_INFO: `/v3/projects/f417682e3dee4b36a017463034b61a3f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:32.445887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818c911-0d29-4f60-929a-110dcdc7ba67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f417682e3dee4b36a017463034b61a3f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:32.447879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818c911-0d29-4f60-929a-110dcdc7ba67 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:32.678335 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-2818c911-0d29-4f60-929a-110dcdc7ba67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f417682e3dee4b36a017463034b61a3f', 'request_id': 'req-2818c911-0d29-4f60-929a-110dcdc7ba67'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:35:32.685225 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-2818c911-0d29-4f60-929a-110dcdc7ba67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f417682e3dee4b36a017463034b61a3f', 'request_id': 'req-2818c911-0d29-4f60-929a-110dcdc7ba67'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:35:32.831671 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-2818c911-0d29-4f60-929a-110dcdc7ba67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f417682e3dee4b36a017463034b61a3f', 'request_id': 'req-2818c911-0d29-4f60-929a-110dcdc7ba67'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:35:32.844221 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-2818c911-0d29-4f60-929a-110dcdc7ba67 admin admin] The token cache is being invalidate because project f417682e3dee4b36a017463034b61a3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:35:32.844615 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-2818c911-0d29-4f60-929a-110dcdc7ba67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:35:32.845278 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-2818c911-0d29-4f60-929a-110dcdc7ba67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:35:32.847039 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1377/2730] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:35:32 2022] DELETE /identity/v3/projects/f417682e3dee4b36a017463034b61a3f => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:35:32.852111 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14c36a-944c-4d2d-8745-6ef647dc1297 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:32.852626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14c36a-944c-4d2d-8745-6ef647dc1297 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:32.862753 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14c36a-944c-4d2d-8745-6ef647dc1297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:32.877796 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-8f14c36a-944c-4d2d-8745-6ef647dc1297 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:35:32.879043 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-8f14c36a-944c-4d2d-8745-6ef647dc1297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:35:32.945653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1354/2731] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:35:32.953937 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fc16a-0d65-47ce-b4eb-fe9aef748f17 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:32.954364 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fc16a-0d65-47ce-b4eb-fe9aef748f17 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:32.954676 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fc16a-0d65-47ce-b4eb-fe9aef748f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:32.977618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-c93fc16a-0d65-47ce-b4eb-fe9aef748f17 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:35:32.978876 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-c93fc16a-0d65-47ce-b4eb-fe9aef748f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:35:32.987840 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1378/2732] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:35:32.992276 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14c36a-944c-4d2d-8745-6ef647dc1297 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:33.003354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14c36a-944c-4d2d-8745-6ef647dc1297 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:33.008390 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d09d6-957e-447c-b003-ae3ebf8b62d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:33.009023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d09d6-957e-447c-b003-ae3ebf8b62d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:33.009301 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d09d6-957e-447c-b003-ae3ebf8b62d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:33.009572 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d09d6-957e-447c-b003-ae3ebf8b62d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:33.010234 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d09d6-957e-447c-b003-ae3ebf8b62d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:35:33.010594 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d09d6-957e-447c-b003-ae3ebf8b62d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:33.012204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d09d6-957e-447c-b003-ae3ebf8b62d8 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:33.025480 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1355/2733] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:35:33.030544 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fc16a-0d65-47ce-b4eb-fe9aef748f17 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:33.041105 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fc16a-0d65-47ce-b4eb-fe9aef748f17 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:33.045993 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd0397-c97b-43ee-81b8-5e0fa1ad2e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:33.046616 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd0397-c97b-43ee-81b8-5e0fa1ad2e22 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:33.046895 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd0397-c97b-43ee-81b8-5e0fa1ad2e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:33.047832 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd0397-c97b-43ee-81b8-5e0fa1ad2e22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:33.048495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd0397-c97b-43ee-81b8-5e0fa1ad2e22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:33.050439 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd0397-c97b-43ee-81b8-5e0fa1ad2e22 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:33.068851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:35:33.205197 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1379/2734] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:35:33 2022] POST /identity/v3/projects => generated 367 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:35:33.210074 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d09d6-957e-447c-b003-ae3ebf8b62d8 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:33.229698 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d09d6-957e-447c-b003-ae3ebf8b62d8 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:33.305662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67798060-f454-4404-8d42-a287649d30dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:33.306329 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67798060-f454-4404-8d42-a287649d30dc admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:33.307014 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67798060-f454-4404-8d42-a287649d30dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:33.307309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67798060-f454-4404-8d42-a287649d30dc admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:33.308061 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67798060-f454-4404-8d42-a287649d30dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:33.310951 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67798060-f454-4404-8d42-a287649d30dc admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:33.320857 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:35:33.438577 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1356/2735] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:35:33 2022] POST /identity/v3/users => generated 284 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:35:33.443373 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd0397-c97b-43ee-81b8-5e0fa1ad2e22 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:33.455046 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd0397-c97b-43ee-81b8-5e0fa1ad2e22 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:33.460471 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35c42c-abb8-4b43-9214-addb7a9cce63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:33.461099 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35c42c-abb8-4b43-9214-addb7a9cce63 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:33.461391 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35c42c-abb8-4b43-9214-addb7a9cce63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:33.461818 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35c42c-abb8-4b43-9214-addb7a9cce63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:33.462664 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35c42c-abb8-4b43-9214-addb7a9cce63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:33.464874 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35c42c-abb8-4b43-9214-addb7a9cce63 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:33.476534 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1380/2736] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:35:33.481206 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67798060-f454-4404-8d42-a287649d30dc admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:33.495026 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67798060-f454-4404-8d42-a287649d30dc admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:33.500708 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c4e01-82fc-49c7-8af8-74db5733f5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:33.501004 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c4e01-82fc-49c7-8af8-74db5733f5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:33.501280 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c4e01-82fc-49c7-8af8-74db5733f5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:33.501603 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c4e01-82fc-49c7-8af8-74db5733f5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:33.502242 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c4e01-82fc-49c7-8af8-74db5733f5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:33.504021 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c4e01-82fc-49c7-8af8-74db5733f5c5 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:33.515761 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1357/2737] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:35:33.520095 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35c42c-abb8-4b43-9214-addb7a9cce63 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:33.532020 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35c42c-abb8-4b43-9214-addb7a9cce63 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:33.536944 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f64355f-49be-4ed9-9398-0010e7d77932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:33.537624 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64355f-49be-4ed9-9398-0010e7d77932 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:33.537900 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64355f-49be-4ed9-9398-0010e7d77932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:33.538165 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64355f-49be-4ed9-9398-0010e7d77932 admin admin] PATH_INFO: `/v3/projects/78a38254513743a4b1c331c8cf1bc7d2/users/95e343d3f790462f8d98c3701c31ace8/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:33.556456 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f64355f-49be-4ed9-9398-0010e7d77932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78a38254513743a4b1c331c8cf1bc7d2, user_id=95e343d3f790462f8d98c3701c31ace8, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:33.559110 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f64355f-49be-4ed9-9398-0010e7d77932 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:33.657835 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1381/2738] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:35:33 2022] PUT /identity/v3/projects/78a38254513743a4b1c331c8cf1bc7d2/users/95e343d3f790462f8d98c3701c31ace8/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:35:33.669441 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f65e9-0b7d-44c6-bf49-c17bd96751d4 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:33.669724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f65e9-0b7d-44c6-bf49-c17bd96751d4 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:33.669998 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f65e9-0b7d-44c6-bf49-c17bd96751d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:33.697986 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-031f65e9-0b7d-44c6-bf49-c17bd96751d4 None None] MFA Rules not processed for user `95e343d3f790462f8d98c3701c31ace8`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:35:33.699267 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-031f65e9-0b7d-44c6-bf49-c17bd96751d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:35:33.767732 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1358/2739] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:35:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:35:33.778847 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f64355f-49be-4ed9-9398-0010e7d77932 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:33.780698 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-1f64355f-49be-4ed9-9398-0010e7d77932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:35:33.891664 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f64355f-49be-4ed9-9398-0010e7d77932 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:33.895781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73617c86-9d80-4b88-b232-5f147d9ac705 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:33.903244 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73617c86-9d80-4b88-b232-5f147d9ac705 service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:33.903244 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73617c86-9d80-4b88-b232-5f147d9ac705 service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:33.903244 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73617c86-9d80-4b88-b232-5f147d9ac705 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:33.907766 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73617c86-9d80-4b88-b232-5f147d9ac705 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:33.909203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73617c86-9d80-4b88-b232-5f147d9ac705 service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:33.919295 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1382/2740] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:35:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:35:43.763938 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:35:43.914742 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=52,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:35:45.727379 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f65e9-0b7d-44c6-bf49-c17bd96751d4 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:45.816510 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f65e9-0b7d-44c6-bf49-c17bd96751d4 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:45.830705 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc56d2-3fb8-47af-9b7b-98ed27f223a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:45.831491 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc56d2-3fb8-47af-9b7b-98ed27f223a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:45.832098 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc56d2-3fb8-47af-9b7b-98ed27f223a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:45.832374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc56d2-3fb8-47af-9b7b-98ed27f223a4 admin admin] PATH_INFO: `/v3/users/95e343d3f790462f8d98c3701c31ace8` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:45.833705 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc56d2-3fb8-47af-9b7b-98ed27f223a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95e343d3f790462f8d98c3701c31ace8)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:45.836044 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc56d2-3fb8-47af-9b7b-98ed27f223a4 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:46.040476 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-28bc56d2-3fb8-47af-9b7b-98ed27f223a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95e343d3f790462f8d98c3701c31ace8'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:35:46.140476 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-28bc56d2-3fb8-47af-9b7b-98ed27f223a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95e343d3f790462f8d98c3701c31ace8'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:35:46.141138 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-28bc56d2-3fb8-47af-9b7b-98ed27f223a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95e343d3f790462f8d98c3701c31ace8'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:35:46.141865 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-28bc56d2-3fb8-47af-9b7b-98ed27f223a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95e343d3f790462f8d98c3701c31ace8'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:35:46.151529 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-28bc56d2-3fb8-47af-9b7b-98ed27f223a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95e343d3f790462f8d98c3701c31ace8'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:35:46.174150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1359/2741] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:35:45 2022] DELETE /identity/v3/users/95e343d3f790462f8d98c3701c31ace8 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:35:46.178875 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb5bb5-c8bf-49c5-9dc1-c7946b2e4a9a None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:46.179490 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb5bb5-c8bf-49c5-9dc1-c7946b2e4a9a None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:46.179490 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb5bb5-c8bf-49c5-9dc1-c7946b2e4a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:46.201082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-59fb5bb5-c8bf-49c5-9dc1-c7946b2e4a9a None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:35:46.202345 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-59fb5bb5-c8bf-49c5-9dc1-c7946b2e4a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:35:46.306982 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1383/2742] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:35:46.319367 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc56d2-3fb8-47af-9b7b-98ed27f223a4 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:46.321512 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-28bc56d2-3fb8-47af-9b7b-98ed27f223a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:35:46.391375 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc56d2-3fb8-47af-9b7b-98ed27f223a4 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:46.397119 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a0382-6d39-4adc-adce-0a113619276d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:46.398189 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a0382-6d39-4adc-adce-0a113619276d service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:46.398677 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a0382-6d39-4adc-adce-0a113619276d service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:46.399206 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a0382-6d39-4adc-adce-0a113619276d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:46.410663 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a0382-6d39-4adc-adce-0a113619276d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:46.412519 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a0382-6d39-4adc-adce-0a113619276d service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:46.425534 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1360/2743] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:35:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:35:47.021081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb5bb5-c8bf-49c5-9dc1-c7946b2e4a9a None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:47.023128 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-59fb5bb5-c8bf-49c5-9dc1-c7946b2e4a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:35:47.036609 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb5bb5-c8bf-49c5-9dc1-c7946b2e4a9a None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:47.042251 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35524d3-6b89-40d9-9750-5cd37f8804b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:47.042996 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35524d3-6b89-40d9-9750-5cd37f8804b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:47.043273 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35524d3-6b89-40d9-9750-5cd37f8804b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:47.043620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35524d3-6b89-40d9-9750-5cd37f8804b5 admin admin] PATH_INFO: `/v3/projects/78a38254513743a4b1c331c8cf1bc7d2` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:47.044916 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35524d3-6b89-40d9-9750-5cd37f8804b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78a38254513743a4b1c331c8cf1bc7d2)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:47.046866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35524d3-6b89-40d9-9750-5cd37f8804b5 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:47.208178 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-b35524d3-6b89-40d9-9750-5cd37f8804b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78a38254513743a4b1c331c8cf1bc7d2', 'request_id': 'req-b35524d3-6b89-40d9-9750-5cd37f8804b5'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:35:47.216377 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-b35524d3-6b89-40d9-9750-5cd37f8804b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78a38254513743a4b1c331c8cf1bc7d2', 'request_id': 'req-b35524d3-6b89-40d9-9750-5cd37f8804b5'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:35:47.288160 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-b35524d3-6b89-40d9-9750-5cd37f8804b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78a38254513743a4b1c331c8cf1bc7d2', 'request_id': 'req-b35524d3-6b89-40d9-9750-5cd37f8804b5'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:35:47.305555 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-b35524d3-6b89-40d9-9750-5cd37f8804b5 admin admin] The token cache is being invalidate because project 78a38254513743a4b1c331c8cf1bc7d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:35:47.306054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-b35524d3-6b89-40d9-9750-5cd37f8804b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:35:47.307182 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-b35524d3-6b89-40d9-9750-5cd37f8804b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:35:47.309980 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1384/2744] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:35:47 2022] DELETE /identity/v3/projects/78a38254513743a4b1c331c8cf1bc7d2 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:35:47.318466 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7e6f7-fcd7-4cea-b2a1-8021e82bf7fa None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:47.325361 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7e6f7-fcd7-4cea-b2a1-8021e82bf7fa None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:47.325361 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7e6f7-fcd7-4cea-b2a1-8021e82bf7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:47.353352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-6af7e6f7-fcd7-4cea-b2a1-8021e82bf7fa None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:35:47.355579 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6af7e6f7-fcd7-4cea-b2a1-8021e82bf7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:35:47.397308 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:35:47.452407 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1361/2745] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:35:47.461360 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c5616-5043-4b6b-8bff-800f12787bd1 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:47.461647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c5616-5043-4b6b-8bff-800f12787bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:47.461885 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c5616-5043-4b6b-8bff-800f12787bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:47.488862 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-346c5616-5043-4b6b-8bff-800f12787bd1 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:35:47.490190 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-346c5616-5043-4b6b-8bff-800f12787bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:35:47.499203 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1385/2746] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:35:47.507018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7e6f7-fcd7-4cea-b2a1-8021e82bf7fa None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:47.523276 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7e6f7-fcd7-4cea-b2a1-8021e82bf7fa None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:47.532441 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34468f-ba8a-474a-9496-2be28cc8c2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:47.533502 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34468f-ba8a-474a-9496-2be28cc8c2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:47.533974 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34468f-ba8a-474a-9496-2be28cc8c2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:47.534459 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34468f-ba8a-474a-9496-2be28cc8c2d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:47.535707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34468f-ba8a-474a-9496-2be28cc8c2d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:35:47.536206 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34468f-ba8a-474a-9496-2be28cc8c2d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:47.539482 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34468f-ba8a-474a-9496-2be28cc8c2d4 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:47.564627 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1362/2747] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:35:47.570230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c5616-5043-4b6b-8bff-800f12787bd1 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:47.581838 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c5616-5043-4b6b-8bff-800f12787bd1 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:47.586972 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40140e-d95f-4777-afef-5d2e7ab7efac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:47.587698 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40140e-d95f-4777-afef-5d2e7ab7efac admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:47.587974 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40140e-d95f-4777-afef-5d2e7ab7efac admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:47.588241 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40140e-d95f-4777-afef-5d2e7ab7efac admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:47.588899 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40140e-d95f-4777-afef-5d2e7ab7efac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:47.590919 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40140e-d95f-4777-afef-5d2e7ab7efac admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:47.755531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1386/2748] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:35:47 2022] POST /identity/v3/projects => generated 355 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:35:47.761465 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34468f-ba8a-474a-9496-2be28cc8c2d4 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:47.775844 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34468f-ba8a-474a-9496-2be28cc8c2d4 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:47.862744 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d9ba8-89d4-4926-a2a8-d2613941c052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:47.863391 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d9ba8-89d4-4926-a2a8-d2613941c052 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:47.863707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d9ba8-89d4-4926-a2a8-d2613941c052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:47.863973 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d9ba8-89d4-4926-a2a8-d2613941c052 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:47.864631 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d9ba8-89d4-4926-a2a8-d2613941c052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:47.866649 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d9ba8-89d4-4926-a2a8-d2613941c052 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:47.987173 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1363/2749] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:35:47 2022] POST /identity/v3/users => generated 278 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:35:47.993479 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40140e-d95f-4777-afef-5d2e7ab7efac admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:48.006435 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40140e-d95f-4777-afef-5d2e7ab7efac admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:48.011561 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fe720-87d6-46eb-b599-6cb025ebce2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:48.012364 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fe720-87d6-46eb-b599-6cb025ebce2b admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:48.013068 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fe720-87d6-46eb-b599-6cb025ebce2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:48.013222 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fe720-87d6-46eb-b599-6cb025ebce2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:48.013883 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311fe720-87d6-46eb-b599-6cb025ebce2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:48.015720 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311fe720-87d6-46eb-b599-6cb025ebce2b admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:48.028616 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1387/2750] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:35:48.034479 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d9ba8-89d4-4926-a2a8-d2613941c052 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:48.053098 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d9ba8-89d4-4926-a2a8-d2613941c052 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:48.061300 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57feeb48-fcc6-4f77-86e3-9e1ee792684d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:48.062006 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57feeb48-fcc6-4f77-86e3-9e1ee792684d admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:48.062963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57feeb48-fcc6-4f77-86e3-9e1ee792684d admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:48.063281 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57feeb48-fcc6-4f77-86e3-9e1ee792684d admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:48.064278 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57feeb48-fcc6-4f77-86e3-9e1ee792684d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:48.067105 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57feeb48-fcc6-4f77-86e3-9e1ee792684d admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:48.084393 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1364/2751] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:35:48.089063 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fe720-87d6-46eb-b599-6cb025ebce2b admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:48.101321 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fe720-87d6-46eb-b599-6cb025ebce2b admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:48.106522 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c5006-5022-4453-a8b9-dc8b0a3a2e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:48.107232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c5006-5022-4453-a8b9-dc8b0a3a2e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:48.107545 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c5006-5022-4453-a8b9-dc8b0a3a2e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:48.107825 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c5006-5022-4453-a8b9-dc8b0a3a2e1e admin admin] PATH_INFO: `/v3/projects/015bd73da2da4cc5af6be65a9f0682ce/users/8b7730b0791f4ae0be48a3f2122e0d5c/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:48.129703 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c5006-5022-4453-a8b9-dc8b0a3a2e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=015bd73da2da4cc5af6be65a9f0682ce, user_id=8b7730b0791f4ae0be48a3f2122e0d5c, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:48.132632 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c5006-5022-4453-a8b9-dc8b0a3a2e1e admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:48.278313 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1388/2752] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:35:48 2022] PUT /identity/v3/projects/015bd73da2da4cc5af6be65a9f0682ce/users/8b7730b0791f4ae0be48a3f2122e0d5c/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:35:48.291757 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ded88-3a8e-4dcd-b0a1-cd3ea4bc9704 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:48.292045 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ded88-3a8e-4dcd-b0a1-cd3ea4bc9704 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:48.292323 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ded88-3a8e-4dcd-b0a1-cd3ea4bc9704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:48.326844 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-ad9ded88-3a8e-4dcd-b0a1-cd3ea4bc9704 None None] MFA Rules not processed for user `8b7730b0791f4ae0be48a3f2122e0d5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:35:48.328153 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-ad9ded88-3a8e-4dcd-b0a1-cd3ea4bc9704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:35:48.413429 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1365/2753] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:35:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:35:48.419031 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c5006-5022-4453-a8b9-dc8b0a3a2e1e admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:48.446054 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:35:48.501358 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c5006-5022-4453-a8b9-dc8b0a3a2e1e admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:48.507239 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe7ba4-3c56-4dbd-8725-e5a9b3776c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:48.508047 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe7ba4-3c56-4dbd-8725-e5a9b3776c19 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:48.508336 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe7ba4-3c56-4dbd-8725-e5a9b3776c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:48.508784 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe7ba4-3c56-4dbd-8725-e5a9b3776c19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:48.509602 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe7ba4-3c56-4dbd-8725-e5a9b3776c19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:48.512449 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe7ba4-3c56-4dbd-8725-e5a9b3776c19 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:48.730056 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1389/2754] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:35:48 2022] POST /identity/v3/projects => generated 357 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:35:48.734736 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ded88-3a8e-4dcd-b0a1-cd3ea4bc9704 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:48.746232 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ded88-3a8e-4dcd-b0a1-cd3ea4bc9704 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:48.767580 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:35:48.822791 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32cbbe-cfc3-4664-b213-4bfb5b0d851d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:48.823928 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32cbbe-cfc3-4664-b213-4bfb5b0d851d admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:48.824311 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32cbbe-cfc3-4664-b213-4bfb5b0d851d admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:48.824817 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32cbbe-cfc3-4664-b213-4bfb5b0d851d admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:48.828690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32cbbe-cfc3-4664-b213-4bfb5b0d851d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:48.830348 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32cbbe-cfc3-4664-b213-4bfb5b0d851d admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:48.938797 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1366/2755] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:35:48 2022] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:35:48.943396 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe7ba4-3c56-4dbd-8725-e5a9b3776c19 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:48.955861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe7ba4-3c56-4dbd-8725-e5a9b3776c19 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:48.961163 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25513f1-91ff-4b5b-91f8-00e479016ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:48.983518 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25513f1-91ff-4b5b-91f8-00e479016ceb admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:48.983518 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25513f1-91ff-4b5b-91f8-00e479016ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:48.983518 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25513f1-91ff-4b5b-91f8-00e479016ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:48.983518 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25513f1-91ff-4b5b-91f8-00e479016ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:48.983518 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25513f1-91ff-4b5b-91f8-00e479016ceb admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:48.983518 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1390/2756] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:35:48.987204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32cbbe-cfc3-4664-b213-4bfb5b0d851d admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:48.998662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32cbbe-cfc3-4664-b213-4bfb5b0d851d admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:49.004903 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d06ce-0c08-4b3a-be5f-b45a19266cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:49.005592 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d06ce-0c08-4b3a-be5f-b45a19266cd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:49.005874 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d06ce-0c08-4b3a-be5f-b45a19266cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:49.006150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d06ce-0c08-4b3a-be5f-b45a19266cd2 admin admin] PATH_INFO: `/v3/projects/06849e343e9a4a82a84f1100d4f0b084/users/d3f1cb291b484f9894f87256dea1d9b7/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:49.028709 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d06ce-0c08-4b3a-be5f-b45a19266cd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06849e343e9a4a82a84f1100d4f0b084, user_id=d3f1cb291b484f9894f87256dea1d9b7, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:49.034210 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d06ce-0c08-4b3a-be5f-b45a19266cd2 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:49.158985 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1367/2757] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:35:48 2022] PUT /identity/v3/projects/06849e343e9a4a82a84f1100d4f0b084/users/d3f1cb291b484f9894f87256dea1d9b7/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:35:49.184734 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25513f1-91ff-4b5b-91f8-00e479016ceb admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:49.196799 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25513f1-91ff-4b5b-91f8-00e479016ceb admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:49.264188 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62962c8-5683-4b42-9ac7-525e074481bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:49.265067 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62962c8-5683-4b42-9ac7-525e074481bc admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:49.265505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62962c8-5683-4b42-9ac7-525e074481bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:49.265887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62962c8-5683-4b42-9ac7-525e074481bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:49.267200 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62962c8-5683-4b42-9ac7-525e074481bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:49.269018 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62962c8-5683-4b42-9ac7-525e074481bc admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:49.281433 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1391/2758] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:35:49.286253 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d06ce-0c08-4b3a-be5f-b45a19266cd2 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:49.298257 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d06ce-0c08-4b3a-be5f-b45a19266cd2 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:49.303406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cca06c-237a-4340-b082-2d2162ceefe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:49.304168 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cca06c-237a-4340-b082-2d2162ceefe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:49.304447 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cca06c-237a-4340-b082-2d2162ceefe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:49.304718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cca06c-237a-4340-b082-2d2162ceefe7 admin admin] PATH_INFO: `/v3/projects/06849e343e9a4a82a84f1100d4f0b084/users/d3f1cb291b484f9894f87256dea1d9b7/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:49.306963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cca06c-237a-4340-b082-2d2162ceefe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06849e343e9a4a82a84f1100d4f0b084, user_id=d3f1cb291b484f9894f87256dea1d9b7, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:49.309771 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cca06c-237a-4340-b082-2d2162ceefe7 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:49.323329 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1368/2759] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:35:49 2022] PUT /identity/v3/projects/06849e343e9a4a82a84f1100d4f0b084/users/d3f1cb291b484f9894f87256dea1d9b7/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:35:49.335093 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb1805-8e15-4306-af92-8700eeca3351 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:49.335423 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb1805-8e15-4306-af92-8700eeca3351 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:49.335883 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb1805-8e15-4306-af92-8700eeca3351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:49.370157 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-75eb1805-8e15-4306-af92-8700eeca3351 None None] MFA Rules not processed for user `d3f1cb291b484f9894f87256dea1d9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:35:49.371781 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-75eb1805-8e15-4306-af92-8700eeca3351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:35:49.487179 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1392/2760] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:35:49 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:35:49.506421 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cca06c-237a-4340-b082-2d2162ceefe7 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:49.509293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-40cca06c-237a-4340-b082-2d2162ceefe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:35:49.591152 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cca06c-237a-4340-b082-2d2162ceefe7 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:49.595678 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda8b07-e3bb-4ba7-a290-15a5908789be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:49.596300 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda8b07-e3bb-4ba7-a290-15a5908789be service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:49.596572 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda8b07-e3bb-4ba7-a290-15a5908789be service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:49.596840 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda8b07-e3bb-4ba7-a290-15a5908789be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:49.606835 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda8b07-e3bb-4ba7-a290-15a5908789be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:49.608305 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda8b07-e3bb-4ba7-a290-15a5908789be service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:49.619338 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1369/2761] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:35:49 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:35:49.916997 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb1805-8e15-4306-af92-8700eeca3351 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:35:49.928111 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb1805-8e15-4306-af92-8700eeca3351 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:35:49.935563 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764690e-ad93-493d-a50a-035a2c95e9bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:35:49.935563 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764690e-ad93-493d-a50a-035a2c95e9bc service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:35:49.935563 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764690e-ad93-493d-a50a-035a2c95e9bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:35:49.935563 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764690e-ad93-493d-a50a-035a2c95e9bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:35:49.948130 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:35:50.004907 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764690e-ad93-493d-a50a-035a2c95e9bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:35:50.006359 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764690e-ad93-493d-a50a-035a2c95e9bc service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:35:50.020079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1393/2762] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:35:49 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:35:59.614652 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=62,keystone:INSERT=5 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:36:00.076694 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=21 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:36:12.370982 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda8b07-e3bb-4ba7-a290-15a5908789be service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:12.452989 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda8b07-e3bb-4ba7-a290-15a5908789be service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:12.457992 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0024cb-5194-4a42-9568-36275c1f42cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:12.458624 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0024cb-5194-4a42-9568-36275c1f42cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:12.458932 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0024cb-5194-4a42-9568-36275c1f42cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:12.459211 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0024cb-5194-4a42-9568-36275c1f42cc admin admin] PATH_INFO: `/v3/users/8b7730b0791f4ae0be48a3f2122e0d5c` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:12.460544 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0024cb-5194-4a42-9568-36275c1f42cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b7730b0791f4ae0be48a3f2122e0d5c)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:12.462648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0024cb-5194-4a42-9568-36275c1f42cc admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:12.716102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-6e0024cb-5194-4a42-9568-36275c1f42cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b7730b0791f4ae0be48a3f2122e0d5c'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:12.832012 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-6e0024cb-5194-4a42-9568-36275c1f42cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b7730b0791f4ae0be48a3f2122e0d5c'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:12.832645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-6e0024cb-5194-4a42-9568-36275c1f42cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b7730b0791f4ae0be48a3f2122e0d5c'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:12.833282 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-6e0024cb-5194-4a42-9568-36275c1f42cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b7730b0791f4ae0be48a3f2122e0d5c'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:12.841715 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-6e0024cb-5194-4a42-9568-36275c1f42cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b7730b0791f4ae0be48a3f2122e0d5c'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:12.863242 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1370/2763] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:36:12 2022] DELETE /identity/v3/users/8b7730b0791f4ae0be48a3f2122e0d5c => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:36:12.868425 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e078f18-b185-4ef4-985c-afb6d39dcd30 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:12.872108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e078f18-b185-4ef4-985c-afb6d39dcd30 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:12.872108 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e078f18-b185-4ef4-985c-afb6d39dcd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:12.889661 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-9e078f18-b185-4ef4-985c-afb6d39dcd30 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:36:12.891450 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-9e078f18-b185-4ef4-985c-afb6d39dcd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:36:12.958411 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1394/2764] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:36:12.968486 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0024cb-5194-4a42-9568-36275c1f42cc admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:12.970077 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6e0024cb-5194-4a42-9568-36275c1f42cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:36:13.034526 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0024cb-5194-4a42-9568-36275c1f42cc admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:13.038116 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6c04d-d7b1-4ff2-966a-3ad9a0e6b821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:13.038716 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6c04d-d7b1-4ff2-966a-3ad9a0e6b821 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:13.038991 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6c04d-d7b1-4ff2-966a-3ad9a0e6b821 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:13.039258 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6c04d-d7b1-4ff2-966a-3ad9a0e6b821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:13.048834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6c04d-d7b1-4ff2-966a-3ad9a0e6b821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:13.050274 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6c04d-d7b1-4ff2-966a-3ad9a0e6b821 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:13.061527 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1371/2765] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:36:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:36:13.534173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e078f18-b185-4ef4-985c-afb6d39dcd30 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:13.535670 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-9e078f18-b185-4ef4-985c-afb6d39dcd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:36:13.549618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e078f18-b185-4ef4-985c-afb6d39dcd30 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:13.555854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f99a4b-52d9-448f-bf5e-ba15ef4ba65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:13.556531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f99a4b-52d9-448f-bf5e-ba15ef4ba65c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:13.556810 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f99a4b-52d9-448f-bf5e-ba15ef4ba65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:13.557085 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f99a4b-52d9-448f-bf5e-ba15ef4ba65c admin admin] PATH_INFO: `/v3/projects/015bd73da2da4cc5af6be65a9f0682ce` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:13.558372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f99a4b-52d9-448f-bf5e-ba15ef4ba65c admin admin] RBAC: Authorizing `identity:delete_project(project_id=015bd73da2da4cc5af6be65a9f0682ce)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:13.560398 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f99a4b-52d9-448f-bf5e-ba15ef4ba65c admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:13.710214 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d6f99a4b-52d9-448f-bf5e-ba15ef4ba65c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '015bd73da2da4cc5af6be65a9f0682ce', 'request_id': 'req-d6f99a4b-52d9-448f-bf5e-ba15ef4ba65c'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:13.716231 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d6f99a4b-52d9-448f-bf5e-ba15ef4ba65c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '015bd73da2da4cc5af6be65a9f0682ce', 'request_id': 'req-d6f99a4b-52d9-448f-bf5e-ba15ef4ba65c'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:13.887746 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d6f99a4b-52d9-448f-bf5e-ba15ef4ba65c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '015bd73da2da4cc5af6be65a9f0682ce', 'request_id': 'req-d6f99a4b-52d9-448f-bf5e-ba15ef4ba65c'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:13.903563 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d6f99a4b-52d9-448f-bf5e-ba15ef4ba65c admin admin] The token cache is being invalidate because project 015bd73da2da4cc5af6be65a9f0682ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:36:13.904438 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d6f99a4b-52d9-448f-bf5e-ba15ef4ba65c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:13.904655 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d6f99a4b-52d9-448f-bf5e-ba15ef4ba65c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:13.906271 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1395/2766] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:36:13 2022] DELETE /identity/v3/projects/015bd73da2da4cc5af6be65a9f0682ce => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:36:13.911113 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6c04d-d7b1-4ff2-966a-3ad9a0e6b821 service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:13.923660 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6c04d-d7b1-4ff2-966a-3ad9a0e6b821 service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:13.951091 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:36:14.006062 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97648f99-c9a9-4315-a246-9c1279cd5dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:14.006994 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97648f99-c9a9-4315-a246-9c1279cd5dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:14.007525 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97648f99-c9a9-4315-a246-9c1279cd5dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:14.007977 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97648f99-c9a9-4315-a246-9c1279cd5dcb admin admin] PATH_INFO: `/v3/users/d3f1cb291b484f9894f87256dea1d9b7` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:14.009797 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97648f99-c9a9-4315-a246-9c1279cd5dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3f1cb291b484f9894f87256dea1d9b7)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:14.012595 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97648f99-c9a9-4315-a246-9c1279cd5dcb admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:14.348737 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-97648f99-c9a9-4315-a246-9c1279cd5dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3f1cb291b484f9894f87256dea1d9b7'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:14.459545 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-97648f99-c9a9-4315-a246-9c1279cd5dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3f1cb291b484f9894f87256dea1d9b7'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:14.460575 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-97648f99-c9a9-4315-a246-9c1279cd5dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3f1cb291b484f9894f87256dea1d9b7'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:14.461296 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-97648f99-c9a9-4315-a246-9c1279cd5dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3f1cb291b484f9894f87256dea1d9b7'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:14.471355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-97648f99-c9a9-4315-a246-9c1279cd5dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3f1cb291b484f9894f87256dea1d9b7'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:14.493505 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1372/2767] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:36:13 2022] DELETE /identity/v3/users/d3f1cb291b484f9894f87256dea1d9b7 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:36:15.041583 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f99a4b-52d9-448f-bf5e-ba15ef4ba65c admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:15.043797 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-d6f99a4b-52d9-448f-bf5e-ba15ef4ba65c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:36:15.066794 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f99a4b-52d9-448f-bf5e-ba15ef4ba65c admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:15.160767 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c0640-0bf0-40d9-891a-8e245a9c94cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:15.161315 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c0640-0bf0-40d9-891a-8e245a9c94cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:15.161606 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c0640-0bf0-40d9-891a-8e245a9c94cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:15.161873 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c0640-0bf0-40d9-891a-8e245a9c94cf admin admin] PATH_INFO: `/v3/projects/06849e343e9a4a82a84f1100d4f0b084` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:15.162998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c0640-0bf0-40d9-891a-8e245a9c94cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=06849e343e9a4a82a84f1100d4f0b084)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:15.164969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c0640-0bf0-40d9-891a-8e245a9c94cf admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:15.267358 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:36:15.288149 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-2c1c0640-0bf0-40d9-891a-8e245a9c94cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06849e343e9a4a82a84f1100d4f0b084', 'request_id': 'req-2c1c0640-0bf0-40d9-891a-8e245a9c94cf'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:15.294611 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-2c1c0640-0bf0-40d9-891a-8e245a9c94cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06849e343e9a4a82a84f1100d4f0b084', 'request_id': 'req-2c1c0640-0bf0-40d9-891a-8e245a9c94cf'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:15.384720 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-2c1c0640-0bf0-40d9-891a-8e245a9c94cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06849e343e9a4a82a84f1100d4f0b084', 'request_id': 'req-2c1c0640-0bf0-40d9-891a-8e245a9c94cf'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:15.397493 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-2c1c0640-0bf0-40d9-891a-8e245a9c94cf admin admin] The token cache is being invalidate because project 06849e343e9a4a82a84f1100d4f0b084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:36:15.397783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-2c1c0640-0bf0-40d9-891a-8e245a9c94cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:15.398464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-2c1c0640-0bf0-40d9-891a-8e245a9c94cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:15.399995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1396/2768] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:36:15 2022] DELETE /identity/v3/projects/06849e343e9a4a82a84f1100d4f0b084 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:36:15.405254 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9202bc-4257-4d6e-b48d-e803ea0c708f None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:15.405831 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9202bc-4257-4d6e-b48d-e803ea0c708f None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:15.405831 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9202bc-4257-4d6e-b48d-e803ea0c708f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:15.429830 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-7a9202bc-4257-4d6e-b48d-e803ea0c708f None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:36:15.431107 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-7a9202bc-4257-4d6e-b48d-e803ea0c708f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:36:15.509182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1373/2769] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:36:15.519918 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959d840-22ab-451a-b275-2722af134310 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:15.519918 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959d840-22ab-451a-b275-2722af134310 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:15.519918 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959d840-22ab-451a-b275-2722af134310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:15.542014 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-9959d840-22ab-451a-b275-2722af134310 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:36:15.543336 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-9959d840-22ab-451a-b275-2722af134310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:36:15.552375 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1397/2770] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:36:15.557032 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9202bc-4257-4d6e-b48d-e803ea0c708f None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:15.569367 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9202bc-4257-4d6e-b48d-e803ea0c708f None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:15.574226 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6091562-1127-4a1a-ad54-98d138443dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:15.574916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6091562-1127-4a1a-ad54-98d138443dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:15.575196 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6091562-1127-4a1a-ad54-98d138443dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:15.575488 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6091562-1127-4a1a-ad54-98d138443dc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:15.576141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6091562-1127-4a1a-ad54-98d138443dc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:36:15.576447 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6091562-1127-4a1a-ad54-98d138443dc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:15.578070 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6091562-1127-4a1a-ad54-98d138443dc0 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:15.591375 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1374/2771] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:36:15.596658 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959d840-22ab-451a-b275-2722af134310 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:15.607112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959d840-22ab-451a-b275-2722af134310 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:15.611958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb0cb3-19a2-40a0-9768-9122f5cc15bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:15.612572 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb0cb3-19a2-40a0-9768-9122f5cc15bc admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:15.612850 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb0cb3-19a2-40a0-9768-9122f5cc15bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:15.613122 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb0cb3-19a2-40a0-9768-9122f5cc15bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:15.613765 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb0cb3-19a2-40a0-9768-9122f5cc15bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:15.615887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb0cb3-19a2-40a0-9768-9122f5cc15bc admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:15.718286 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1398/2772] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:36:15 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:36:15.723162 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6091562-1127-4a1a-ad54-98d138443dc0 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:15.733715 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6091562-1127-4a1a-ad54-98d138443dc0 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:15.766415 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:36:15.801140 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1d9d7-1c2d-424b-bf2b-d5f8cd8deba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:15.801766 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1d9d7-1c2d-424b-bf2b-d5f8cd8deba0 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:15.802047 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1d9d7-1c2d-424b-bf2b-d5f8cd8deba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:15.802322 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1d9d7-1c2d-424b-bf2b-d5f8cd8deba0 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:15.803000 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1d9d7-1c2d-424b-bf2b-d5f8cd8deba0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:15.805127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1d9d7-1c2d-424b-bf2b-d5f8cd8deba0 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:15.900518 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1375/2773] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:36:15 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:36:15.905831 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb0cb3-19a2-40a0-9768-9122f5cc15bc admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:15.920702 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb0cb3-19a2-40a0-9768-9122f5cc15bc admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:15.926768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1ea3b-5244-4ca0-a65e-b31d51882c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:15.927468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1ea3b-5244-4ca0-a65e-b31d51882c95 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:15.927757 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1ea3b-5244-4ca0-a65e-b31d51882c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:15.928036 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1ea3b-5244-4ca0-a65e-b31d51882c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:15.928686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1ea3b-5244-4ca0-a65e-b31d51882c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:15.930315 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1ea3b-5244-4ca0-a65e-b31d51882c95 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:15.941897 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1399/2774] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:36:15.946611 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1d9d7-1c2d-424b-bf2b-d5f8cd8deba0 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:15.958277 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1d9d7-1c2d-424b-bf2b-d5f8cd8deba0 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:15.963377 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8de2ff-3490-4505-b838-3146cc60d2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:15.964138 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8de2ff-3490-4505-b838-3146cc60d2fd admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:15.964418 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8de2ff-3490-4505-b838-3146cc60d2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:15.964693 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8de2ff-3490-4505-b838-3146cc60d2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:15.965403 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8de2ff-3490-4505-b838-3146cc60d2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:15.966978 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8de2ff-3490-4505-b838-3146cc60d2fd admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:15.977664 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1376/2775] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:36:15.981883 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1ea3b-5244-4ca0-a65e-b31d51882c95 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:15.992494 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1ea3b-5244-4ca0-a65e-b31d51882c95 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:15.997793 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0882bc5-fc3c-4a23-abf9-e4c056e2b289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:15.998464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0882bc5-fc3c-4a23-abf9-e4c056e2b289 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:15.998747 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0882bc5-fc3c-4a23-abf9-e4c056e2b289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:15.999022 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0882bc5-fc3c-4a23-abf9-e4c056e2b289 admin admin] PATH_INFO: `/v3/projects/c3d6e25f32374f2c9e9896631482278d/users/de3c6478e81844a8b99b0ce8b1859a38/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:16.016537 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0882bc5-fc3c-4a23-abf9-e4c056e2b289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3d6e25f32374f2c9e9896631482278d, user_id=de3c6478e81844a8b99b0ce8b1859a38, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:16.019280 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0882bc5-fc3c-4a23-abf9-e4c056e2b289 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:16.111366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1400/2776] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:36:15 2022] PUT /identity/v3/projects/c3d6e25f32374f2c9e9896631482278d/users/de3c6478e81844a8b99b0ce8b1859a38/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:36:16.122329 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdae7d-7505-4e24-9fba-54e953bce6e7 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:16.122811 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdae7d-7505-4e24-9fba-54e953bce6e7 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:16.130591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdae7d-7505-4e24-9fba-54e953bce6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:16.158514 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-99cdae7d-7505-4e24-9fba-54e953bce6e7 None None] MFA Rules not processed for user `de3c6478e81844a8b99b0ce8b1859a38`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:36:16.160127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-99cdae7d-7505-4e24-9fba-54e953bce6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:36:16.245421 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1377/2777] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:36:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:36:16.253443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0882bc5-fc3c-4a23-abf9-e4c056e2b289 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:16.329588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0882bc5-fc3c-4a23-abf9-e4c056e2b289 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:16.335548 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db4a8e-898c-48d3-8fb7-9c57662a9112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:16.336181 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db4a8e-898c-48d3-8fb7-9c57662a9112 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:16.336466 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db4a8e-898c-48d3-8fb7-9c57662a9112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:16.336733 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db4a8e-898c-48d3-8fb7-9c57662a9112 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:16.337457 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db4a8e-898c-48d3-8fb7-9c57662a9112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:16.339881 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db4a8e-898c-48d3-8fb7-9c57662a9112 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:16.455817 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1401/2778] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:36:16 2022] POST /identity/v3/projects => generated 367 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:36:16.461306 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdae7d-7505-4e24-9fba-54e953bce6e7 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:16.473369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdae7d-7505-4e24-9fba-54e953bce6e7 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:16.533200 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e214274-ca8c-4b73-8613-6ffec8c43e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:16.533816 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e214274-ca8c-4b73-8613-6ffec8c43e48 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:16.534098 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e214274-ca8c-4b73-8613-6ffec8c43e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:16.534373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e214274-ca8c-4b73-8613-6ffec8c43e48 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:16.535001 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e214274-ca8c-4b73-8613-6ffec8c43e48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:16.536954 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e214274-ca8c-4b73-8613-6ffec8c43e48 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:16.647092 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1378/2779] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:36:16 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:36:16.651393 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db4a8e-898c-48d3-8fb7-9c57662a9112 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:16.663488 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db4a8e-898c-48d3-8fb7-9c57662a9112 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:16.670501 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254deff-697c-4fa4-befd-3e409496b699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:16.670501 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254deff-697c-4fa4-befd-3e409496b699 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:16.670501 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254deff-697c-4fa4-befd-3e409496b699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:16.670501 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254deff-697c-4fa4-befd-3e409496b699 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:16.670966 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254deff-697c-4fa4-befd-3e409496b699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:16.671805 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254deff-697c-4fa4-befd-3e409496b699 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:16.685639 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1402/2780] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:36:16.690666 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e214274-ca8c-4b73-8613-6ffec8c43e48 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:16.702029 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e214274-ca8c-4b73-8613-6ffec8c43e48 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:16.706970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8be98f-ecce-4f63-b252-d5cadec266f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:16.707688 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8be98f-ecce-4f63-b252-d5cadec266f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:16.707963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8be98f-ecce-4f63-b252-d5cadec266f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:16.708233 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8be98f-ecce-4f63-b252-d5cadec266f8 admin admin] PATH_INFO: `/v3/projects/ffa549f7bfa64a7498247f76fa4e3a1d/users/b7c367fcf861405eabb25196bb80c386/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:16.724699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8be98f-ecce-4f63-b252-d5cadec266f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffa549f7bfa64a7498247f76fa4e3a1d, user_id=b7c367fcf861405eabb25196bb80c386, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:16.727426 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8be98f-ecce-4f63-b252-d5cadec266f8 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:16.890730 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1379/2781] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:36:16 2022] PUT /identity/v3/projects/ffa549f7bfa64a7498247f76fa4e3a1d/users/b7c367fcf861405eabb25196bb80c386/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:36:16.895178 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254deff-697c-4fa4-befd-3e409496b699 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:16.906115 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254deff-697c-4fa4-befd-3e409496b699 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:16.930237 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:36:16.983964 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0e694-a996-4674-bc76-79b9b43ea720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:16.985567 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0e694-a996-4674-bc76-79b9b43ea720 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:16.986066 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0e694-a996-4674-bc76-79b9b43ea720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:16.986563 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0e694-a996-4674-bc76-79b9b43ea720 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:16.987859 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0e694-a996-4674-bc76-79b9b43ea720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:16.990866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0e694-a996-4674-bc76-79b9b43ea720 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:17.006027 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1403/2782] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:36:17.010631 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8be98f-ecce-4f63-b252-d5cadec266f8 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:17.016473 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:36:17.022224 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8be98f-ecce-4f63-b252-d5cadec266f8 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:17.027373 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481ba5e-8568-4493-bd41-aeacb27fe391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:17.028088 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481ba5e-8568-4493-bd41-aeacb27fe391 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:17.028397 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481ba5e-8568-4493-bd41-aeacb27fe391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:17.028704 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481ba5e-8568-4493-bd41-aeacb27fe391 admin admin] PATH_INFO: `/v3/projects/ffa549f7bfa64a7498247f76fa4e3a1d/users/b7c367fcf861405eabb25196bb80c386/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:17.030678 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481ba5e-8568-4493-bd41-aeacb27fe391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffa549f7bfa64a7498247f76fa4e3a1d, user_id=b7c367fcf861405eabb25196bb80c386, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:17.033980 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481ba5e-8568-4493-bd41-aeacb27fe391 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:17.049895 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1380/2783] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:36:17 2022] PUT /identity/v3/projects/ffa549f7bfa64a7498247f76fa4e3a1d/users/b7c367fcf861405eabb25196bb80c386/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:36:17.061460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041da50-b1f0-485f-9187-aac7c485fa2a None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:17.061752 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041da50-b1f0-485f-9187-aac7c485fa2a None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:17.062028 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041da50-b1f0-485f-9187-aac7c485fa2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:17.095611 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-9041da50-b1f0-485f-9187-aac7c485fa2a None None] MFA Rules not processed for user `b7c367fcf861405eabb25196bb80c386`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:36:17.097146 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-9041da50-b1f0-485f-9187-aac7c485fa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:36:17.184388 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1404/2784] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:36:17 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:36:17.195896 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481ba5e-8568-4493-bd41-aeacb27fe391 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:17.197772 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-9481ba5e-8568-4493-bd41-aeacb27fe391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:36:17.273537 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481ba5e-8568-4493-bd41-aeacb27fe391 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:17.278198 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e447e8-d324-4277-a59d-e8d4930f68a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:17.278815 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e447e8-d324-4277-a59d-e8d4930f68a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:17.279090 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e447e8-d324-4277-a59d-e8d4930f68a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:17.279360 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e447e8-d324-4277-a59d-e8d4930f68a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:17.290106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e447e8-d324-4277-a59d-e8d4930f68a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:17.291564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e447e8-d324-4277-a59d-e8d4930f68a3 service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:17.301804 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1381/2785] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:36:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:36:21.028408 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041da50-b1f0-485f-9187-aac7c485fa2a None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:21.106657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041da50-b1f0-485f-9187-aac7c485fa2a None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:21.112467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc9baf-0cc8-4378-995e-07cba6166c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:21.113128 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc9baf-0cc8-4378-995e-07cba6166c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:21.113400 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc9baf-0cc8-4378-995e-07cba6166c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:21.113672 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc9baf-0cc8-4378-995e-07cba6166c60 admin admin] PATH_INFO: `/v3/users/de3c6478e81844a8b99b0ce8b1859a38` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:21.114924 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc9baf-0cc8-4378-995e-07cba6166c60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de3c6478e81844a8b99b0ce8b1859a38)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:21.117183 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc9baf-0cc8-4378-995e-07cba6166c60 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:21.350745 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-50cc9baf-0cc8-4378-995e-07cba6166c60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de3c6478e81844a8b99b0ce8b1859a38'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:21.352836 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:36:21.504852 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-50cc9baf-0cc8-4378-995e-07cba6166c60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de3c6478e81844a8b99b0ce8b1859a38'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:21.506014 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-50cc9baf-0cc8-4378-995e-07cba6166c60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de3c6478e81844a8b99b0ce8b1859a38'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:21.506687 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-50cc9baf-0cc8-4378-995e-07cba6166c60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de3c6478e81844a8b99b0ce8b1859a38'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:21.516784 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-50cc9baf-0cc8-4378-995e-07cba6166c60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de3c6478e81844a8b99b0ce8b1859a38'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:21.550236 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1405/2786] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:36:21 2022] DELETE /identity/v3/users/de3c6478e81844a8b99b0ce8b1859a38 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:36:21.557276 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96409492-161e-48f8-b9d0-cbca27c58e4c None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:21.557868 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96409492-161e-48f8-b9d0-cbca27c58e4c None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:21.558249 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96409492-161e-48f8-b9d0-cbca27c58e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:21.588363 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-96409492-161e-48f8-b9d0-cbca27c58e4c None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:36:21.590378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-96409492-161e-48f8-b9d0-cbca27c58e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:36:21.679670 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1382/2787] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:36:21.692861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc9baf-0cc8-4378-995e-07cba6166c60 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:21.695117 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-50cc9baf-0cc8-4378-995e-07cba6166c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:36:21.766864 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc9baf-0cc8-4378-995e-07cba6166c60 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:21.771505 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3eceef-63da-4126-ad7d-3e51c7b2d856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:21.772169 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3eceef-63da-4126-ad7d-3e51c7b2d856 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:21.772587 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3eceef-63da-4126-ad7d-3e51c7b2d856 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:21.773077 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3eceef-63da-4126-ad7d-3e51c7b2d856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:21.790379 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3eceef-63da-4126-ad7d-3e51c7b2d856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:21.792180 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3eceef-63da-4126-ad7d-3e51c7b2d856 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:21.806858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1406/2788] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:36:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:36:22.371046 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96409492-161e-48f8-b9d0-cbca27c58e4c None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:22.376719 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-96409492-161e-48f8-b9d0-cbca27c58e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:36:22.391904 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96409492-161e-48f8-b9d0-cbca27c58e4c None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:22.396273 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e50b59-a59f-40b3-a17f-e695d7a0b85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:22.404985 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e50b59-a59f-40b3-a17f-e695d7a0b85b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:22.404985 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e50b59-a59f-40b3-a17f-e695d7a0b85b admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:22.404985 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e50b59-a59f-40b3-a17f-e695d7a0b85b admin admin] PATH_INFO: `/v3/projects/c3d6e25f32374f2c9e9896631482278d` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:22.404985 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e50b59-a59f-40b3-a17f-e695d7a0b85b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3d6e25f32374f2c9e9896631482278d)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:22.404985 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e50b59-a59f-40b3-a17f-e695d7a0b85b admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:22.550551 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-d3e50b59-a59f-40b3-a17f-e695d7a0b85b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3d6e25f32374f2c9e9896631482278d', 'request_id': 'req-d3e50b59-a59f-40b3-a17f-e695d7a0b85b'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:22.558092 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-d3e50b59-a59f-40b3-a17f-e695d7a0b85b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3d6e25f32374f2c9e9896631482278d', 'request_id': 'req-d3e50b59-a59f-40b3-a17f-e695d7a0b85b'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:22.641900 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-d3e50b59-a59f-40b3-a17f-e695d7a0b85b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3d6e25f32374f2c9e9896631482278d', 'request_id': 'req-d3e50b59-a59f-40b3-a17f-e695d7a0b85b'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:22.659667 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-d3e50b59-a59f-40b3-a17f-e695d7a0b85b admin admin] The token cache is being invalidate because project c3d6e25f32374f2c9e9896631482278d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:36:22.660145 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-d3e50b59-a59f-40b3-a17f-e695d7a0b85b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:22.661162 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-d3e50b59-a59f-40b3-a17f-e695d7a0b85b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:22.663989 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1383/2789] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:36:22 2022] DELETE /identity/v3/projects/c3d6e25f32374f2c9e9896631482278d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:36:22.673352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3eceef-63da-4126-ad7d-3e51c7b2d856 service neutron] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:22.686570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3eceef-63da-4126-ad7d-3e51c7b2d856 service neutron] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:22.758686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520a8fd-c3eb-4b20-822a-263a880f9e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:22.759331 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520a8fd-c3eb-4b20-822a-263a880f9e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:22.759675 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520a8fd-c3eb-4b20-822a-263a880f9e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:22.759955 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520a8fd-c3eb-4b20-822a-263a880f9e8b admin admin] PATH_INFO: `/v3/users/b7c367fcf861405eabb25196bb80c386` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:22.761112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520a8fd-c3eb-4b20-822a-263a880f9e8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7c367fcf861405eabb25196bb80c386)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:22.763019 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520a8fd-c3eb-4b20-822a-263a880f9e8b admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:23.025213 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-5520a8fd-c3eb-4b20-822a-263a880f9e8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7c367fcf861405eabb25196bb80c386'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:23.125768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-5520a8fd-c3eb-4b20-822a-263a880f9e8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7c367fcf861405eabb25196bb80c386'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:23.126436 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-5520a8fd-c3eb-4b20-822a-263a880f9e8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7c367fcf861405eabb25196bb80c386'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:23.127034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-5520a8fd-c3eb-4b20-822a-263a880f9e8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7c367fcf861405eabb25196bb80c386'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:23.135755 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-5520a8fd-c3eb-4b20-822a-263a880f9e8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7c367fcf861405eabb25196bb80c386'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:23.144669 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:36:23.166083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1407/2790] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:36:22 2022] DELETE /identity/v3/users/b7c367fcf861405eabb25196bb80c386 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:36:23.655980 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e50b59-a59f-40b3-a17f-e695d7a0b85b admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:23.658062 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-d3e50b59-a59f-40b3-a17f-e695d7a0b85b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:36:23.672845 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e50b59-a59f-40b3-a17f-e695d7a0b85b admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:23.689541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:36:23.741366 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96dbf02-3131-482f-bd7a-e123f5ac4612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:23.742017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96dbf02-3131-482f-bd7a-e123f5ac4612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:23.742291 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96dbf02-3131-482f-bd7a-e123f5ac4612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:23.743243 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96dbf02-3131-482f-bd7a-e123f5ac4612 admin admin] PATH_INFO: `/v3/projects/ffa549f7bfa64a7498247f76fa4e3a1d` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:23.744459 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96dbf02-3131-482f-bd7a-e123f5ac4612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffa549f7bfa64a7498247f76fa4e3a1d)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:23.746364 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96dbf02-3131-482f-bd7a-e123f5ac4612 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:23.918678 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-b96dbf02-3131-482f-bd7a-e123f5ac4612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffa549f7bfa64a7498247f76fa4e3a1d', 'request_id': 'req-b96dbf02-3131-482f-bd7a-e123f5ac4612'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:23.926569 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-b96dbf02-3131-482f-bd7a-e123f5ac4612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffa549f7bfa64a7498247f76fa4e3a1d', 'request_id': 'req-b96dbf02-3131-482f-bd7a-e123f5ac4612'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:24.007338 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-b96dbf02-3131-482f-bd7a-e123f5ac4612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffa549f7bfa64a7498247f76fa4e3a1d', 'request_id': 'req-b96dbf02-3131-482f-bd7a-e123f5ac4612'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:24.019331 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-b96dbf02-3131-482f-bd7a-e123f5ac4612 admin admin] The token cache is being invalidate because project ffa549f7bfa64a7498247f76fa4e3a1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:36:24.022694 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-b96dbf02-3131-482f-bd7a-e123f5ac4612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:24.022694 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-b96dbf02-3131-482f-bd7a-e123f5ac4612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:24.022694 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1384/2791] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:36:23 2022] DELETE /identity/v3/projects/ffa549f7bfa64a7498247f76fa4e3a1d => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:36:24.027694 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc655be-9217-41e1-9630-0b17b51d0689 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:24.028482 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc655be-9217-41e1-9630-0b17b51d0689 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:24.028482 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc655be-9217-41e1-9630-0b17b51d0689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:24.050263 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-ccc655be-9217-41e1-9630-0b17b51d0689 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:36:24.051622 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ccc655be-9217-41e1-9630-0b17b51d0689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:36:24.119263 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1408/2792] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:36:24.128962 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e844a-8919-4481-8b52-9bbda5536826 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:24.129246 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e844a-8919-4481-8b52-9bbda5536826 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:24.129519 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e844a-8919-4481-8b52-9bbda5536826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:24.150441 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-b78e844a-8919-4481-8b52-9bbda5536826 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:36:24.151717 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-b78e844a-8919-4481-8b52-9bbda5536826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:36:24.159889 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1385/2793] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:36:24.164279 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc655be-9217-41e1-9630-0b17b51d0689 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:24.175770 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc655be-9217-41e1-9630-0b17b51d0689 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:24.181023 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf6118-1b33-4958-97ad-48b19636da02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:24.181647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf6118-1b33-4958-97ad-48b19636da02 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:24.181920 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf6118-1b33-4958-97ad-48b19636da02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:24.182187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf6118-1b33-4958-97ad-48b19636da02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:24.182866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf6118-1b33-4958-97ad-48b19636da02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:36:24.183169 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf6118-1b33-4958-97ad-48b19636da02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:24.184798 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf6118-1b33-4958-97ad-48b19636da02 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:24.201494 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1409/2794] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:36:24.212023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e844a-8919-4481-8b52-9bbda5536826 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:24.226941 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e844a-8919-4481-8b52-9bbda5536826 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:24.232916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8faf988-46e1-4532-ba5e-6769abf26842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:24.233565 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8faf988-46e1-4532-ba5e-6769abf26842 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:24.233843 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8faf988-46e1-4532-ba5e-6769abf26842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:24.234563 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8faf988-46e1-4532-ba5e-6769abf26842 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:24.235367 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8faf988-46e1-4532-ba5e-6769abf26842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:24.237310 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8faf988-46e1-4532-ba5e-6769abf26842 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:24.363462 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1386/2795] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:36:24 2022] POST /identity/v3/projects => generated 401 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:36:24.368579 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf6118-1b33-4958-97ad-48b19636da02 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:24.379753 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf6118-1b33-4958-97ad-48b19636da02 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:24.450445 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda0bc1-a2ad-4119-8108-3138efb2e0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:24.451397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda0bc1-a2ad-4119-8108-3138efb2e0ee admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:24.451795 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda0bc1-a2ad-4119-8108-3138efb2e0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:24.452193 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda0bc1-a2ad-4119-8108-3138efb2e0ee admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:24.452799 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda0bc1-a2ad-4119-8108-3138efb2e0ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:24.455809 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda0bc1-a2ad-4119-8108-3138efb2e0ee admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:24.549671 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1410/2796] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:36:24 2022] POST /identity/v3/users => generated 301 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:36:24.554489 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8faf988-46e1-4532-ba5e-6769abf26842 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:24.566280 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8faf988-46e1-4532-ba5e-6769abf26842 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:24.572754 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851dc2cb-a3f4-4b27-9e38-50b5f751ac06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:24.573520 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dc2cb-a3f4-4b27-9e38-50b5f751ac06 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:24.573801 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dc2cb-a3f4-4b27-9e38-50b5f751ac06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:24.574070 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dc2cb-a3f4-4b27-9e38-50b5f751ac06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:24.574729 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851dc2cb-a3f4-4b27-9e38-50b5f751ac06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:24.576632 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851dc2cb-a3f4-4b27-9e38-50b5f751ac06 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:24.589589 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1387/2797] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:36:24.595134 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda0bc1-a2ad-4119-8108-3138efb2e0ee admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:24.606760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda0bc1-a2ad-4119-8108-3138efb2e0ee admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:24.612666 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d1cac-6733-4632-81f5-8157438b6138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:24.613374 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d1cac-6733-4632-81f5-8157438b6138 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:24.613757 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d1cac-6733-4632-81f5-8157438b6138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:24.614135 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d1cac-6733-4632-81f5-8157438b6138 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:24.614811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d1cac-6733-4632-81f5-8157438b6138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:24.616798 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d1cac-6733-4632-81f5-8157438b6138 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:24.631398 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1411/2798] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:36:24.635781 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851dc2cb-a3f4-4b27-9e38-50b5f751ac06 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:24.650957 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851dc2cb-a3f4-4b27-9e38-50b5f751ac06 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:24.657590 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f7c13-c9c4-445f-9acc-3df27045b6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:24.658447 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f7c13-c9c4-445f-9acc-3df27045b6ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:24.658564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f7c13-c9c4-445f-9acc-3df27045b6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:24.658811 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f7c13-c9c4-445f-9acc-3df27045b6ec admin admin] PATH_INFO: `/v3/projects/1a08aa6a5224446cb1a20a3d2f770cc9/users/f2b1169015184ac48cb52fd5ebcdf1a0/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:24.677381 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f7c13-c9c4-445f-9acc-3df27045b6ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a08aa6a5224446cb1a20a3d2f770cc9, user_id=f2b1169015184ac48cb52fd5ebcdf1a0, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:24.680211 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f7c13-c9c4-445f-9acc-3df27045b6ec admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:24.826473 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1388/2799] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:36:24 2022] PUT /identity/v3/projects/1a08aa6a5224446cb1a20a3d2f770cc9/users/f2b1169015184ac48cb52fd5ebcdf1a0/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:36:24.842115 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2ac98-c6c1-4db7-86ea-b9d1cfba6fb9 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:24.842672 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2ac98-c6c1-4db7-86ea-b9d1cfba6fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:24.843120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2ac98-c6c1-4db7-86ea-b9d1cfba6fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:24.883199 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-0ea2ac98-c6c1-4db7-86ea-b9d1cfba6fb9 None None] MFA Rules not processed for user `f2b1169015184ac48cb52fd5ebcdf1a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:36:24.884395 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-0ea2ac98-c6c1-4db7-86ea-b9d1cfba6fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:36:24.935115 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:36:24.961450 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1412/2800] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:36:24 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:36:24.966491 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f7c13-c9c4-445f-9acc-3df27045b6ec admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:25.029590 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:36:25.053376 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f7c13-c9c4-445f-9acc-3df27045b6ec admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:25.059433 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9b73f-a55a-4079-b864-671c52a79f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:25.069541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9b73f-a55a-4079-b864-671c52a79f7f admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:25.069541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9b73f-a55a-4079-b864-671c52a79f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:25.069541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9b73f-a55a-4079-b864-671c52a79f7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:25.069541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9b73f-a55a-4079-b864-671c52a79f7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:25.069541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9b73f-a55a-4079-b864-671c52a79f7f admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:25.167916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1389/2801] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:36:24 2022] POST /identity/v3/projects => generated 399 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:36:25.175731 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2ac98-c6c1-4db7-86ea-b9d1cfba6fb9 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:25.185739 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2ac98-c6c1-4db7-86ea-b9d1cfba6fb9 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:25.275599 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848a8f9-e26a-4b78-8618-08f1affde290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:25.276811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848a8f9-e26a-4b78-8618-08f1affde290 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:25.276811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848a8f9-e26a-4b78-8618-08f1affde290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:25.276811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848a8f9-e26a-4b78-8618-08f1affde290 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:25.277432 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2848a8f9-e26a-4b78-8618-08f1affde290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:25.279416 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2848a8f9-e26a-4b78-8618-08f1affde290 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:25.372493 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1413/2802] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:36:25 2022] POST /identity/v3/users => generated 306 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:36:25.377963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9b73f-a55a-4079-b864-671c52a79f7f admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:25.396155 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9b73f-a55a-4079-b864-671c52a79f7f admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:25.404316 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e656322-7059-424a-b9fd-42c88b6b6fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:25.405335 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e656322-7059-424a-b9fd-42c88b6b6fdc admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:25.405832 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e656322-7059-424a-b9fd-42c88b6b6fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:25.406323 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e656322-7059-424a-b9fd-42c88b6b6fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:25.407612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e656322-7059-424a-b9fd-42c88b6b6fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:25.410727 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e656322-7059-424a-b9fd-42c88b6b6fdc admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:25.431314 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1390/2803] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:36:25.436111 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848a8f9-e26a-4b78-8618-08f1affde290 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:25.448509 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848a8f9-e26a-4b78-8618-08f1affde290 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:25.453463 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e72902-5ba1-45ea-977a-f6953c5df0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:25.454151 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e72902-5ba1-45ea-977a-f6953c5df0be admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:25.454443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e72902-5ba1-45ea-977a-f6953c5df0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:25.454777 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e72902-5ba1-45ea-977a-f6953c5df0be admin admin] PATH_INFO: `/v3/projects/22354aed4c6b4393a274d25b71757867/users/a148adc9d43c42d5adac65dc634adfcd/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:25.474233 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e72902-5ba1-45ea-977a-f6953c5df0be admin admin] RBAC: Authorizing `identity:create_grant(project_id=22354aed4c6b4393a274d25b71757867, user_id=a148adc9d43c42d5adac65dc634adfcd, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:25.476973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e72902-5ba1-45ea-977a-f6953c5df0be admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:25.555647 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1414/2804] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:36:25 2022] PUT /identity/v3/projects/22354aed4c6b4393a274d25b71757867/users/a148adc9d43c42d5adac65dc634adfcd/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:36:25.566961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e656322-7059-424a-b9fd-42c88b6b6fdc admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:25.581401 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e656322-7059-424a-b9fd-42c88b6b6fdc admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:25.654875 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e014e-53eb-4077-8a3e-45ce25a1a751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:25.655540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e014e-53eb-4077-8a3e-45ce25a1a751 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:25.655819 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e014e-53eb-4077-8a3e-45ce25a1a751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:25.656755 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e014e-53eb-4077-8a3e-45ce25a1a751 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:25.657420 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e014e-53eb-4077-8a3e-45ce25a1a751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:25.659212 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e014e-53eb-4077-8a3e-45ce25a1a751 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:25.670741 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1391/2805] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:36:25.676709 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e72902-5ba1-45ea-977a-f6953c5df0be admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:25.689095 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e72902-5ba1-45ea-977a-f6953c5df0be admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:25.694528 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c54773-c900-441c-88fb-5b58a38953a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:25.695226 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c54773-c900-441c-88fb-5b58a38953a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:25.695576 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c54773-c900-441c-88fb-5b58a38953a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:25.695891 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c54773-c900-441c-88fb-5b58a38953a7 admin admin] PATH_INFO: `/v3/projects/22354aed4c6b4393a274d25b71757867/users/a148adc9d43c42d5adac65dc634adfcd/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:25.698089 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c54773-c900-441c-88fb-5b58a38953a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22354aed4c6b4393a274d25b71757867, user_id=a148adc9d43c42d5adac65dc634adfcd, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:25.700946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c54773-c900-441c-88fb-5b58a38953a7 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:25.714258 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1415/2806] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:36:25 2022] PUT /identity/v3/projects/22354aed4c6b4393a274d25b71757867/users/a148adc9d43c42d5adac65dc634adfcd/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:36:25.736939 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc89400-f2cf-4fa1-a8cc-aa92e5e17b41 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:25.737346 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc89400-f2cf-4fa1-a8cc-aa92e5e17b41 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:25.737498 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc89400-f2cf-4fa1-a8cc-aa92e5e17b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:25.770285 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-2cc89400-f2cf-4fa1-a8cc-aa92e5e17b41 None None] MFA Rules not processed for user `a148adc9d43c42d5adac65dc634adfcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:36:25.771559 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-2cc89400-f2cf-4fa1-a8cc-aa92e5e17b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:36:25.860982 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1392/2807] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:36:25 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:36:25.931042 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c54773-c900-441c-88fb-5b58a38953a7 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:25.932828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-a9c54773-c900-441c-88fb-5b58a38953a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:36:25.996592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c54773-c900-441c-88fb-5b58a38953a7 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:26.003866 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb271a-0585-41e0-8195-b9624c389631 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:26.004568 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb271a-0585-41e0-8195-b9624c389631 service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:26.004886 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb271a-0585-41e0-8195-b9624c389631 service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:26.005163 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb271a-0585-41e0-8195-b9624c389631 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:26.015112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb271a-0585-41e0-8195-b9624c389631 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:26.017159 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb271a-0585-41e0-8195-b9624c389631 service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:26.028862 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1416/2808] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:36:25 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:36:26.295148 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc89400-f2cf-4fa1-a8cc-aa92e5e17b41 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:26.306549 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc89400-f2cf-4fa1-a8cc-aa92e5e17b41 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:26.310370 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2e22a-6388-47ae-9c94-1b4629f9c850 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:26.310989 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2e22a-6388-47ae-9c94-1b4629f9c850 service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:26.311271 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2e22a-6388-47ae-9c94-1b4629f9c850 service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:26.311582 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2e22a-6388-47ae-9c94-1b4629f9c850 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:26.357447 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:36:26.390066 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2e22a-6388-47ae-9c94-1b4629f9c850 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:26.391561 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2e22a-6388-47ae-9c94-1b4629f9c850 service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:26.402715 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1393/2809] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:36:26 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:36:32.184482 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb271a-0585-41e0-8195-b9624c389631 service cinder] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:32.242818 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:36:32.266619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb271a-0585-41e0-8195-b9624c389631 service cinder] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:32.271761 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14aa32b-4e0d-4440-a1f2-ab52dda6592f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:32.272418 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14aa32b-4e0d-4440-a1f2-ab52dda6592f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:32.272697 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14aa32b-4e0d-4440-a1f2-ab52dda6592f admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:32.272958 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14aa32b-4e0d-4440-a1f2-ab52dda6592f admin admin] PATH_INFO: `/v3/users/f2b1169015184ac48cb52fd5ebcdf1a0` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:32.274112 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14aa32b-4e0d-4440-a1f2-ab52dda6592f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b1169015184ac48cb52fd5ebcdf1a0)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:32.276077 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14aa32b-4e0d-4440-a1f2-ab52dda6592f admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:32.521495 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-a14aa32b-4e0d-4440-a1f2-ab52dda6592f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b1169015184ac48cb52fd5ebcdf1a0'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:32.601565 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-a14aa32b-4e0d-4440-a1f2-ab52dda6592f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b1169015184ac48cb52fd5ebcdf1a0'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:32.602218 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-a14aa32b-4e0d-4440-a1f2-ab52dda6592f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b1169015184ac48cb52fd5ebcdf1a0'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:32.602853 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-a14aa32b-4e0d-4440-a1f2-ab52dda6592f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b1169015184ac48cb52fd5ebcdf1a0'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:32.613481 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-a14aa32b-4e0d-4440-a1f2-ab52dda6592f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b1169015184ac48cb52fd5ebcdf1a0'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:32.644418 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1417/2810] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:36:32 2022] DELETE /identity/v3/users/f2b1169015184ac48cb52fd5ebcdf1a0 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:36:32.650632 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd049cf-4228-46f1-bbde-a9af9ae05f50 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:32.651182 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd049cf-4228-46f1-bbde-a9af9ae05f50 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:32.651301 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd049cf-4228-46f1-bbde-a9af9ae05f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:32.671569 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-5bd049cf-4228-46f1-bbde-a9af9ae05f50 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:36:32.672884 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-5bd049cf-4228-46f1-bbde-a9af9ae05f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:36:32.743726 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1394/2811] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:36:32.754557 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14aa32b-4e0d-4440-a1f2-ab52dda6592f admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:32.756036 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-a14aa32b-4e0d-4440-a1f2-ab52dda6592f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:36:32.829436 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14aa32b-4e0d-4440-a1f2-ab52dda6592f admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:32.833220 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6702ee7-aa27-4581-bfd8-d359550427f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:32.833838 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6702ee7-aa27-4581-bfd8-d359550427f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:32.834120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6702ee7-aa27-4581-bfd8-d359550427f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:32.834402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6702ee7-aa27-4581-bfd8-d359550427f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:32.845293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6702ee7-aa27-4581-bfd8-d359550427f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:32.846821 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6702ee7-aa27-4581-bfd8-d359550427f6 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:32.857834 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1418/2812] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:36:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:36:33.446076 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd049cf-4228-46f1-bbde-a9af9ae05f50 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:33.447895 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-5bd049cf-4228-46f1-bbde-a9af9ae05f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:36:33.464633 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd049cf-4228-46f1-bbde-a9af9ae05f50 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:33.471128 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56086170-ccc0-43b0-a144-9c45d970a432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:33.471878 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56086170-ccc0-43b0-a144-9c45d970a432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:33.472157 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56086170-ccc0-43b0-a144-9c45d970a432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:33.472490 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56086170-ccc0-43b0-a144-9c45d970a432 admin admin] PATH_INFO: `/v3/projects/1a08aa6a5224446cb1a20a3d2f770cc9` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:33.473925 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56086170-ccc0-43b0-a144-9c45d970a432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a08aa6a5224446cb1a20a3d2f770cc9)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:33.475993 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56086170-ccc0-43b0-a144-9c45d970a432 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:33.685694 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-56086170-ccc0-43b0-a144-9c45d970a432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a08aa6a5224446cb1a20a3d2f770cc9', 'request_id': 'req-56086170-ccc0-43b0-a144-9c45d970a432'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:33.693738 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-56086170-ccc0-43b0-a144-9c45d970a432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a08aa6a5224446cb1a20a3d2f770cc9', 'request_id': 'req-56086170-ccc0-43b0-a144-9c45d970a432'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:33.885574 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-56086170-ccc0-43b0-a144-9c45d970a432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a08aa6a5224446cb1a20a3d2f770cc9', 'request_id': 'req-56086170-ccc0-43b0-a144-9c45d970a432'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:33.901109 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-56086170-ccc0-43b0-a144-9c45d970a432 admin admin] The token cache is being invalidate because project 1a08aa6a5224446cb1a20a3d2f770cc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:36:33.901588 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-56086170-ccc0-43b0-a144-9c45d970a432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:33.902366 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-56086170-ccc0-43b0-a144-9c45d970a432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:33.904204 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1395/2813] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:36:33 2022] DELETE /identity/v3/projects/1a08aa6a5224446cb1a20a3d2f770cc9 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:36:33.909227 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6702ee7-aa27-4581-bfd8-d359550427f6 service neutron] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:33.919972 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6702ee7-aa27-4581-bfd8-d359550427f6 service neutron] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:33.989768 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85056b-60db-4583-adf1-48aca13c0499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:33.990311 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85056b-60db-4583-adf1-48aca13c0499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:33.990594 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85056b-60db-4583-adf1-48aca13c0499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:33.990870 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85056b-60db-4583-adf1-48aca13c0499 admin admin] PATH_INFO: `/v3/users/a148adc9d43c42d5adac65dc634adfcd` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:33.992122 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85056b-60db-4583-adf1-48aca13c0499 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a148adc9d43c42d5adac65dc634adfcd)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:33.994262 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85056b-60db-4583-adf1-48aca13c0499 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:33.996162 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:36:34.507120 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-cf85056b-60db-4583-adf1-48aca13c0499 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a148adc9d43c42d5adac65dc634adfcd'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:34.596129 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-cf85056b-60db-4583-adf1-48aca13c0499 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a148adc9d43c42d5adac65dc634adfcd'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:34.597784 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-cf85056b-60db-4583-adf1-48aca13c0499 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a148adc9d43c42d5adac65dc634adfcd'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:34.599573 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-cf85056b-60db-4583-adf1-48aca13c0499 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a148adc9d43c42d5adac65dc634adfcd'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:34.612497 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-cf85056b-60db-4583-adf1-48aca13c0499 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a148adc9d43c42d5adac65dc634adfcd'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:34.635601 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1419/2814] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:36:33 2022] DELETE /identity/v3/users/a148adc9d43c42d5adac65dc634adfcd => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:36:35.158474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56086170-ccc0-43b0-a144-9c45d970a432 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:35.160354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-56086170-ccc0-43b0-a144-9c45d970a432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:36:35.177416 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56086170-ccc0-43b0-a144-9c45d970a432 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:35.247614 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b18f7-9c7a-4175-a4b3-ffb56d41b3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:35.248269 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b18f7-9c7a-4175-a4b3-ffb56d41b3f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:35.248553 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b18f7-9c7a-4175-a4b3-ffb56d41b3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:35.248832 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b18f7-9c7a-4175-a4b3-ffb56d41b3f7 admin admin] PATH_INFO: `/v3/projects/22354aed4c6b4393a274d25b71757867` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:35.251340 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b18f7-9c7a-4175-a4b3-ffb56d41b3f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22354aed4c6b4393a274d25b71757867)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:35.253315 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b18f7-9c7a-4175-a4b3-ffb56d41b3f7 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:35.255333 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:36:35.445242 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-493b18f7-9c7a-4175-a4b3-ffb56d41b3f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22354aed4c6b4393a274d25b71757867', 'request_id': 'req-493b18f7-9c7a-4175-a4b3-ffb56d41b3f7'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:35.452948 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-493b18f7-9c7a-4175-a4b3-ffb56d41b3f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22354aed4c6b4393a274d25b71757867', 'request_id': 'req-493b18f7-9c7a-4175-a4b3-ffb56d41b3f7'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:35.725374 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-493b18f7-9c7a-4175-a4b3-ffb56d41b3f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22354aed4c6b4393a274d25b71757867', 'request_id': 'req-493b18f7-9c7a-4175-a4b3-ffb56d41b3f7'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:35.737612 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-493b18f7-9c7a-4175-a4b3-ffb56d41b3f7 admin admin] The token cache is being invalidate because project 22354aed4c6b4393a274d25b71757867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:36:35.737901 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-493b18f7-9c7a-4175-a4b3-ffb56d41b3f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:35.738562 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-493b18f7-9c7a-4175-a4b3-ffb56d41b3f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:36:35.740106 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1396/2815] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:36:35 2022] DELETE /identity/v3/projects/22354aed4c6b4393a274d25b71757867 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:36:35.745132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5850c-d2a8-43c2-bc12-927f183e5846 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:35.745704 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5850c-d2a8-43c2-bc12-927f183e5846 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:35.745704 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5850c-d2a8-43c2-bc12-927f183e5846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:35.767344 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-a6a5850c-d2a8-43c2-bc12-927f183e5846 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:36:35.768590 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-a6a5850c-d2a8-43c2-bc12-927f183e5846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:36:35.845342 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1420/2816] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:36:35.854591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27060b27-4421-4c3b-bdb5-01634170208f None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:35.854891 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27060b27-4421-4c3b-bdb5-01634170208f None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:35.855152 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27060b27-4421-4c3b-bdb5-01634170208f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:35.879108 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-27060b27-4421-4c3b-bdb5-01634170208f None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:36:35.880399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-27060b27-4421-4c3b-bdb5-01634170208f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:36:35.890332 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1397/2817] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:36:35.897149 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5850c-d2a8-43c2-bc12-927f183e5846 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:35.914272 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5850c-d2a8-43c2-bc12-927f183e5846 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:35.919939 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d289fa21-64a9-416d-a254-3bcebc5e7bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:35.920593 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289fa21-64a9-416d-a254-3bcebc5e7bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:35.920872 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289fa21-64a9-416d-a254-3bcebc5e7bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:35.921201 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289fa21-64a9-416d-a254-3bcebc5e7bc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:35.921890 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d289fa21-64a9-416d-a254-3bcebc5e7bc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:36:35.922219 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d289fa21-64a9-416d-a254-3bcebc5e7bc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:35.924235 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d289fa21-64a9-416d-a254-3bcebc5e7bc1 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:35.938605 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1421/2818] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:36:35.943850 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27060b27-4421-4c3b-bdb5-01634170208f None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:35.954397 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27060b27-4421-4c3b-bdb5-01634170208f None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:35.959493 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac27dc6-648a-49b1-b270-ba5e67b52762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:35.960113 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac27dc6-648a-49b1-b270-ba5e67b52762 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:35.960478 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac27dc6-648a-49b1-b270-ba5e67b52762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:35.960662 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac27dc6-648a-49b1-b270-ba5e67b52762 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:35.961302 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac27dc6-648a-49b1-b270-ba5e67b52762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:35.963227 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac27dc6-648a-49b1-b270-ba5e67b52762 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:36.077720 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1398/2819] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:36:35 2022] POST /identity/v3/projects => generated 365 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:36:36.082806 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d289fa21-64a9-416d-a254-3bcebc5e7bc1 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:36.093255 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d289fa21-64a9-416d-a254-3bcebc5e7bc1 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:36.162180 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e450f8-db32-4bfd-86d9-d70064495aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:36.162814 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e450f8-db32-4bfd-86d9-d70064495aaf admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:36.163093 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e450f8-db32-4bfd-86d9-d70064495aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:36.163413 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e450f8-db32-4bfd-86d9-d70064495aaf admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:36.164146 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e450f8-db32-4bfd-86d9-d70064495aaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:36.166345 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e450f8-db32-4bfd-86d9-d70064495aaf admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:36.180525 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:36:36.312100 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1422/2820] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:36:36 2022] POST /identity/v3/users => generated 283 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:36:36.317121 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac27dc6-648a-49b1-b270-ba5e67b52762 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:36.328171 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac27dc6-648a-49b1-b270-ba5e67b52762 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:36.335169 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349b908-e393-44cb-86be-ce74d4943e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:36.335830 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349b908-e393-44cb-86be-ce74d4943e0f admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:36.336108 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349b908-e393-44cb-86be-ce74d4943e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:36.336376 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349b908-e393-44cb-86be-ce74d4943e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:36.337220 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349b908-e393-44cb-86be-ce74d4943e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:36.338626 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349b908-e393-44cb-86be-ce74d4943e0f admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:36.351503 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1399/2821] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:36:36.356908 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e450f8-db32-4bfd-86d9-d70064495aaf admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:36.368312 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e450f8-db32-4bfd-86d9-d70064495aaf admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:36.373621 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417f20d-1492-44b3-a5b2-3226af33a644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:36.374317 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417f20d-1492-44b3-a5b2-3226af33a644 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:36.374592 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417f20d-1492-44b3-a5b2-3226af33a644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:36.374865 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417f20d-1492-44b3-a5b2-3226af33a644 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:36.376252 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417f20d-1492-44b3-a5b2-3226af33a644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:36.377993 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417f20d-1492-44b3-a5b2-3226af33a644 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:36.390686 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1423/2822] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:36:36.395983 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349b908-e393-44cb-86be-ce74d4943e0f admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:36.406847 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349b908-e393-44cb-86be-ce74d4943e0f admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:36.411930 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cab19-5b63-47cd-b70c-1c57b1484cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:36.413854 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cab19-5b63-47cd-b70c-1c57b1484cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:36.413854 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cab19-5b63-47cd-b70c-1c57b1484cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:36.413854 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cab19-5b63-47cd-b70c-1c57b1484cf0 admin admin] PATH_INFO: `/v3/projects/d6260b0806684a7596d49a6b36cb1c94/users/59d193ed4cb945ec83ab82fdc16eb889/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:36.431639 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6cab19-5b63-47cd-b70c-1c57b1484cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6260b0806684a7596d49a6b36cb1c94, user_id=59d193ed4cb945ec83ab82fdc16eb889, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:36.434535 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6cab19-5b63-47cd-b70c-1c57b1484cf0 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:36.557290 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1400/2823] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:36:36 2022] PUT /identity/v3/projects/d6260b0806684a7596d49a6b36cb1c94/users/59d193ed4cb945ec83ab82fdc16eb889/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:36:36.571863 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1632da5-afce-46a0-b8d7-185c5dd3798e None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:36.572185 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1632da5-afce-46a0-b8d7-185c5dd3798e None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:36.572414 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1632da5-afce-46a0-b8d7-185c5dd3798e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:36.603157 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-a1632da5-afce-46a0-b8d7-185c5dd3798e None None] MFA Rules not processed for user `59d193ed4cb945ec83ab82fdc16eb889`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:36:36.604395 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-a1632da5-afce-46a0-b8d7-185c5dd3798e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:36:36.671322 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1424/2824] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:36:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:36:36.682876 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cab19-5b63-47cd-b70c-1c57b1484cf0 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:36:36.684602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-0c6cab19-5b63-47cd-b70c-1c57b1484cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:36:36.747490 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cab19-5b63-47cd-b70c-1c57b1484cf0 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:36:36.752012 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f3302-84aa-471e-a88d-8b9c7f80fb25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:36:36.752633 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f3302-84aa-471e-a88d-8b9c7f80fb25 service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:36:36.752916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f3302-84aa-471e-a88d-8b9c7f80fb25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:36:36.753190 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f3302-84aa-471e-a88d-8b9c7f80fb25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:36:36.762327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f3302-84aa-471e-a88d-8b9c7f80fb25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:36:36.763794 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f3302-84aa-471e-a88d-8b9c7f80fb25 service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:36:36.775301 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1401/2825] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:36:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:36:46.668264 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=39 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:36:46.769419 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:37:10.445129 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1632da5-afce-46a0-b8d7-185c5dd3798e None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:37:10.456402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1632da5-afce-46a0-b8d7-185c5dd3798e None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:37:10.460366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be082743-83e4-44f4-81aa-ed694adbf3dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:37:10.461021 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be082743-83e4-44f4-81aa-ed694adbf3dd service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:37:10.461300 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be082743-83e4-44f4-81aa-ed694adbf3dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:37:10.461575 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be082743-83e4-44f4-81aa-ed694adbf3dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:37:10.463551 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-be082743-83e4-44f4-81aa-ed694adbf3dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:37:10.547124 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be082743-83e4-44f4-81aa-ed694adbf3dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:37:10.548624 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be082743-83e4-44f4-81aa-ed694adbf3dd service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:37:10.560271 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1425/2826] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:37:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:37:13.544794 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f3302-84aa-471e-a88d-8b9c7f80fb25 service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:37:13.546309 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-4d9f3302-84aa-471e-a88d-8b9c7f80fb25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:37:13.611365 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f3302-84aa-471e-a88d-8b9c7f80fb25 service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:37:13.615126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d02aa-5935-48ea-8923-c648b9e9c428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:37:13.615783 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d02aa-5935-48ea-8923-c648b9e9c428 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:37:13.616119 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d02aa-5935-48ea-8923-c648b9e9c428 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:37:13.616393 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d02aa-5935-48ea-8923-c648b9e9c428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:37:13.618294 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-cc5d02aa-5935-48ea-8923-c648b9e9c428 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:37:13.633899 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d02aa-5935-48ea-8923-c648b9e9c428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:37:13.635379 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d02aa-5935-48ea-8923-c648b9e9c428 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:37:13.647668 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1402/2827] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:37:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:37:15.247576 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be082743-83e4-44f4-81aa-ed694adbf3dd service cinder] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:37:15.323983 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be082743-83e4-44f4-81aa-ed694adbf3dd service cinder] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:37:15.328489 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b547a-7068-4704-85eb-d759dd2356c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:37:15.329721 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b547a-7068-4704-85eb-d759dd2356c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:37:15.329997 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b547a-7068-4704-85eb-d759dd2356c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:37:15.330270 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b547a-7068-4704-85eb-d759dd2356c7 admin admin] PATH_INFO: `/v3/users/59d193ed4cb945ec83ab82fdc16eb889` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:37:15.331514 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b547a-7068-4704-85eb-d759dd2356c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59d193ed4cb945ec83ab82fdc16eb889)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:37:15.333435 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b547a-7068-4704-85eb-d759dd2356c7 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:37:15.636219 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d98b547a-7068-4704-85eb-d759dd2356c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59d193ed4cb945ec83ab82fdc16eb889'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:37:15.763733 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d98b547a-7068-4704-85eb-d759dd2356c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59d193ed4cb945ec83ab82fdc16eb889'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:37:15.764372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d98b547a-7068-4704-85eb-d759dd2356c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59d193ed4cb945ec83ab82fdc16eb889'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:37:15.765033 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d98b547a-7068-4704-85eb-d759dd2356c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59d193ed4cb945ec83ab82fdc16eb889'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:37:15.777854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d98b547a-7068-4704-85eb-d759dd2356c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59d193ed4cb945ec83ab82fdc16eb889'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:37:15.798324 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1426/2828] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:37:15 2022] DELETE /identity/v3/users/59d193ed4cb945ec83ab82fdc16eb889 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:37:15.803888 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc67557-a8af-4c9d-92b8-4efb0f171424 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:37:15.804540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc67557-a8af-4c9d-92b8-4efb0f171424 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:37:15.804540 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc67557-a8af-4c9d-92b8-4efb0f171424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:37:15.835579 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-cfc67557-a8af-4c9d-92b8-4efb0f171424 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:37:15.835579 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-cfc67557-a8af-4c9d-92b8-4efb0f171424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:37:15.903959 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1403/2829] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:37:15.914934 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b547a-7068-4704-85eb-d759dd2356c7 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:37:15.916377 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-d98b547a-7068-4704-85eb-d759dd2356c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:37:15.923715 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:37:15.979658 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b547a-7068-4704-85eb-d759dd2356c7 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:37:15.984368 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146443b9-d6fd-422d-a0a9-40cfe6abeee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:37:15.985937 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146443b9-d6fd-422d-a0a9-40cfe6abeee2 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:37:15.986117 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146443b9-d6fd-422d-a0a9-40cfe6abeee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:37:15.986562 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146443b9-d6fd-422d-a0a9-40cfe6abeee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:37:16.001619 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146443b9-d6fd-422d-a0a9-40cfe6abeee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:37:16.003158 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146443b9-d6fd-422d-a0a9-40cfe6abeee2 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:37:16.013601 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1427/2830] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:37:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:37:16.509196 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc67557-a8af-4c9d-92b8-4efb0f171424 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:37:16.510969 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-cfc67557-a8af-4c9d-92b8-4efb0f171424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:37:16.534762 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc67557-a8af-4c9d-92b8-4efb0f171424 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:37:16.541838 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55dbcf-1339-4f7d-8e46-92c8aa98ebb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:37:16.542353 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55dbcf-1339-4f7d-8e46-92c8aa98ebb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:37:16.542585 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55dbcf-1339-4f7d-8e46-92c8aa98ebb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:37:16.542957 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55dbcf-1339-4f7d-8e46-92c8aa98ebb4 admin admin] PATH_INFO: `/v3/projects/d6260b0806684a7596d49a6b36cb1c94` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:37:16.544096 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55dbcf-1339-4f7d-8e46-92c8aa98ebb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6260b0806684a7596d49a6b36cb1c94)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:37:16.546023 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55dbcf-1339-4f7d-8e46-92c8aa98ebb4 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:37:16.674779 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-bb55dbcf-1339-4f7d-8e46-92c8aa98ebb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6260b0806684a7596d49a6b36cb1c94', 'request_id': 'req-bb55dbcf-1339-4f7d-8e46-92c8aa98ebb4'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:37:16.685399 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-bb55dbcf-1339-4f7d-8e46-92c8aa98ebb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6260b0806684a7596d49a6b36cb1c94', 'request_id': 'req-bb55dbcf-1339-4f7d-8e46-92c8aa98ebb4'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:37:16.780961 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-bb55dbcf-1339-4f7d-8e46-92c8aa98ebb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6260b0806684a7596d49a6b36cb1c94', 'request_id': 'req-bb55dbcf-1339-4f7d-8e46-92c8aa98ebb4'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:37:16.799998 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-bb55dbcf-1339-4f7d-8e46-92c8aa98ebb4 admin admin] The token cache is being invalidate because project d6260b0806684a7596d49a6b36cb1c94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:37:16.809560 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-bb55dbcf-1339-4f7d-8e46-92c8aa98ebb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:37:16.809560 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-bb55dbcf-1339-4f7d-8e46-92c8aa98ebb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:37:16.809560 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1404/2831] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:37:16 2022] DELETE /identity/v3/projects/d6260b0806684a7596d49a6b36cb1c94 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:37:23.926727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146443b9-d6fd-422d-a0a9-40cfe6abeee2 service neutron] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:37:23.937116 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146443b9-d6fd-422d-a0a9-40cfe6abeee2 service neutron] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:37:23.993183 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9e42c-4543-4f13-b357-47a41bfb8fb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:37:23.993804 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9e42c-4543-4f13-b357-47a41bfb8fb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:37:23.994082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9e42c-4543-4f13-b357-47a41bfb8fb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:37:23.994354 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9e42c-4543-4f13-b357-47a41bfb8fb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:37:23.996179 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-55b9e42c-4543-4f13-b357-47a41bfb8fb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:37:24.010991 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9e42c-4543-4f13-b357-47a41bfb8fb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:37:24.012604 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9e42c-4543-4f13-b357-47a41bfb8fb6 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:37:24.026516 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1428/2832] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:37:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:37:26.794685 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:37:34.021930 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=50 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:38:09.434756 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55dbcf-1339-4f7d-8e46-92c8aa98ebb4 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:38:09.436555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-bb55dbcf-1339-4f7d-8e46-92c8aa98ebb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:38:09.523940 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55dbcf-1339-4f7d-8e46-92c8aa98ebb4 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:38:09.530350 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168072c-f7e8-482c-8ae2-6eec89bc593d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:38:09.530977 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168072c-f7e8-482c-8ae2-6eec89bc593d service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:38:09.531253 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168072c-f7e8-482c-8ae2-6eec89bc593d service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:38:09.531619 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168072c-f7e8-482c-8ae2-6eec89bc593d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:38:09.533518 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-9168072c-f7e8-482c-8ae2-6eec89bc593d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:38:09.547154 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168072c-f7e8-482c-8ae2-6eec89bc593d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:38:09.549648 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168072c-f7e8-482c-8ae2-6eec89bc593d service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:38:09.562394 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1405/2833] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:38:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:38:15.538887 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872b1a4-6cb8-4a1b-95d4-a5036dc50fbe None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:38:15.539480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872b1a4-6cb8-4a1b-95d4-a5036dc50fbe None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:38:15.539480 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872b1a4-6cb8-4a1b-95d4-a5036dc50fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:38:15.559570 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-6872b1a4-6cb8-4a1b-95d4-a5036dc50fbe None None] MFA Rules not processed for user `b64e3a9410554ad1a4478bc9da37dd16`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:38:15.560779 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-6872b1a4-6cb8-4a1b-95d4-a5036dc50fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:38:15.620683 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1429/2834] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:38:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:38:15.970048 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168072c-f7e8-482c-8ae2-6eec89bc593d service nova] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:38:15.971694 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-9168072c-f7e8-482c-8ae2-6eec89bc593d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:38:15.983535 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168072c-f7e8-482c-8ae2-6eec89bc593d service nova] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:38:15.988134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea912d5-f994-4884-a077-dbb3095c1d45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:38:15.989126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea912d5-f994-4884-a077-dbb3095c1d45 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:38:15.989406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea912d5-f994-4884-a077-dbb3095c1d45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:38:15.989674 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea912d5-f994-4884-a077-dbb3095c1d45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:38:15.991672 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-9ea912d5-f994-4884-a077-dbb3095c1d45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:38:16.002557 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea912d5-f994-4884-a077-dbb3095c1d45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:38:16.004272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea912d5-f994-4884-a077-dbb3095c1d45 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:38:16.013838 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1406/2835] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:38:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:38:16.535232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872b1a4-6cb8-4a1b-95d4-a5036dc50fbe None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:38:16.540004 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-6872b1a4-6cb8-4a1b-95d4-a5036dc50fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:38:16.617468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872b1a4-6cb8-4a1b-95d4-a5036dc50fbe None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:38:16.622540 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cec59-fb50-460f-949f-0b929f7024e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a486663ec144db0bbde6bf3deb35a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:38:16.623205 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cec59-fb50-460f-949f-0b929f7024e9 service placement] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:38:16.623516 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cec59-fb50-460f-949f-0b929f7024e9 service placement] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:38:16.623797 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cec59-fb50-460f-949f-0b929f7024e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:38:16.626298 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-910cec59-fb50-460f-949f-0b929f7024e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:38:16.638749 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cec59-fb50-460f-949f-0b929f7024e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:38:16.640419 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cec59-fb50-460f-949f-0b929f7024e9 service placement] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:38:16.651922 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1430/2836] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:38:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:38:26.009474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=40 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:38:26.647104 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=57 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:38:26.927551 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea912d5-f994-4884-a077-dbb3095c1d45 service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:38:26.941544 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea912d5-f994-4884-a077-dbb3095c1d45 service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:38:26.957941 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04dda31-26a2-4b2e-b2e3-bac02160613a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:38:26.958575 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04dda31-26a2-4b2e-b2e3-bac02160613a service nova] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:38:26.958862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04dda31-26a2-4b2e-b2e3-bac02160613a service nova] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:38:26.959144 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04dda31-26a2-4b2e-b2e3-bac02160613a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:38:26.960999 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c04dda31-26a2-4b2e-b2e3-bac02160613a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:38:26.974922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04dda31-26a2-4b2e-b2e3-bac02160613a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:38:26.976579 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04dda31-26a2-4b2e-b2e3-bac02160613a service nova] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:38:26.988832 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1407/2837] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:38:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 20:38:31.234834 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cec59-fb50-460f-949f-0b929f7024e9 service placement] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:38:31.237405 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-910cec59-fb50-460f-949f-0b929f7024e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:38:31.256610 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cec59-fb50-460f-949f-0b929f7024e9 service placement] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:38:31.263643 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c47d8-9b4c-4d2d-b10d-9497b7fe7eb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:38:31.264920 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c47d8-9b4c-4d2d-b10d-9497b7fe7eb5 service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:38:31.265304 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c47d8-9b4c-4d2d-b10d-9497b7fe7eb5 service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:38:31.265677 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c47d8-9b4c-4d2d-b10d-9497b7fe7eb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:38:31.269467 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-074c47d8-9b4c-4d2d-b10d-9497b7fe7eb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:38:31.289034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c47d8-9b4c-4d2d-b10d-9497b7fe7eb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:38:31.292303 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c47d8-9b4c-4d2d-b10d-9497b7fe7eb5 service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:38:31.317630 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1431/2838] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:38:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:38:36.983728 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=6 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:38:41.304799 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=6 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:39:09.512217 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04dda31-26a2-4b2e-b2e3-bac02160613a service nova] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:09.522454 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04dda31-26a2-4b2e-b2e3-bac02160613a service nova] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:09.526134 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d09de9-7d78-4554-822b-581278fb7e6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:09.526743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d09de9-7d78-4554-822b-581278fb7e6c service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:09.527020 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d09de9-7d78-4554-822b-581278fb7e6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:09.527317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d09de9-7d78-4554-822b-581278fb7e6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:09.529221 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-74d09de9-7d78-4554-822b-581278fb7e6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:09.612201 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d09de9-7d78-4554-822b-581278fb7e6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:09.613646 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d09de9-7d78-4554-822b-581278fb7e6c service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:09.625843 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1408/2839] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:39:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:39:12.034683 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c47d8-9b4c-4d2d-b10d-9497b7fe7eb5 service nova] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:12.036159 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-074c47d8-9b4c-4d2d-b10d-9497b7fe7eb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:12.050797 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c47d8-9b4c-4d2d-b10d-9497b7fe7eb5 service nova] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:12.056072 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca36a29-036a-4de2-b671-71b126501cb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a486663ec144db0bbde6bf3deb35a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:12.056986 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca36a29-036a-4de2-b671-71b126501cb3 service placement] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:12.057357 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca36a29-036a-4de2-b671-71b126501cb3 service placement] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:12.057635 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca36a29-036a-4de2-b671-71b126501cb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:12.059552 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-1ca36a29-036a-4de2-b671-71b126501cb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:12.077915 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca36a29-036a-4de2-b671-71b126501cb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:12.079617 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca36a29-036a-4de2-b671-71b126501cb3 service placement] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:12.092868 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1432/2840] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:39:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:39:16.212716 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d09de9-7d78-4554-822b-581278fb7e6c service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:16.214922 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-74d09de9-7d78-4554-822b-581278fb7e6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:16.233348 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d09de9-7d78-4554-822b-581278fb7e6c service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:16.238462 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3e8a5-7b07-4533-a517-f871f4a445f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:16.239357 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3e8a5-7b07-4533-a517-f871f4a445f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:16.239697 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3e8a5-7b07-4533-a517-f871f4a445f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:16.239970 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3e8a5-7b07-4533-a517-f871f4a445f8 admin admin] PATH_INFO: `/v3/users/aa0bb9aa1ac741faa2ea3ab0ae0f334d` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:16.242393 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3e8a5-7b07-4533-a517-f871f4a445f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa0bb9aa1ac741faa2ea3ab0ae0f334d)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:16.244680 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3e8a5-7b07-4533-a517-f871f4a445f8 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:16.513518 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-66b3e8a5-7b07-4533-a517-f871f4a445f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa0bb9aa1ac741faa2ea3ab0ae0f334d'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:16.639881 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-66b3e8a5-7b07-4533-a517-f871f4a445f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa0bb9aa1ac741faa2ea3ab0ae0f334d'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:16.640477 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-66b3e8a5-7b07-4533-a517-f871f4a445f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa0bb9aa1ac741faa2ea3ab0ae0f334d'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:16.641103 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-66b3e8a5-7b07-4533-a517-f871f4a445f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa0bb9aa1ac741faa2ea3ab0ae0f334d'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:16.650160 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-66b3e8a5-7b07-4533-a517-f871f4a445f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa0bb9aa1ac741faa2ea3ab0ae0f334d'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:16.677305 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1409/2841] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:39:16 2022] DELETE /identity/v3/users/aa0bb9aa1ac741faa2ea3ab0ae0f334d => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:39:17.023304 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca36a29-036a-4de2-b671-71b126501cb3 service placement] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:17.037560 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca36a29-036a-4de2-b671-71b126501cb3 service placement] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:17.101293 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec177d-a67c-4bf8-a95f-9b446d93ad22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:17.101926 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec177d-a67c-4bf8-a95f-9b446d93ad22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:17.102208 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec177d-a67c-4bf8-a95f-9b446d93ad22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:17.102488 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec177d-a67c-4bf8-a95f-9b446d93ad22 admin admin] PATH_INFO: `/v3/projects/efb1e75cc0bf464789bcb3e41623197d` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:17.103779 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec177d-a67c-4bf8-a95f-9b446d93ad22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efb1e75cc0bf464789bcb3e41623197d)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:17.105651 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec177d-a67c-4bf8-a95f-9b446d93ad22 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:17.282004 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-61ec177d-a67c-4bf8-a95f-9b446d93ad22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efb1e75cc0bf464789bcb3e41623197d', 'request_id': 'req-61ec177d-a67c-4bf8-a95f-9b446d93ad22'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:17.288610 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-61ec177d-a67c-4bf8-a95f-9b446d93ad22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efb1e75cc0bf464789bcb3e41623197d', 'request_id': 'req-61ec177d-a67c-4bf8-a95f-9b446d93ad22'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:17.416307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-61ec177d-a67c-4bf8-a95f-9b446d93ad22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efb1e75cc0bf464789bcb3e41623197d', 'request_id': 'req-61ec177d-a67c-4bf8-a95f-9b446d93ad22'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:17.434816 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-61ec177d-a67c-4bf8-a95f-9b446d93ad22 admin admin] The token cache is being invalidate because project efb1e75cc0bf464789bcb3e41623197d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:39:17.435136 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-61ec177d-a67c-4bf8-a95f-9b446d93ad22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:17.436037 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-61ec177d-a67c-4bf8-a95f-9b446d93ad22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:17.439292 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1433/2842] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:39:17 2022] DELETE /identity/v3/projects/efb1e75cc0bf464789bcb3e41623197d => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:39:17.443301 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3e8a5-7b07-4533-a517-f871f4a445f8 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:17.445063 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-66b3e8a5-7b07-4533-a517-f871f4a445f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:17.459947 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3e8a5-7b07-4533-a517-f871f4a445f8 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:17.520417 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a70bbe-a2bc-4d7e-9d97-bf0799364fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:17.523102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a70bbe-a2bc-4d7e-9d97-bf0799364fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:17.523102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a70bbe-a2bc-4d7e-9d97-bf0799364fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:17.523102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a70bbe-a2bc-4d7e-9d97-bf0799364fa4 admin admin] PATH_INFO: `/v3/users/db1a0071dfb0436da2221a5d0bdc36ca` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:17.523102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a70bbe-a2bc-4d7e-9d97-bf0799364fa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db1a0071dfb0436da2221a5d0bdc36ca)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:17.524649 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a70bbe-a2bc-4d7e-9d97-bf0799364fa4 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:17.530530 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:39:17.860127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-e9a70bbe-a2bc-4d7e-9d97-bf0799364fa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db1a0071dfb0436da2221a5d0bdc36ca'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:17.976690 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-e9a70bbe-a2bc-4d7e-9d97-bf0799364fa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db1a0071dfb0436da2221a5d0bdc36ca'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:17.977316 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-e9a70bbe-a2bc-4d7e-9d97-bf0799364fa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db1a0071dfb0436da2221a5d0bdc36ca'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:17.977999 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-e9a70bbe-a2bc-4d7e-9d97-bf0799364fa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db1a0071dfb0436da2221a5d0bdc36ca'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:17.989583 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-e9a70bbe-a2bc-4d7e-9d97-bf0799364fa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db1a0071dfb0436da2221a5d0bdc36ca'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:18.009679 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1410/2843] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:39:17 2022] DELETE /identity/v3/users/db1a0071dfb0436da2221a5d0bdc36ca => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:39:18.321456 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec177d-a67c-4bf8-a95f-9b446d93ad22 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:18.323257 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-61ec177d-a67c-4bf8-a95f-9b446d93ad22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:18.337360 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec177d-a67c-4bf8-a95f-9b446d93ad22 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:18.406581 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433b048-08e1-4239-8475-a46481141098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:18.407276 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433b048-08e1-4239-8475-a46481141098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:18.407664 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433b048-08e1-4239-8475-a46481141098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:18.408113 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433b048-08e1-4239-8475-a46481141098 admin admin] PATH_INFO: `/v3/projects/b78df9af6c4b4ea48098bbb5c27ff0cf` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:18.409268 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433b048-08e1-4239-8475-a46481141098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b78df9af6c4b4ea48098bbb5c27ff0cf)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:18.412443 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433b048-08e1-4239-8475-a46481141098 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:18.440345 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:39:18.618383 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-3433b048-08e1-4239-8475-a46481141098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b78df9af6c4b4ea48098bbb5c27ff0cf', 'request_id': 'req-3433b048-08e1-4239-8475-a46481141098'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:18.625213 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-3433b048-08e1-4239-8475-a46481141098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b78df9af6c4b4ea48098bbb5c27ff0cf', 'request_id': 'req-3433b048-08e1-4239-8475-a46481141098'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:18.702080 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-3433b048-08e1-4239-8475-a46481141098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b78df9af6c4b4ea48098bbb5c27ff0cf', 'request_id': 'req-3433b048-08e1-4239-8475-a46481141098'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:18.713757 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-3433b048-08e1-4239-8475-a46481141098 admin admin] The token cache is being invalidate because project b78df9af6c4b4ea48098bbb5c27ff0cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:39:18.714059 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-3433b048-08e1-4239-8475-a46481141098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:18.714783 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-3433b048-08e1-4239-8475-a46481141098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:18.716896 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1434/2844] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:39:18 2022] DELETE /identity/v3/projects/b78df9af6c4b4ea48098bbb5c27ff0cf => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:39:28.005738 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:39:28.736696 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:39:40.055327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a70bbe-a2bc-4d7e-9d97-bf0799364fa4 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:40.056894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-e9a70bbe-a2bc-4d7e-9d97-bf0799364fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:40.073756 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a70bbe-a2bc-4d7e-9d97-bf0799364fa4 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:40.139767 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cfe7d-e6a4-45f8-9bf1-4d9d23da4cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:40.140421 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cfe7d-e6a4-45f8-9bf1-4d9d23da4cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:40.140703 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cfe7d-e6a4-45f8-9bf1-4d9d23da4cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:40.140977 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cfe7d-e6a4-45f8-9bf1-4d9d23da4cf5 admin admin] PATH_INFO: `/v3/users/b64e3a9410554ad1a4478bc9da37dd16` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:40.142174 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671cfe7d-e6a4-45f8-9bf1-4d9d23da4cf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b64e3a9410554ad1a4478bc9da37dd16)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:40.144190 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671cfe7d-e6a4-45f8-9bf1-4d9d23da4cf5 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:40.347190 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-671cfe7d-e6a4-45f8-9bf1-4d9d23da4cf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b64e3a9410554ad1a4478bc9da37dd16'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:40.504334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-671cfe7d-e6a4-45f8-9bf1-4d9d23da4cf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b64e3a9410554ad1a4478bc9da37dd16'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:40.505080 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-671cfe7d-e6a4-45f8-9bf1-4d9d23da4cf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b64e3a9410554ad1a4478bc9da37dd16'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:40.505780 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-671cfe7d-e6a4-45f8-9bf1-4d9d23da4cf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b64e3a9410554ad1a4478bc9da37dd16'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:40.515229 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-671cfe7d-e6a4-45f8-9bf1-4d9d23da4cf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b64e3a9410554ad1a4478bc9da37dd16'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:40.534406 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1411/2845] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:39:40 2022] DELETE /identity/v3/users/b64e3a9410554ad1a4478bc9da37dd16 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:39:40.803668 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433b048-08e1-4239-8475-a46481141098 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:40.803668 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-3433b048-08e1-4239-8475-a46481141098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:40.821957 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433b048-08e1-4239-8475-a46481141098 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:40.917629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18265e-e151-4855-a05a-0fe8187e8bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:40.918609 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18265e-e151-4855-a05a-0fe8187e8bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:40.918609 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18265e-e151-4855-a05a-0fe8187e8bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:40.918907 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18265e-e151-4855-a05a-0fe8187e8bc5 admin admin] PATH_INFO: `/v3/projects/10c568f9f04d4dd8a8f36e7e05058e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:40.920257 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18265e-e151-4855-a05a-0fe8187e8bc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10c568f9f04d4dd8a8f36e7e05058e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:40.922239 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18265e-e151-4855-a05a-0fe8187e8bc5 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:41.051684 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-4e18265e-e151-4855-a05a-0fe8187e8bc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10c568f9f04d4dd8a8f36e7e05058e8f', 'request_id': 'req-4e18265e-e151-4855-a05a-0fe8187e8bc5'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:41.058760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-4e18265e-e151-4855-a05a-0fe8187e8bc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10c568f9f04d4dd8a8f36e7e05058e8f', 'request_id': 'req-4e18265e-e151-4855-a05a-0fe8187e8bc5'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:41.112649 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-4e18265e-e151-4855-a05a-0fe8187e8bc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10c568f9f04d4dd8a8f36e7e05058e8f', 'request_id': 'req-4e18265e-e151-4855-a05a-0fe8187e8bc5'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:41.124969 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-4e18265e-e151-4855-a05a-0fe8187e8bc5 admin admin] The token cache is being invalidate because project 10c568f9f04d4dd8a8f36e7e05058e8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:39:41.125232 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-4e18265e-e151-4855-a05a-0fe8187e8bc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:41.126074 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-4e18265e-e151-4855-a05a-0fe8187e8bc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:41.127414 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1435/2846] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:39:40 2022] DELETE /identity/v3/projects/10c568f9f04d4dd8a8f36e7e05058e8f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:39:41.132475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef96718-88fa-42c2-a77e-1e69d7a4e6e6 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:41.133013 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef96718-88fa-42c2-a77e-1e69d7a4e6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:41.133013 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef96718-88fa-42c2-a77e-1e69d7a4e6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:41.153377 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-9ef96718-88fa-42c2-a77e-1e69d7a4e6e6 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:39:41.156236 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-9ef96718-88fa-42c2-a77e-1e69d7a4e6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:41.215681 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1412/2847] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:39:41.223904 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42122ce4-7837-4b08-84ea-3044f01a9f3b None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:41.224196 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42122ce4-7837-4b08-84ea-3044f01a9f3b None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:41.224465 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42122ce4-7837-4b08-84ea-3044f01a9f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:41.244645 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-42122ce4-7837-4b08-84ea-3044f01a9f3b None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:39:41.246521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-42122ce4-7837-4b08-84ea-3044f01a9f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:41.258407 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1436/2848] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:39:41.262493 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef96718-88fa-42c2-a77e-1e69d7a4e6e6 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:41.272485 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef96718-88fa-42c2-a77e-1e69d7a4e6e6 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:41.277372 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ba3f0-f5b9-4f71-9447-985839bb465c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:41.278141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ba3f0-f5b9-4f71-9447-985839bb465c admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:41.278279 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ba3f0-f5b9-4f71-9447-985839bb465c admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:41.278555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ba3f0-f5b9-4f71-9447-985839bb465c admin admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:41.279221 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ba3f0-f5b9-4f71-9447-985839bb465c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:39:41.279576 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ba3f0-f5b9-4f71-9447-985839bb465c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:41.281205 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ba3f0-f5b9-4f71-9447-985839bb465c admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:41.294541 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1413/2849] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:39:41.299282 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42122ce4-7837-4b08-84ea-3044f01a9f3b None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:41.309839 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42122ce4-7837-4b08-84ea-3044f01a9f3b None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:41.314932 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83364b6f-9ca7-472b-bef6-2ae72c094afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:41.315582 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83364b6f-9ca7-472b-bef6-2ae72c094afa admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:41.315861 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83364b6f-9ca7-472b-bef6-2ae72c094afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:41.316132 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83364b6f-9ca7-472b-bef6-2ae72c094afa admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:41.316764 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83364b6f-9ca7-472b-bef6-2ae72c094afa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:41.318668 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83364b6f-9ca7-472b-bef6-2ae72c094afa admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:41.429026 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1437/2850] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:39:41 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:39:41.433457 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ba3f0-f5b9-4f71-9447-985839bb465c admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:41.444152 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ba3f0-f5b9-4f71-9447-985839bb465c admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:41.447982 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:39:41.501300 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cad38-8e22-4cf7-9a22-47c8f3cd0000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:41.501824 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cad38-8e22-4cf7-9a22-47c8f3cd0000 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:41.502105 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cad38-8e22-4cf7-9a22-47c8f3cd0000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:41.502380 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cad38-8e22-4cf7-9a22-47c8f3cd0000 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:41.502996 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cad38-8e22-4cf7-9a22-47c8f3cd0000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:41.504959 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cad38-8e22-4cf7-9a22-47c8f3cd0000 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:41.587150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1414/2851] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:39:41 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:39:41.591375 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83364b6f-9ca7-472b-bef6-2ae72c094afa admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:41.602098 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83364b6f-9ca7-472b-bef6-2ae72c094afa admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:41.607777 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b0cc1-5b4a-4ae4-87e9-f30805c08e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:41.608402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b0cc1-5b4a-4ae4-87e9-f30805c08e7b admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:41.608710 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b0cc1-5b4a-4ae4-87e9-f30805c08e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:41.608984 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b0cc1-5b4a-4ae4-87e9-f30805c08e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:41.609636 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b0cc1-5b4a-4ae4-87e9-f30805c08e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:41.611258 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b0cc1-5b4a-4ae4-87e9-f30805c08e7b admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:41.622748 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1438/2852] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:39:41.626894 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cad38-8e22-4cf7-9a22-47c8f3cd0000 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:41.637827 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cad38-8e22-4cf7-9a22-47c8f3cd0000 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:41.642669 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d5794-5012-485c-a2e6-3b8455b480cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:41.643273 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d5794-5012-485c-a2e6-3b8455b480cc admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:41.643588 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d5794-5012-485c-a2e6-3b8455b480cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:41.643862 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d5794-5012-485c-a2e6-3b8455b480cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:41.644501 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d5794-5012-485c-a2e6-3b8455b480cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:41.646225 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d5794-5012-485c-a2e6-3b8455b480cc admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:41.659487 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1415/2853] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:39:41.663946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b0cc1-5b4a-4ae4-87e9-f30805c08e7b admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:41.674371 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b0cc1-5b4a-4ae4-87e9-f30805c08e7b admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:41.679081 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403dad3-f6c5-4c94-b158-4adee2738986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:41.679771 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403dad3-f6c5-4c94-b158-4adee2738986 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:41.680050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403dad3-f6c5-4c94-b158-4adee2738986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:41.680329 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403dad3-f6c5-4c94-b158-4adee2738986 admin admin] PATH_INFO: `/v3/projects/6fb5826107ab45a580075fc4deec4091/users/7213138b0d5041ef8574432ec830c5fc/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:41.697055 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403dad3-f6c5-4c94-b158-4adee2738986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fb5826107ab45a580075fc4deec4091, user_id=7213138b0d5041ef8574432ec830c5fc, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:41.700388 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403dad3-f6c5-4c94-b158-4adee2738986 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:41.793724 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1439/2854] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:39:41 2022] PUT /identity/v3/projects/6fb5826107ab45a580075fc4deec4091/users/7213138b0d5041ef8574432ec830c5fc/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:39:41.803982 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892d6da-bbf7-4754-a3e9-302d9a0176e3 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:41.804278 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892d6da-bbf7-4754-a3e9-302d9a0176e3 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:41.804557 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892d6da-bbf7-4754-a3e9-302d9a0176e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:41.835057 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-a892d6da-bbf7-4754-a3e9-302d9a0176e3 None None] MFA Rules not processed for user `7213138b0d5041ef8574432ec830c5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:39:41.836301 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-a892d6da-bbf7-4754-a3e9-302d9a0176e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:41.904300 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1416/2855] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:39:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:39:41.916478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403dad3-f6c5-4c94-b158-4adee2738986 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:41.918838 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-3403dad3-f6c5-4c94-b158-4adee2738986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:41.941977 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:39:42.001677 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403dad3-f6c5-4c94-b158-4adee2738986 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:42.007274 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c814a4-4753-4ffa-a255-977394835eb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ce16da49b4af38491ad4eb6287d70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:42.007893 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c814a4-4753-4ffa-a255-977394835eb2 service nova] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:42.008173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c814a4-4753-4ffa-a255-977394835eb2 service nova] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:42.008449 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c814a4-4753-4ffa-a255-977394835eb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:42.017459 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c814a4-4753-4ffa-a255-977394835eb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:42.019053 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c814a4-4753-4ffa-a255-977394835eb2 service nova] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:42.028512 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1440/2856] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:39:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:39:42.274954 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892d6da-bbf7-4754-a3e9-302d9a0176e3 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:42.342700 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892d6da-bbf7-4754-a3e9-302d9a0176e3 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:42.347141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c64592-ef21-4337-9b8b-4f6b3a9f2068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:42.347810 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c64592-ef21-4337-9b8b-4f6b3a9f2068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:42.348085 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c64592-ef21-4337-9b8b-4f6b3a9f2068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:42.348352 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c64592-ef21-4337-9b8b-4f6b3a9f2068 admin admin] PATH_INFO: `/v3/users/7213138b0d5041ef8574432ec830c5fc` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:42.349478 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c64592-ef21-4337-9b8b-4f6b3a9f2068 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7213138b0d5041ef8574432ec830c5fc)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:42.351375 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c64592-ef21-4337-9b8b-4f6b3a9f2068 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:42.369025 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:39:42.522355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-e4c64592-ef21-4337-9b8b-4f6b3a9f2068 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7213138b0d5041ef8574432ec830c5fc'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:42.610060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-e4c64592-ef21-4337-9b8b-4f6b3a9f2068 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7213138b0d5041ef8574432ec830c5fc'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:42.610613 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-e4c64592-ef21-4337-9b8b-4f6b3a9f2068 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7213138b0d5041ef8574432ec830c5fc'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:42.611214 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-e4c64592-ef21-4337-9b8b-4f6b3a9f2068 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7213138b0d5041ef8574432ec830c5fc'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:42.619077 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-e4c64592-ef21-4337-9b8b-4f6b3a9f2068 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7213138b0d5041ef8574432ec830c5fc'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:42.637814 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1417/2857] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:39:42 2022] DELETE /identity/v3/users/7213138b0d5041ef8574432ec830c5fc => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:39:42.642520 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872f697-73bf-4e5a-b92c-6af7cf68f3d8 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:42.642807 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872f697-73bf-4e5a-b92c-6af7cf68f3d8 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:42.643083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872f697-73bf-4e5a-b92c-6af7cf68f3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:42.665830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-8872f697-73bf-4e5a-b92c-6af7cf68f3d8 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:39:42.665984 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-8872f697-73bf-4e5a-b92c-6af7cf68f3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:42.727841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1441/2858] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:39:42.739460 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c64592-ef21-4337-9b8b-4f6b3a9f2068 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:42.740883 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-e4c64592-ef21-4337-9b8b-4f6b3a9f2068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:42.800408 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c64592-ef21-4337-9b8b-4f6b3a9f2068 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:42.804100 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daeca34-933a-47ac-aaef-07e96bc614a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:42.804713 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daeca34-933a-47ac-aaef-07e96bc614a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:42.804991 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daeca34-933a-47ac-aaef-07e96bc614a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:42.805263 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daeca34-933a-47ac-aaef-07e96bc614a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:42.815674 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daeca34-933a-47ac-aaef-07e96bc614a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:42.817525 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daeca34-933a-47ac-aaef-07e96bc614a3 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:42.828885 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1418/2859] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:39:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:39:43.326007 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872f697-73bf-4e5a-b92c-6af7cf68f3d8 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:43.327809 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-8872f697-73bf-4e5a-b92c-6af7cf68f3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:43.342697 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872f697-73bf-4e5a-b92c-6af7cf68f3d8 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:43.348723 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51543271-04e5-4353-8187-d7aa685e2ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:43.349402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51543271-04e5-4353-8187-d7aa685e2ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:43.349792 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51543271-04e5-4353-8187-d7aa685e2ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:43.349944 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51543271-04e5-4353-8187-d7aa685e2ab2 admin admin] PATH_INFO: `/v3/projects/6fb5826107ab45a580075fc4deec4091` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:43.351267 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51543271-04e5-4353-8187-d7aa685e2ab2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fb5826107ab45a580075fc4deec4091)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:43.353615 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51543271-04e5-4353-8187-d7aa685e2ab2 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:43.451357 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-51543271-04e5-4353-8187-d7aa685e2ab2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fb5826107ab45a580075fc4deec4091', 'request_id': 'req-51543271-04e5-4353-8187-d7aa685e2ab2'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:43.457853 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-51543271-04e5-4353-8187-d7aa685e2ab2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fb5826107ab45a580075fc4deec4091', 'request_id': 'req-51543271-04e5-4353-8187-d7aa685e2ab2'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:43.523913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-51543271-04e5-4353-8187-d7aa685e2ab2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fb5826107ab45a580075fc4deec4091', 'request_id': 'req-51543271-04e5-4353-8187-d7aa685e2ab2'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:43.537563 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-51543271-04e5-4353-8187-d7aa685e2ab2 admin admin] The token cache is being invalidate because project 6fb5826107ab45a580075fc4deec4091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:39:43.537864 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-51543271-04e5-4353-8187-d7aa685e2ab2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:43.538533 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-51543271-04e5-4353-8187-d7aa685e2ab2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:43.540168 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1442/2860] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:39:43 2022] DELETE /identity/v3/projects/6fb5826107ab45a580075fc4deec4091 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:39:43.546102 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e5eb0-db6c-4acd-9777-ddc833c1449d None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:43.546643 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e5eb0-db6c-4acd-9777-ddc833c1449d None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:43.546643 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e5eb0-db6c-4acd-9777-ddc833c1449d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:43.568389 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-df9e5eb0-db6c-4acd-9777-ddc833c1449d None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:39:43.569532 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-df9e5eb0-db6c-4acd-9777-ddc833c1449d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:43.632544 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1419/2861] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:39:43.640727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188be43-770d-4271-8ca1-6946e0f0ec2c None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:43.641011 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188be43-770d-4271-8ca1-6946e0f0ec2c None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:43.641287 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188be43-770d-4271-8ca1-6946e0f0ec2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:43.663304 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-d188be43-770d-4271-8ca1-6946e0f0ec2c None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:39:43.664562 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-d188be43-770d-4271-8ca1-6946e0f0ec2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:43.673290 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1443/2862] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:39:43.677798 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e5eb0-db6c-4acd-9777-ddc833c1449d None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:43.688569 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e5eb0-db6c-4acd-9777-ddc833c1449d None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:43.693537 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84752b91-0065-4da2-a2ce-6558508e126e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:43.694161 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84752b91-0065-4da2-a2ce-6558508e126e admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:43.694438 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84752b91-0065-4da2-a2ce-6558508e126e admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:43.694711 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84752b91-0065-4da2-a2ce-6558508e126e admin admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:43.695369 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84752b91-0065-4da2-a2ce-6558508e126e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:39:43.695705 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84752b91-0065-4da2-a2ce-6558508e126e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:43.697317 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84752b91-0065-4da2-a2ce-6558508e126e admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:43.710131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1420/2863] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:39:43.715050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188be43-770d-4271-8ca1-6946e0f0ec2c None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:43.724424 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188be43-770d-4271-8ca1-6946e0f0ec2c None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:43.729127 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbab4d-3087-42ce-92c2-719378f2c17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:43.729751 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbab4d-3087-42ce-92c2-719378f2c17e admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:43.730608 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbab4d-3087-42ce-92c2-719378f2c17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:43.730882 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbab4d-3087-42ce-92c2-719378f2c17e admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:43.731562 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cbab4d-3087-42ce-92c2-719378f2c17e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:43.733470 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cbab4d-3087-42ce-92c2-719378f2c17e admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:43.816735 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:39:43.824976 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1444/2864] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:39:43 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:39:43.833738 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84752b91-0065-4da2-a2ce-6558508e126e admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:43.845034 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84752b91-0065-4da2-a2ce-6558508e126e admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:43.869253 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:39:43.908160 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cae24-4b1c-4cf5-be48-802d338dae7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:43.908781 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cae24-4b1c-4cf5-be48-802d338dae7a admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:43.909060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cae24-4b1c-4cf5-be48-802d338dae7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:43.909334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cae24-4b1c-4cf5-be48-802d338dae7a admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:43.909982 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cae24-4b1c-4cf5-be48-802d338dae7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:43.911995 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cae24-4b1c-4cf5-be48-802d338dae7a admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:44.010724 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1421/2865] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:39:43 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:39:44.015629 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbab4d-3087-42ce-92c2-719378f2c17e admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:44.027736 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbab4d-3087-42ce-92c2-719378f2c17e admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:44.033330 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba0923-3834-4548-9b43-96e126285ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:44.034010 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba0923-3834-4548-9b43-96e126285ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:44.034356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba0923-3834-4548-9b43-96e126285ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:44.034672 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba0923-3834-4548-9b43-96e126285ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:44.035372 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba0923-3834-4548-9b43-96e126285ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:44.037202 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba0923-3834-4548-9b43-96e126285ea7 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:44.050144 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1445/2866] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:39:44.055855 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cae24-4b1c-4cf5-be48-802d338dae7a admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:44.066671 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cae24-4b1c-4cf5-be48-802d338dae7a admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:44.072331 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592560f-7f8f-4ce9-8b6f-acaa5c9f22c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:44.072885 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592560f-7f8f-4ce9-8b6f-acaa5c9f22c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:44.073166 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592560f-7f8f-4ce9-8b6f-acaa5c9f22c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:44.074212 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592560f-7f8f-4ce9-8b6f-acaa5c9f22c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:44.074743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592560f-7f8f-4ce9-8b6f-acaa5c9f22c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:44.076486 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592560f-7f8f-4ce9-8b6f-acaa5c9f22c0 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:44.086993 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1422/2867] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:39:44.092059 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba0923-3834-4548-9b43-96e126285ea7 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:44.103085 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba0923-3834-4548-9b43-96e126285ea7 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:44.107977 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577de07-491c-4fd6-b469-1ab98b575c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:44.108633 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577de07-491c-4fd6-b469-1ab98b575c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:44.108917 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577de07-491c-4fd6-b469-1ab98b575c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:44.109830 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577de07-491c-4fd6-b469-1ab98b575c45 admin admin] PATH_INFO: `/v3/projects/3dea2ce744b5477ea9d87a5fbce6a964/users/14cdbda34b6e4bf2bcfbdf049642838a/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:44.125273 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577de07-491c-4fd6-b469-1ab98b575c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dea2ce744b5477ea9d87a5fbce6a964, user_id=14cdbda34b6e4bf2bcfbdf049642838a, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:44.128014 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577de07-491c-4fd6-b469-1ab98b575c45 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:44.264246 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1446/2868] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:39:44 2022] PUT /identity/v3/projects/3dea2ce744b5477ea9d87a5fbce6a964/users/14cdbda34b6e4bf2bcfbdf049642838a/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:39:44.276643 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b834f7b-c989-4be9-a460-534ebf1d4097 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:44.276941 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b834f7b-c989-4be9-a460-534ebf1d4097 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:44.277764 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b834f7b-c989-4be9-a460-534ebf1d4097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:44.322671 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-9b834f7b-c989-4be9-a460-534ebf1d4097 None None] MFA Rules not processed for user `14cdbda34b6e4bf2bcfbdf049642838a`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:39:44.325306 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-9b834f7b-c989-4be9-a460-534ebf1d4097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:44.407043 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1423/2869] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:39:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:39:44.412095 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577de07-491c-4fd6-b469-1ab98b575c45 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:44.488787 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577de07-491c-4fd6-b469-1ab98b575c45 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:44.493853 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e62328-1668-4db3-aefa-c9bbefeccc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:44.494514 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e62328-1668-4db3-aefa-c9bbefeccc93 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:44.494852 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e62328-1668-4db3-aefa-c9bbefeccc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:44.495056 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e62328-1668-4db3-aefa-c9bbefeccc93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:44.498960 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e62328-1668-4db3-aefa-c9bbefeccc93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:44.500697 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e62328-1668-4db3-aefa-c9bbefeccc93 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:44.625543 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1447/2870] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:39:44 2022] POST /identity/v3/projects => generated 379 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:39:44.630082 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b834f7b-c989-4be9-a460-534ebf1d4097 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:44.642049 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b834f7b-c989-4be9-a460-534ebf1d4097 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:44.702839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe41c92-c0ed-4078-9ba2-3fd51319f339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:44.703481 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe41c92-c0ed-4078-9ba2-3fd51319f339 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:44.703767 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe41c92-c0ed-4078-9ba2-3fd51319f339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:44.704040 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe41c92-c0ed-4078-9ba2-3fd51319f339 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:44.704704 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe41c92-c0ed-4078-9ba2-3fd51319f339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:44.706973 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe41c92-c0ed-4078-9ba2-3fd51319f339 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:44.872762 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1424/2871] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:39:44 2022] POST /identity/v3/users => generated 296 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:39:44.893498 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e62328-1668-4db3-aefa-c9bbefeccc93 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:44.893498 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e62328-1668-4db3-aefa-c9bbefeccc93 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:44.894252 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5ff27-f819-4b03-84c1-3b86cd23a41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:44.894865 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5ff27-f819-4b03-84c1-3b86cd23a41d admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:44.895145 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5ff27-f819-4b03-84c1-3b86cd23a41d admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:44.895458 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5ff27-f819-4b03-84c1-3b86cd23a41d admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:44.896123 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5ff27-f819-4b03-84c1-3b86cd23a41d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:44.897740 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5ff27-f819-4b03-84c1-3b86cd23a41d admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:44.911528 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1448/2872] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:39:44.916841 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe41c92-c0ed-4078-9ba2-3fd51319f339 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:44.928150 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe41c92-c0ed-4078-9ba2-3fd51319f339 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:44.932828 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5628d41-0aca-4756-b1f1-badec2b15aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:44.933488 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5628d41-0aca-4756-b1f1-badec2b15aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:44.933765 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5628d41-0aca-4756-b1f1-badec2b15aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:44.934034 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5628d41-0aca-4756-b1f1-badec2b15aa2 admin admin] PATH_INFO: `/v3/projects/7dd5a59225d0416e8cdbe878adaccfdd/users/038341de2741447c85890e3b04980fe1/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:44.950242 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5628d41-0aca-4756-b1f1-badec2b15aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd5a59225d0416e8cdbe878adaccfdd, user_id=038341de2741447c85890e3b04980fe1, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:44.952941 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5628d41-0aca-4756-b1f1-badec2b15aa2 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:45.016322 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:39:45.022252 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1425/2873] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:39:44 2022] PUT /identity/v3/projects/7dd5a59225d0416e8cdbe878adaccfdd/users/038341de2741447c85890e3b04980fe1/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:39:45.026530 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5ff27-f819-4b03-84c1-3b86cd23a41d admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:45.040061 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5ff27-f819-4b03-84c1-3b86cd23a41d admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:45.105083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffab6f3-47d6-487f-86d4-b121f5815d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:45.105703 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffab6f3-47d6-487f-86d4-b121f5815d10 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:45.105983 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffab6f3-47d6-487f-86d4-b121f5815d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:45.106258 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffab6f3-47d6-487f-86d4-b121f5815d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:45.106907 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffab6f3-47d6-487f-86d4-b121f5815d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:45.108651 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffab6f3-47d6-487f-86d4-b121f5815d10 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:45.119402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1449/2874] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:39:45.124589 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5628d41-0aca-4756-b1f1-badec2b15aa2 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:45.137910 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5628d41-0aca-4756-b1f1-badec2b15aa2 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:45.143651 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2349e-7657-48ac-b674-91ff6a432dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:45.144281 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2349e-7657-48ac-b674-91ff6a432dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:45.144564 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2349e-7657-48ac-b674-91ff6a432dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:45.144839 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2349e-7657-48ac-b674-91ff6a432dc7 admin admin] PATH_INFO: `/v3/projects/7dd5a59225d0416e8cdbe878adaccfdd/users/038341de2741447c85890e3b04980fe1/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:45.146782 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2349e-7657-48ac-b674-91ff6a432dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd5a59225d0416e8cdbe878adaccfdd, user_id=038341de2741447c85890e3b04980fe1, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:45.149487 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2349e-7657-48ac-b674-91ff6a432dc7 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:45.160887 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1426/2875] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:39:45 2022] PUT /identity/v3/projects/7dd5a59225d0416e8cdbe878adaccfdd/users/038341de2741447c85890e3b04980fe1/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:39:45.171429 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb600e9-8794-46ac-a9d9-c21b56fde9cd None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:45.171806 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb600e9-8794-46ac-a9d9-c21b56fde9cd None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:45.172003 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb600e9-8794-46ac-a9d9-c21b56fde9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:45.203841 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-0cb600e9-8794-46ac-a9d9-c21b56fde9cd None None] MFA Rules not processed for user `038341de2741447c85890e3b04980fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:39:45.205070 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-0cb600e9-8794-46ac-a9d9-c21b56fde9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:45.226050 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:39:45.276913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1450/2876] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:39:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:39:45.288431 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2349e-7657-48ac-b674-91ff6a432dc7 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:45.290453 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-3db2349e-7657-48ac-b674-91ff6a432dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:45.353494 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2349e-7657-48ac-b674-91ff6a432dc7 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:45.357247 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845322a-245c-4c8c-8fba-81784ff003a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:45.357850 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845322a-245c-4c8c-8fba-81784ff003a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:45.358131 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845322a-245c-4c8c-8fba-81784ff003a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:45.358402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845322a-245c-4c8c-8fba-81784ff003a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:45.424497 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845322a-245c-4c8c-8fba-81784ff003a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:45.426790 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845322a-245c-4c8c-8fba-81784ff003a2 service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:45.442324 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1427/2877] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:39:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:39:47.247953 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb600e9-8794-46ac-a9d9-c21b56fde9cd None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:47.249515 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-0cb600e9-8794-46ac-a9d9-c21b56fde9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:47.262266 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb600e9-8794-46ac-a9d9-c21b56fde9cd None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:47.265878 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18da5f-4794-4fcd-9b2c-0ce8b59b8e2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:47.266482 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18da5f-4794-4fcd-9b2c-0ce8b59b8e2e service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:47.266756 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18da5f-4794-4fcd-9b2c-0ce8b59b8e2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:47.267025 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18da5f-4794-4fcd-9b2c-0ce8b59b8e2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:47.276397 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18da5f-4794-4fcd-9b2c-0ce8b59b8e2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:47.283079 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18da5f-4794-4fcd-9b2c-0ce8b59b8e2e service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:47.287468 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1451/2878] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:39:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:39:51.678954 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845322a-245c-4c8c-8fba-81784ff003a2 service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:51.746158 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845322a-245c-4c8c-8fba-81784ff003a2 service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:51.752018 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6b9da-8c3c-44ba-a8d7-edb3f3563e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:51.752678 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6b9da-8c3c-44ba-a8d7-edb3f3563e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:51.753040 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6b9da-8c3c-44ba-a8d7-edb3f3563e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:51.753318 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6b9da-8c3c-44ba-a8d7-edb3f3563e4a admin admin] PATH_INFO: `/v3/users/14cdbda34b6e4bf2bcfbdf049642838a` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:51.754443 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6b9da-8c3c-44ba-a8d7-edb3f3563e4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=14cdbda34b6e4bf2bcfbdf049642838a)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:51.756411 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6b9da-8c3c-44ba-a8d7-edb3f3563e4a admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:52.020419 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:39:52.026327 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-75c6b9da-8c3c-44ba-a8d7-edb3f3563e4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14cdbda34b6e4bf2bcfbdf049642838a'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:52.153160 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-75c6b9da-8c3c-44ba-a8d7-edb3f3563e4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14cdbda34b6e4bf2bcfbdf049642838a'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:52.153776 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-75c6b9da-8c3c-44ba-a8d7-edb3f3563e4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14cdbda34b6e4bf2bcfbdf049642838a'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:52.154386 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-75c6b9da-8c3c-44ba-a8d7-edb3f3563e4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14cdbda34b6e4bf2bcfbdf049642838a'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:52.162238 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-75c6b9da-8c3c-44ba-a8d7-edb3f3563e4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14cdbda34b6e4bf2bcfbdf049642838a'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:52.181099 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1428/2879] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:39:51 2022] DELETE /identity/v3/users/14cdbda34b6e4bf2bcfbdf049642838a => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:39:52.186134 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb2d73-92e5-4ca5-9e4f-9046a45c5826 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:52.186680 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb2d73-92e5-4ca5-9e4f-9046a45c5826 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:52.186680 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb2d73-92e5-4ca5-9e4f-9046a45c5826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:52.207692 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-0cbb2d73-92e5-4ca5-9e4f-9046a45c5826 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:39:52.208927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-0cbb2d73-92e5-4ca5-9e4f-9046a45c5826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:52.296188 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1452/2880] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:39:52.306044 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6b9da-8c3c-44ba-a8d7-edb3f3563e4a admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:52.307509 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-75c6b9da-8c3c-44ba-a8d7-edb3f3563e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:52.370183 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6b9da-8c3c-44ba-a8d7-edb3f3563e4a admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:52.373838 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd860ab-5ef2-4e91-9459-66a66dafa414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:52.374455 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd860ab-5ef2-4e91-9459-66a66dafa414 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:52.374733 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd860ab-5ef2-4e91-9459-66a66dafa414 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:52.375004 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd860ab-5ef2-4e91-9459-66a66dafa414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:52.384873 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd860ab-5ef2-4e91-9459-66a66dafa414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:52.386316 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd860ab-5ef2-4e91-9459-66a66dafa414 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:52.397435 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1429/2881] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:39:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:39:52.893176 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb2d73-92e5-4ca5-9e4f-9046a45c5826 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:52.894712 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-0cbb2d73-92e5-4ca5-9e4f-9046a45c5826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:52.910231 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb2d73-92e5-4ca5-9e4f-9046a45c5826 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:52.918261 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a27f03-40b8-4f67-b5d4-f0cdd14a4d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:52.919346 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a27f03-40b8-4f67-b5d4-f0cdd14a4d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:52.919885 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a27f03-40b8-4f67-b5d4-f0cdd14a4d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:52.920373 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a27f03-40b8-4f67-b5d4-f0cdd14a4d2e admin admin] PATH_INFO: `/v3/projects/3dea2ce744b5477ea9d87a5fbce6a964` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:52.922387 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a27f03-40b8-4f67-b5d4-f0cdd14a4d2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dea2ce744b5477ea9d87a5fbce6a964)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:52.925492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a27f03-40b8-4f67-b5d4-f0cdd14a4d2e admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:53.117006 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-72a27f03-40b8-4f67-b5d4-f0cdd14a4d2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dea2ce744b5477ea9d87a5fbce6a964', 'request_id': 'req-72a27f03-40b8-4f67-b5d4-f0cdd14a4d2e'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:53.125447 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-72a27f03-40b8-4f67-b5d4-f0cdd14a4d2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dea2ce744b5477ea9d87a5fbce6a964', 'request_id': 'req-72a27f03-40b8-4f67-b5d4-f0cdd14a4d2e'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:53.234517 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-72a27f03-40b8-4f67-b5d4-f0cdd14a4d2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dea2ce744b5477ea9d87a5fbce6a964', 'request_id': 'req-72a27f03-40b8-4f67-b5d4-f0cdd14a4d2e'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:53.248282 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-72a27f03-40b8-4f67-b5d4-f0cdd14a4d2e admin admin] The token cache is being invalidate because project 3dea2ce744b5477ea9d87a5fbce6a964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:39:53.248572 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-72a27f03-40b8-4f67-b5d4-f0cdd14a4d2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:53.249246 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-72a27f03-40b8-4f67-b5d4-f0cdd14a4d2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:53.250760 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1453/2882] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:39:52 2022] DELETE /identity/v3/projects/3dea2ce744b5477ea9d87a5fbce6a964 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:39:53.255364 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd860ab-5ef2-4e91-9459-66a66dafa414 service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:53.266740 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd860ab-5ef2-4e91-9459-66a66dafa414 service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:53.329228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68061e5b-a34e-4284-9232-2d7d6dddbab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:53.329972 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68061e5b-a34e-4284-9232-2d7d6dddbab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:53.330324 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68061e5b-a34e-4284-9232-2d7d6dddbab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:53.330784 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68061e5b-a34e-4284-9232-2d7d6dddbab4 admin admin] PATH_INFO: `/v3/users/038341de2741447c85890e3b04980fe1` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:53.332094 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68061e5b-a34e-4284-9232-2d7d6dddbab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=038341de2741447c85890e3b04980fe1)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:53.334228 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68061e5b-a34e-4284-9232-2d7d6dddbab4 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:53.538965 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-68061e5b-a34e-4284-9232-2d7d6dddbab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '038341de2741447c85890e3b04980fe1'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:53.644062 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-68061e5b-a34e-4284-9232-2d7d6dddbab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '038341de2741447c85890e3b04980fe1'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:53.644713 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-68061e5b-a34e-4284-9232-2d7d6dddbab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '038341de2741447c85890e3b04980fe1'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:53.645413 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-68061e5b-a34e-4284-9232-2d7d6dddbab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '038341de2741447c85890e3b04980fe1'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:53.654110 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-68061e5b-a34e-4284-9232-2d7d6dddbab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '038341de2741447c85890e3b04980fe1'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:53.655240 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:39:53.673193 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1430/2883] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:39:53 2022] DELETE /identity/v3/users/038341de2741447c85890e3b04980fe1 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 20:39:54.123543 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a27f03-40b8-4f67-b5d4-f0cdd14a4d2e admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:54.123543 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-72a27f03-40b8-4f67-b5d4-f0cdd14a4d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:54.137535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a27f03-40b8-4f67-b5d4-f0cdd14a4d2e admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:54.169833 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:39:54.203567 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6530430-8406-42cd-b920-fd5ac980c47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:54.204248 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6530430-8406-42cd-b920-fd5ac980c47e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:54.204532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6530430-8406-42cd-b920-fd5ac980c47e admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:54.204855 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6530430-8406-42cd-b920-fd5ac980c47e admin admin] PATH_INFO: `/v3/projects/7dd5a59225d0416e8cdbe878adaccfdd` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:54.206009 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6530430-8406-42cd-b920-fd5ac980c47e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dd5a59225d0416e8cdbe878adaccfdd)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:54.207990 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6530430-8406-42cd-b920-fd5ac980c47e admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:54.346927 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d6530430-8406-42cd-b920-fd5ac980c47e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dd5a59225d0416e8cdbe878adaccfdd', 'request_id': 'req-d6530430-8406-42cd-b920-fd5ac980c47e'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:54.353426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d6530430-8406-42cd-b920-fd5ac980c47e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dd5a59225d0416e8cdbe878adaccfdd', 'request_id': 'req-d6530430-8406-42cd-b920-fd5ac980c47e'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:54.483911 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d6530430-8406-42cd-b920-fd5ac980c47e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dd5a59225d0416e8cdbe878adaccfdd', 'request_id': 'req-d6530430-8406-42cd-b920-fd5ac980c47e'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:54.496063 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d6530430-8406-42cd-b920-fd5ac980c47e admin admin] The token cache is being invalidate because project 7dd5a59225d0416e8cdbe878adaccfdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:39:54.497083 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d6530430-8406-42cd-b920-fd5ac980c47e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:54.497901 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-d6530430-8406-42cd-b920-fd5ac980c47e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:54.499745 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1454/2884] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:39:54 2022] DELETE /identity/v3/projects/7dd5a59225d0416e8cdbe878adaccfdd => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:39:54.505866 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169f508-52c3-4430-95c4-1dffa490aacb None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:54.506432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169f508-52c3-4430-95c4-1dffa490aacb None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:54.506432 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169f508-52c3-4430-95c4-1dffa490aacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:54.527278 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-f169f508-52c3-4430-95c4-1dffa490aacb None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:39:54.528782 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-f169f508-52c3-4430-95c4-1dffa490aacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:54.616747 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1431/2885] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:39:54.626875 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e344ab-2e86-46f5-a2ac-be2f22cbd64d None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:54.631973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e344ab-2e86-46f5-a2ac-be2f22cbd64d None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:54.631973 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e344ab-2e86-46f5-a2ac-be2f22cbd64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:54.650641 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-b7e344ab-2e86-46f5-a2ac-be2f22cbd64d None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:39:54.652009 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-b7e344ab-2e86-46f5-a2ac-be2f22cbd64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:54.664270 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1455/2886] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:39:54.665888 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169f508-52c3-4430-95c4-1dffa490aacb None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:54.676927 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169f508-52c3-4430-95c4-1dffa490aacb None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:54.681628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c9390-2bdc-4f09-a79f-6b6950643dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:54.682360 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c9390-2bdc-4f09-a79f-6b6950643dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:54.682643 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c9390-2bdc-4f09-a79f-6b6950643dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:54.682916 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c9390-2bdc-4f09-a79f-6b6950643dd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:54.683630 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c9390-2bdc-4f09-a79f-6b6950643dd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:39:54.683976 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c9390-2bdc-4f09-a79f-6b6950643dd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:54.686117 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c9390-2bdc-4f09-a79f-6b6950643dd8 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:54.699251 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1432/2887] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:39:54.704820 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e344ab-2e86-46f5-a2ac-be2f22cbd64d None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:54.714475 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e344ab-2e86-46f5-a2ac-be2f22cbd64d None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:54.719492 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60ce16-7cb1-47c4-969d-8702e29c5ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:54.720165 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60ce16-7cb1-47c4-969d-8702e29c5ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:54.720460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60ce16-7cb1-47c4-969d-8702e29c5ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:54.720738 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60ce16-7cb1-47c4-969d-8702e29c5ea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:54.721385 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60ce16-7cb1-47c4-969d-8702e29c5ea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:54.723381 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60ce16-7cb1-47c4-969d-8702e29c5ea6 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:54.864009 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1456/2888] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:39:54 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:39:54.868805 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c9390-2bdc-4f09-a79f-6b6950643dd8 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:54.879420 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c9390-2bdc-4f09-a79f-6b6950643dd8 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:54.954962 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9f623-772f-4e80-af19-ad01ef87f207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:54.955637 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9f623-772f-4e80-af19-ad01ef87f207 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:54.955917 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9f623-772f-4e80-af19-ad01ef87f207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:54.956188 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9f623-772f-4e80-af19-ad01ef87f207 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:54.956832 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9f623-772f-4e80-af19-ad01ef87f207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:54.958892 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9f623-772f-4e80-af19-ad01ef87f207 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:55.085091 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1433/2889] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:39:54 2022] POST /identity/v3/users => generated 290 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:39:55.089855 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60ce16-7cb1-47c4-969d-8702e29c5ea6 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:55.101588 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60ce16-7cb1-47c4-969d-8702e29c5ea6 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:55.107211 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7dcc89-4d21-49ad-897b-d94df5e88fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:55.107882 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dcc89-4d21-49ad-897b-d94df5e88fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:55.108312 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dcc89-4d21-49ad-897b-d94df5e88fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:55.108589 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dcc89-4d21-49ad-897b-d94df5e88fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:55.109252 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7dcc89-4d21-49ad-897b-d94df5e88fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:55.110918 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7dcc89-4d21-49ad-897b-d94df5e88fe5 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:55.122149 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1457/2890] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:39:55.126678 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9f623-772f-4e80-af19-ad01ef87f207 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:55.138034 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9f623-772f-4e80-af19-ad01ef87f207 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:55.143831 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e028e7-7eab-4393-b1c9-5e5a22408447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:55.144344 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e028e7-7eab-4393-b1c9-5e5a22408447 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:55.149653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e028e7-7eab-4393-b1c9-5e5a22408447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:55.149653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e028e7-7eab-4393-b1c9-5e5a22408447 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:55.149653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e028e7-7eab-4393-b1c9-5e5a22408447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:55.149653 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e028e7-7eab-4393-b1c9-5e5a22408447 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:55.160126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1434/2891] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:39:55.165036 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7dcc89-4d21-49ad-897b-d94df5e88fe5 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:55.184541 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7dcc89-4d21-49ad-897b-d94df5e88fe5 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:55.189995 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4eb760-2d6c-48ac-9138-c230eb10fc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:55.191105 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4eb760-2d6c-48ac-9138-c230eb10fc59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:55.191105 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4eb760-2d6c-48ac-9138-c230eb10fc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:55.191396 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4eb760-2d6c-48ac-9138-c230eb10fc59 admin admin] PATH_INFO: `/v3/projects/7948fff2951e45beb586c347873b6594/users/496609a9cf7548a3be0142111b52d071/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:55.208787 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4eb760-2d6c-48ac-9138-c230eb10fc59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7948fff2951e45beb586c347873b6594, user_id=496609a9cf7548a3be0142111b52d071, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:55.211412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4eb760-2d6c-48ac-9138-c230eb10fc59 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:55.340034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1458/2892] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:39:55 2022] PUT /identity/v3/projects/7948fff2951e45beb586c347873b6594/users/496609a9cf7548a3be0142111b52d071/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:39:55.348272 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850eba9-0bce-4afd-8b17-dd06de6ac0f6 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:55.348555 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850eba9-0bce-4afd-8b17-dd06de6ac0f6 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:55.348833 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850eba9-0bce-4afd-8b17-dd06de6ac0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:55.380424 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-1850eba9-0bce-4afd-8b17-dd06de6ac0f6 None None] MFA Rules not processed for user `496609a9cf7548a3be0142111b52d071`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:39:55.381652 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-1850eba9-0bce-4afd-8b17-dd06de6ac0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:55.419350 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:39:55.452183 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1435/2893] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:39:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:39:55.456869 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4eb760-2d6c-48ac-9138-c230eb10fc59 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:55.523851 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:39:55.529128 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4eb760-2d6c-48ac-9138-c230eb10fc59 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:55.533914 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef344ed-420f-4ca2-a6cc-e75d64c723b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:55.534531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef344ed-420f-4ca2-a6cc-e75d64c723b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:55.534822 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef344ed-420f-4ca2-a6cc-e75d64c723b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:55.535211 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef344ed-420f-4ca2-a6cc-e75d64c723b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:55.535727 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef344ed-420f-4ca2-a6cc-e75d64c723b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:55.537615 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef344ed-420f-4ca2-a6cc-e75d64c723b5 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:55.640754 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1459/2894] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:39:55 2022] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:39:55.644426 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850eba9-0bce-4afd-8b17-dd06de6ac0f6 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:55.656319 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850eba9-0bce-4afd-8b17-dd06de6ac0f6 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:55.714746 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e563395-4294-419b-84fd-997468eb3253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:55.715932 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e563395-4294-419b-84fd-997468eb3253 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:55.716191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e563395-4294-419b-84fd-997468eb3253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:55.716506 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e563395-4294-419b-84fd-997468eb3253 admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:55.717143 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e563395-4294-419b-84fd-997468eb3253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:55.719040 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e563395-4294-419b-84fd-997468eb3253 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:55.844758 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1436/2895] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:39:55 2022] POST /identity/v3/users => generated 296 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:39:55.848963 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef344ed-420f-4ca2-a6cc-e75d64c723b5 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:55.860114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef344ed-420f-4ca2-a6cc-e75d64c723b5 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:55.864806 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94816af-ad37-4302-a864-b247bbc9ce0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:55.865473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94816af-ad37-4302-a864-b247bbc9ce0f admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:55.865754 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94816af-ad37-4302-a864-b247bbc9ce0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:55.866026 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94816af-ad37-4302-a864-b247bbc9ce0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:55.866691 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94816af-ad37-4302-a864-b247bbc9ce0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:55.868426 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94816af-ad37-4302-a864-b247bbc9ce0f admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:55.878981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1460/2896] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:39:55.883414 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e563395-4294-419b-84fd-997468eb3253 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:55.893743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e563395-4294-419b-84fd-997468eb3253 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:55.898378 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde53714-42b2-4ed4-b1b3-2e8a91be9d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:55.899038 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde53714-42b2-4ed4-b1b3-2e8a91be9d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:55.899313 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde53714-42b2-4ed4-b1b3-2e8a91be9d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:55.899625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde53714-42b2-4ed4-b1b3-2e8a91be9d7f admin admin] PATH_INFO: `/v3/projects/37d35115aab14e1690eff4a562e7c9bc/users/e6b3945cdaaa473ea08072f43e3506eb/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:55.916068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde53714-42b2-4ed4-b1b3-2e8a91be9d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=37d35115aab14e1690eff4a562e7c9bc, user_id=e6b3945cdaaa473ea08072f43e3506eb, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:55.919304 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde53714-42b2-4ed4-b1b3-2e8a91be9d7f admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:56.010312 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1437/2897] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:39:55 2022] PUT /identity/v3/projects/37d35115aab14e1690eff4a562e7c9bc/users/e6b3945cdaaa473ea08072f43e3506eb/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:39:56.015074 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94816af-ad37-4302-a864-b247bbc9ce0f admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:56.025828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94816af-ad37-4302-a864-b247bbc9ce0f admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:56.084531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb0c37-cb7f-4f36-bf4d-eee0dc144614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:56.085157 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb0c37-cb7f-4f36-bf4d-eee0dc144614 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:56.085432 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb0c37-cb7f-4f36-bf4d-eee0dc144614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:56.085708 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb0c37-cb7f-4f36-bf4d-eee0dc144614 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:56.086367 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb0c37-cb7f-4f36-bf4d-eee0dc144614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:56.088017 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb0c37-cb7f-4f36-bf4d-eee0dc144614 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:56.099043 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1461/2898] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:39:56.103253 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde53714-42b2-4ed4-b1b3-2e8a91be9d7f admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:56.114123 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde53714-42b2-4ed4-b1b3-2e8a91be9d7f admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:56.119074 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef489a9-ba09-4bec-b6e1-64e68ad59248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:56.119767 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef489a9-ba09-4bec-b6e1-64e68ad59248 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:56.120070 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef489a9-ba09-4bec-b6e1-64e68ad59248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:56.120341 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef489a9-ba09-4bec-b6e1-64e68ad59248 admin admin] PATH_INFO: `/v3/projects/37d35115aab14e1690eff4a562e7c9bc/users/e6b3945cdaaa473ea08072f43e3506eb/roles/1e2ac44410664e6b8f42ab3c37e2643f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:56.122285 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef489a9-ba09-4bec-b6e1-64e68ad59248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37d35115aab14e1690eff4a562e7c9bc, user_id=e6b3945cdaaa473ea08072f43e3506eb, role_id=1e2ac44410664e6b8f42ab3c37e2643f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:56.124994 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef489a9-ba09-4bec-b6e1-64e68ad59248 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:56.135581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1438/2899] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:39:56 2022] PUT /identity/v3/projects/37d35115aab14e1690eff4a562e7c9bc/users/e6b3945cdaaa473ea08072f43e3506eb/roles/1e2ac44410664e6b8f42ab3c37e2643f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:39:56.146998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f91992-7678-4637-bd3c-02aa702c4db2 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:56.146998 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f91992-7678-4637-bd3c-02aa702c4db2 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:56.147352 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f91992-7678-4637-bd3c-02aa702c4db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:56.178409 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-56f91992-7678-4637-bd3c-02aa702c4db2 None None] MFA Rules not processed for user `e6b3945cdaaa473ea08072f43e3506eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:39:56.179845 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-56f91992-7678-4637-bd3c-02aa702c4db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:56.256620 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1462/2900] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:39:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:39:56.268165 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef489a9-ba09-4bec-b6e1-64e68ad59248 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:56.269985 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-8ef489a9-ba09-4bec-b6e1-64e68ad59248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:56.332334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef489a9-ba09-4bec-b6e1-64e68ad59248 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:56.336575 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d7eb9-27c5-474d-a4c2-e753f3fee8b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:56.337420 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d7eb9-27c5-474d-a4c2-e753f3fee8b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:56.337792 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d7eb9-27c5-474d-a4c2-e753f3fee8b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:56.338167 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d7eb9-27c5-474d-a4c2-e753f3fee8b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:56.348184 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d7eb9-27c5-474d-a4c2-e753f3fee8b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:56.349625 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d7eb9-27c5-474d-a4c2-e753f3fee8b8 service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:56.359121 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1439/2901] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:39:56 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:39:57.086776 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f91992-7678-4637-bd3c-02aa702c4db2 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:57.141541 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:39:57.153947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f91992-7678-4637-bd3c-02aa702c4db2 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:57.158485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653471d-3225-4cd3-a560-5e659e13f636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:57.159148 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653471d-3225-4cd3-a560-5e659e13f636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:57.159393 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653471d-3225-4cd3-a560-5e659e13f636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:57.159693 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653471d-3225-4cd3-a560-5e659e13f636 admin admin] PATH_INFO: `/v3/users/496609a9cf7548a3be0142111b52d071` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:57.160810 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1653471d-3225-4cd3-a560-5e659e13f636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=496609a9cf7548a3be0142111b52d071)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:57.162714 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1653471d-3225-4cd3-a560-5e659e13f636 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:57.436010 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1653471d-3225-4cd3-a560-5e659e13f636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '496609a9cf7548a3be0142111b52d071'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:57.586746 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1653471d-3225-4cd3-a560-5e659e13f636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '496609a9cf7548a3be0142111b52d071'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:57.587514 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1653471d-3225-4cd3-a560-5e659e13f636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '496609a9cf7548a3be0142111b52d071'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:57.588150 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1653471d-3225-4cd3-a560-5e659e13f636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '496609a9cf7548a3be0142111b52d071'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:57.597660 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-1653471d-3225-4cd3-a560-5e659e13f636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '496609a9cf7548a3be0142111b52d071'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:57.615532 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1463/2902] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:39:57 2022] DELETE /identity/v3/users/496609a9cf7548a3be0142111b52d071 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:39:57.620325 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873a5fa-af78-4551-b540-963da11a28f2 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:57.620950 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873a5fa-af78-4551-b540-963da11a28f2 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:57.620950 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873a5fa-af78-4551-b540-963da11a28f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:57.641253 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-c873a5fa-af78-4551-b540-963da11a28f2 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:39:57.642478 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c873a5fa-af78-4551-b540-963da11a28f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:57.669928 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:39:57.705707 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1440/2903] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:39:57.716317 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653471d-3225-4cd3-a560-5e659e13f636 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:57.717746 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-1653471d-3225-4cd3-a560-5e659e13f636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:57.776041 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653471d-3225-4cd3-a560-5e659e13f636 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:57.780350 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77601074-0e1e-4704-ae17-21812bbc25a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:57.780960 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77601074-0e1e-4704-ae17-21812bbc25a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:57.781244 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77601074-0e1e-4704-ae17-21812bbc25a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:57.781514 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77601074-0e1e-4704-ae17-21812bbc25a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:57.791229 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77601074-0e1e-4704-ae17-21812bbc25a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:57.792719 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77601074-0e1e-4704-ae17-21812bbc25a4 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:57.803334 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1464/2904] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:39:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:39:58.382714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873a5fa-af78-4551-b540-963da11a28f2 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:58.384174 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c873a5fa-af78-4551-b540-963da11a28f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:58.396849 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873a5fa-af78-4551-b540-963da11a28f2 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:58.403176 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366696d5-7a54-4cc1-81f3-44d9ed55d113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:58.403176 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366696d5-7a54-4cc1-81f3-44d9ed55d113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:58.403176 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366696d5-7a54-4cc1-81f3-44d9ed55d113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:58.403176 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366696d5-7a54-4cc1-81f3-44d9ed55d113 admin admin] PATH_INFO: `/v3/projects/7948fff2951e45beb586c347873b6594` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:58.405142 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366696d5-7a54-4cc1-81f3-44d9ed55d113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7948fff2951e45beb586c347873b6594)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:58.407160 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366696d5-7a54-4cc1-81f3-44d9ed55d113 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:58.583387 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-366696d5-7a54-4cc1-81f3-44d9ed55d113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7948fff2951e45beb586c347873b6594', 'request_id': 'req-366696d5-7a54-4cc1-81f3-44d9ed55d113'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:58.590867 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-366696d5-7a54-4cc1-81f3-44d9ed55d113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7948fff2951e45beb586c347873b6594', 'request_id': 'req-366696d5-7a54-4cc1-81f3-44d9ed55d113'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:58.700753 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-366696d5-7a54-4cc1-81f3-44d9ed55d113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7948fff2951e45beb586c347873b6594', 'request_id': 'req-366696d5-7a54-4cc1-81f3-44d9ed55d113'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:58.712442 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-366696d5-7a54-4cc1-81f3-44d9ed55d113 admin admin] The token cache is being invalidate because project 7948fff2951e45beb586c347873b6594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:39:58.712681 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-366696d5-7a54-4cc1-81f3-44d9ed55d113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:58.713328 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-366696d5-7a54-4cc1-81f3-44d9ed55d113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:58.714841 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1441/2905] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:39:58 2022] DELETE /identity/v3/projects/7948fff2951e45beb586c347873b6594 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:39:58.719601 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77601074-0e1e-4704-ae17-21812bbc25a4 service neutron] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:58.730472 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77601074-0e1e-4704-ae17-21812bbc25a4 service neutron] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:58.790521 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff57204-2ad8-4c5b-8321-5e976e876c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:58.793706 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff57204-2ad8-4c5b-8321-5e976e876c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:58.793706 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff57204-2ad8-4c5b-8321-5e976e876c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:58.793706 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff57204-2ad8-4c5b-8321-5e976e876c10 admin admin] PATH_INFO: `/v3/users/e6b3945cdaaa473ea08072f43e3506eb` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:58.793706 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff57204-2ad8-4c5b-8321-5e976e876c10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6b3945cdaaa473ea08072f43e3506eb)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:58.795389 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff57204-2ad8-4c5b-8321-5e976e876c10 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:58.809981 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:39:59.024230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-dff57204-2ad8-4c5b-8321-5e976e876c10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6b3945cdaaa473ea08072f43e3506eb'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:59.192440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-dff57204-2ad8-4c5b-8321-5e976e876c10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6b3945cdaaa473ea08072f43e3506eb'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:59.193073 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-dff57204-2ad8-4c5b-8321-5e976e876c10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6b3945cdaaa473ea08072f43e3506eb'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:59.193679 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-dff57204-2ad8-4c5b-8321-5e976e876c10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6b3945cdaaa473ea08072f43e3506eb'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:59.203173 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-dff57204-2ad8-4c5b-8321-5e976e876c10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6b3945cdaaa473ea08072f43e3506eb'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:59.222062 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1465/2906] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:39:58 2022] DELETE /identity/v3/users/e6b3945cdaaa473ea08072f43e3506eb => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:39:59.710218 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366696d5-7a54-4cc1-81f3-44d9ed55d113 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:39:59.712031 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-366696d5-7a54-4cc1-81f3-44d9ed55d113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:39:59.731565 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366696d5-7a54-4cc1-81f3-44d9ed55d113 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:39:59.797355 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3113ad-b913-47c6-8da1-7a041a47b9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:39:59.798010 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3113ad-b913-47c6-8da1-7a041a47b9d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:39:59.798288 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3113ad-b913-47c6-8da1-7a041a47b9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:39:59.798556 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3113ad-b913-47c6-8da1-7a041a47b9d5 admin admin] PATH_INFO: `/v3/projects/37d35115aab14e1690eff4a562e7c9bc` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:39:59.799807 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3113ad-b913-47c6-8da1-7a041a47b9d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37d35115aab14e1690eff4a562e7c9bc)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:39:59.801714 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3113ad-b913-47c6-8da1-7a041a47b9d5 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:39:59.975645 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-fc3113ad-b913-47c6-8da1-7a041a47b9d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37d35115aab14e1690eff4a562e7c9bc', 'request_id': 'req-fc3113ad-b913-47c6-8da1-7a041a47b9d5'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:59.982834 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-fc3113ad-b913-47c6-8da1-7a041a47b9d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37d35115aab14e1690eff4a562e7c9bc', 'request_id': 'req-fc3113ad-b913-47c6-8da1-7a041a47b9d5'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:39:59.985718 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:40:00.095756 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-fc3113ad-b913-47c6-8da1-7a041a47b9d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37d35115aab14e1690eff4a562e7c9bc', 'request_id': 'req-fc3113ad-b913-47c6-8da1-7a041a47b9d5'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:00.108436 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-fc3113ad-b913-47c6-8da1-7a041a47b9d5 admin admin] The token cache is being invalidate because project 37d35115aab14e1690eff4a562e7c9bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:40:00.108751 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-fc3113ad-b913-47c6-8da1-7a041a47b9d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:00.109450 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-fc3113ad-b913-47c6-8da1-7a041a47b9d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:00.110952 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1442/2907] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:39:59 2022] DELETE /identity/v3/projects/37d35115aab14e1690eff4a562e7c9bc => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:40:00.116049 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591e716-a309-4116-afe0-ce6968853b41 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:00.116713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591e716-a309-4116-afe0-ce6968853b41 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:00.116713 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591e716-a309-4116-afe0-ce6968853b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:00.137879 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-2591e716-a309-4116-afe0-ce6968853b41 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:40:00.139226 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-2591e716-a309-4116-afe0-ce6968853b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:40:00.206295 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1466/2908] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:40:00.271511 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804742be-2883-47ee-aa28-0a889704c98c None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:00.271754 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804742be-2883-47ee-aa28-0a889704c98c None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:00.271966 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804742be-2883-47ee-aa28-0a889704c98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:00.293734 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-804742be-2883-47ee-aa28-0a889704c98c None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:40:00.295098 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-804742be-2883-47ee-aa28-0a889704c98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:40:00.304175 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1443/2909] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:40:00.308776 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591e716-a309-4116-afe0-ce6968853b41 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:00.319338 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591e716-a309-4116-afe0-ce6968853b41 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:00.324103 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642ada1-a47c-47b3-80fa-6cd3e6e5eaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:00.324722 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642ada1-a47c-47b3-80fa-6cd3e6e5eaa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:00.324999 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642ada1-a47c-47b3-80fa-6cd3e6e5eaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:00.325269 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642ada1-a47c-47b3-80fa-6cd3e6e5eaa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:00.325916 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642ada1-a47c-47b3-80fa-6cd3e6e5eaa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:40:00.326214 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642ada1-a47c-47b3-80fa-6cd3e6e5eaa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:00.327877 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642ada1-a47c-47b3-80fa-6cd3e6e5eaa7 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:00.340767 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1467/2910] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 20:40:00.345391 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804742be-2883-47ee-aa28-0a889704c98c None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:00.355148 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804742be-2883-47ee-aa28-0a889704c98c None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:00.361408 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a6e6c-6500-4b86-bbc9-5a2db7bc1bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:00.362060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a6e6c-6500-4b86-bbc9-5a2db7bc1bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:00.362342 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a6e6c-6500-4b86-bbc9-5a2db7bc1bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:00.362656 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a6e6c-6500-4b86-bbc9-5a2db7bc1bd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:00.363263 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a6e6c-6500-4b86-bbc9-5a2db7bc1bd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:00.365281 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a6e6c-6500-4b86-bbc9-5a2db7bc1bd4 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:00.480027 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1444/2911] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:40:00 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:40:00.484531 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642ada1-a47c-47b3-80fa-6cd3e6e5eaa7 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:00.494605 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642ada1-a47c-47b3-80fa-6cd3e6e5eaa7 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:00.551359 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6fb24-68e9-402a-bfcb-4cc5461af176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:00.552000 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6fb24-68e9-402a-bfcb-4cc5461af176 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:00.552276 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6fb24-68e9-402a-bfcb-4cc5461af176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:00.552565 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6fb24-68e9-402a-bfcb-4cc5461af176 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:00.553189 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6fb24-68e9-402a-bfcb-4cc5461af176 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:00.555113 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6fb24-68e9-402a-bfcb-4cc5461af176 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:00.638519 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1468/2912] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:40:00 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:40:00.642659 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a6e6c-6500-4b86-bbc9-5a2db7bc1bd4 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:00.653650 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a6e6c-6500-4b86-bbc9-5a2db7bc1bd4 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:00.658343 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f005bb3-dbbb-4d77-8f29-5e431a66862f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:00.658920 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f005bb3-dbbb-4d77-8f29-5e431a66862f admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:00.659198 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f005bb3-dbbb-4d77-8f29-5e431a66862f admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:00.659491 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f005bb3-dbbb-4d77-8f29-5e431a66862f admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:00.660127 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f005bb3-dbbb-4d77-8f29-5e431a66862f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:00.661750 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f005bb3-dbbb-4d77-8f29-5e431a66862f admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:00.672268 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1445/2913] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:40:00.676388 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6fb24-68e9-402a-bfcb-4cc5461af176 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:00.700164 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6fb24-68e9-402a-bfcb-4cc5461af176 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:00.705289 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc96fbe-df0f-4096-a5ca-f9f74748a126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:00.705920 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc96fbe-df0f-4096-a5ca-f9f74748a126 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:00.706247 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc96fbe-df0f-4096-a5ca-f9f74748a126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:00.706557 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc96fbe-df0f-4096-a5ca-f9f74748a126 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:00.707265 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc96fbe-df0f-4096-a5ca-f9f74748a126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:00.708976 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc96fbe-df0f-4096-a5ca-f9f74748a126 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:00.712366 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:40:00.722798 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1469/2914] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:40:00.727983 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f005bb3-dbbb-4d77-8f29-5e431a66862f admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:00.741513 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f005bb3-dbbb-4d77-8f29-5e431a66862f admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:00.746491 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724adfc-aad3-44eb-b3b7-63efb5d7f678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:00.747191 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724adfc-aad3-44eb-b3b7-63efb5d7f678 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:00.747497 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724adfc-aad3-44eb-b3b7-63efb5d7f678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:00.747800 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724adfc-aad3-44eb-b3b7-63efb5d7f678 admin admin] PATH_INFO: `/v3/projects/7e58892bac4d4033b4760530e1bda6ea/users/2b6a5099020c4c1f9f5eb612d4e34c97/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:00.764602 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724adfc-aad3-44eb-b3b7-63efb5d7f678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e58892bac4d4033b4760530e1bda6ea, user_id=2b6a5099020c4c1f9f5eb612d4e34c97, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:00.767266 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724adfc-aad3-44eb-b3b7-63efb5d7f678 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:00.852390 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1446/2915] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:40:00 2022] PUT /identity/v3/projects/7e58892bac4d4033b4760530e1bda6ea/users/2b6a5099020c4c1f9f5eb612d4e34c97/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:40:00.854412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbcc0f-85d9-4d8f-bf5d-008ef6cd1171 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:00.854695 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbcc0f-85d9-4d8f-bf5d-008ef6cd1171 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:00.854961 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbcc0f-85d9-4d8f-bf5d-008ef6cd1171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:00.884499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-83dbcc0f-85d9-4d8f-bf5d-008ef6cd1171 None None] MFA Rules not processed for user `2b6a5099020c4c1f9f5eb612d4e34c97`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:40:00.885733 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-83dbcc0f-85d9-4d8f-bf5d-008ef6cd1171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:40:00.963917 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1470/2916] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:40:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:40:00.976081 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724adfc-aad3-44eb-b3b7-63efb5d7f678 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:00.977582 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-4724adfc-aad3-44eb-b3b7-63efb5d7f678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:40:01.045386 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724adfc-aad3-44eb-b3b7-63efb5d7f678 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:01.047881 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315761c4-c7d4-4453-b595-f42af4253a01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:01.048499 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315761c4-c7d4-4453-b595-f42af4253a01 service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:01.048776 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315761c4-c7d4-4453-b595-f42af4253a01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:01.049050 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315761c4-c7d4-4453-b595-f42af4253a01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:01.058430 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315761c4-c7d4-4453-b595-f42af4253a01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:01.061165 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315761c4-c7d4-4453-b595-f42af4253a01 service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:01.075775 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1447/2917] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:40:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:40:01.097087 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbcc0f-85d9-4d8f-bf5d-008ef6cd1171 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:01.163824 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbcc0f-85d9-4d8f-bf5d-008ef6cd1171 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:01.168746 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf711e-edb8-407e-a96e-263c5d38312b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:01.169382 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf711e-edb8-407e-a96e-263c5d38312b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:01.169670 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf711e-edb8-407e-a96e-263c5d38312b admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:01.169948 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf711e-edb8-407e-a96e-263c5d38312b admin admin] PATH_INFO: `/v3/users/2b6a5099020c4c1f9f5eb612d4e34c97` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:01.171097 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf711e-edb8-407e-a96e-263c5d38312b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b6a5099020c4c1f9f5eb612d4e34c97)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:01.173063 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf711e-edb8-407e-a96e-263c5d38312b admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:01.396058 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-2ddf711e-edb8-407e-a96e-263c5d38312b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b6a5099020c4c1f9f5eb612d4e34c97'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:01.489224 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-2ddf711e-edb8-407e-a96e-263c5d38312b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b6a5099020c4c1f9f5eb612d4e34c97'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:01.489863 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-2ddf711e-edb8-407e-a96e-263c5d38312b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b6a5099020c4c1f9f5eb612d4e34c97'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:01.490473 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-2ddf711e-edb8-407e-a96e-263c5d38312b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b6a5099020c4c1f9f5eb612d4e34c97'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:01.499297 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-2ddf711e-edb8-407e-a96e-263c5d38312b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b6a5099020c4c1f9f5eb612d4e34c97'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:01.518697 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1471/2918] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:40:01 2022] DELETE /identity/v3/users/2b6a5099020c4c1f9f5eb612d4e34c97 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:40:01.523503 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b322601-1c65-4e51-ae86-40d9d50247ee None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:01.523801 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b322601-1c65-4e51-ae86-40d9d50247ee None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:01.524081 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b322601-1c65-4e51-ae86-40d9d50247ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:01.544591 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-8b322601-1c65-4e51-ae86-40d9d50247ee None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:40:01.545848 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-8b322601-1c65-4e51-ae86-40d9d50247ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:40:01.606383 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1448/2919] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:40:01.616811 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf711e-edb8-407e-a96e-263c5d38312b admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:01.618206 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-2ddf711e-edb8-407e-a96e-263c5d38312b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:40:01.629360 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:40:01.680256 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf711e-edb8-407e-a96e-263c5d38312b admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:01.683759 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d172d-c3e6-4bc0-ae5d-1495542f1ce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:01.684368 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d172d-c3e6-4bc0-ae5d-1495542f1ce5 service neutron] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:01.684641 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d172d-c3e6-4bc0-ae5d-1495542f1ce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:01.684908 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d172d-c3e6-4bc0-ae5d-1495542f1ce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:01.694368 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d172d-c3e6-4bc0-ae5d-1495542f1ce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:01.695845 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d172d-c3e6-4bc0-ae5d-1495542f1ce5 service neutron] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:01.705530 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1472/2920] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:40:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:40:02.170994 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b322601-1c65-4e51-ae86-40d9d50247ee None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:02.172487 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-8b322601-1c65-4e51-ae86-40d9d50247ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:40:02.185281 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b322601-1c65-4e51-ae86-40d9d50247ee None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:02.190893 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bdb01-0478-41db-8e9b-9131c7e1ef7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:02.191578 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bdb01-0478-41db-8e9b-9131c7e1ef7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:02.191867 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bdb01-0478-41db-8e9b-9131c7e1ef7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:02.192141 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bdb01-0478-41db-8e9b-9131c7e1ef7b admin admin] PATH_INFO: `/v3/projects/7e58892bac4d4033b4760530e1bda6ea` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:02.193596 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00bdb01-0478-41db-8e9b-9131c7e1ef7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e58892bac4d4033b4760530e1bda6ea)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:02.195582 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00bdb01-0478-41db-8e9b-9131c7e1ef7b admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:02.219945 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:40:02.331842 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-d00bdb01-0478-41db-8e9b-9131c7e1ef7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e58892bac4d4033b4760530e1bda6ea', 'request_id': 'req-d00bdb01-0478-41db-8e9b-9131c7e1ef7b'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:02.338561 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-d00bdb01-0478-41db-8e9b-9131c7e1ef7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e58892bac4d4033b4760530e1bda6ea', 'request_id': 'req-d00bdb01-0478-41db-8e9b-9131c7e1ef7b'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:02.443326 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-d00bdb01-0478-41db-8e9b-9131c7e1ef7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e58892bac4d4033b4760530e1bda6ea', 'request_id': 'req-d00bdb01-0478-41db-8e9b-9131c7e1ef7b'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:02.456987 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-d00bdb01-0478-41db-8e9b-9131c7e1ef7b admin admin] The token cache is being invalidate because project 7e58892bac4d4033b4760530e1bda6ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81847) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:40:02.457193 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-d00bdb01-0478-41db-8e9b-9131c7e1ef7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:02.457860 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-d00bdb01-0478-41db-8e9b-9131c7e1ef7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:02.459581 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1449/2921] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:40:02 2022] DELETE /identity/v3/projects/7e58892bac4d4033b4760530e1bda6ea => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:40:02.464512 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf64ce-bb73-434b-aab8-f8944ccfda45 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:02.469478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf64ce-bb73-434b-aab8-f8944ccfda45 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:02.469478 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf64ce-bb73-434b-aab8-f8944ccfda45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:02.487941 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-f5bf64ce-bb73-434b-aab8-f8944ccfda45 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:40:02.489359 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-f5bf64ce-bb73-434b-aab8-f8944ccfda45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:40:02.556177 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1473/2922] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:40:02.564346 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdee235-c460-4dbd-9702-e3d817f488af None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:02.564638 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdee235-c460-4dbd-9702-e3d817f488af None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:02.565097 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdee235-c460-4dbd-9702-e3d817f488af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:02.592244 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-7cdee235-c460-4dbd-9702-e3d817f488af None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:40:02.593477 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-7cdee235-c460-4dbd-9702-e3d817f488af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:40:02.603892 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1450/2923] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:40:02.608553 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf64ce-bb73-434b-aab8-f8944ccfda45 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:02.618440 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf64ce-bb73-434b-aab8-f8944ccfda45 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:02.623206 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda69724-b693-4228-8708-abf0bdce0b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:02.623854 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda69724-b693-4228-8708-abf0bdce0b36 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:02.624138 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda69724-b693-4228-8708-abf0bdce0b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:02.624412 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda69724-b693-4228-8708-abf0bdce0b36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:02.625059 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda69724-b693-4228-8708-abf0bdce0b36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81846) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:40:02.625368 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda69724-b693-4228-8708-abf0bdce0b36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:02.626967 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda69724-b693-4228-8708-abf0bdce0b36 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:02.638917 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1474/2924] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:40:02.643504 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdee235-c460-4dbd-9702-e3d817f488af None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:02.653051 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdee235-c460-4dbd-9702-e3d817f488af None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:02.658402 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc51d57-854d-4ff6-bb4c-186252da5013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:02.659013 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc51d57-854d-4ff6-bb4c-186252da5013 admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:02.659293 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc51d57-854d-4ff6-bb4c-186252da5013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:02.659593 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc51d57-854d-4ff6-bb4c-186252da5013 admin admin] PATH_INFO: `/v3/projects` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:02.660232 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc51d57-854d-4ff6-bb4c-186252da5013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:02.662142 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc51d57-854d-4ff6-bb4c-186252da5013 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:02.778523 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1451/2925] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:40:02 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:40:02.783464 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda69724-b693-4228-8708-abf0bdce0b36 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:02.795948 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda69724-b693-4228-8708-abf0bdce0b36 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:02.858817 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c9384-2c64-4d72-8b98-0f128e261366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:02.859460 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c9384-2c64-4d72-8b98-0f128e261366 admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:02.859743 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c9384-2c64-4d72-8b98-0f128e261366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:02.860018 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c9384-2c64-4d72-8b98-0f128e261366 admin admin] PATH_INFO: `/v3/users` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:02.860654 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c9384-2c64-4d72-8b98-0f128e261366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:02.862585 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c9384-2c64-4d72-8b98-0f128e261366 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:02.981858 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1475/2926] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:40:02 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:40:02.986586 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc51d57-854d-4ff6-bb4c-186252da5013 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:02.999830 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc51d57-854d-4ff6-bb4c-186252da5013 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:03.004578 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679cdb9-0614-45d7-ab84-abe9ebad07f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:03.005195 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679cdb9-0614-45d7-ab84-abe9ebad07f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:03.005474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679cdb9-0614-45d7-ab84-abe9ebad07f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:03.005752 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679cdb9-0614-45d7-ab84-abe9ebad07f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:03.006391 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679cdb9-0614-45d7-ab84-abe9ebad07f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:03.008175 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679cdb9-0614-45d7-ab84-abe9ebad07f2 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:03.019330 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1452/2927] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 20:40:03.023773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c9384-2c64-4d72-8b98-0f128e261366 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:03.035191 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c9384-2c64-4d72-8b98-0f128e261366 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:03.039968 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5effd8d9-df24-4334-95b2-1a1749cb288e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:03.040571 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effd8d9-df24-4334-95b2-1a1749cb288e admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:03.040846 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effd8d9-df24-4334-95b2-1a1749cb288e admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:03.041114 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effd8d9-df24-4334-95b2-1a1749cb288e admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:03.041744 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5effd8d9-df24-4334-95b2-1a1749cb288e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:03.043483 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5effd8d9-df24-4334-95b2-1a1749cb288e admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:03.054847 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1476/2928] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:40:03.059159 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679cdb9-0614-45d7-ab84-abe9ebad07f2 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:03.073688 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679cdb9-0614-45d7-ab84-abe9ebad07f2 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:03.079206 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325ca23-4b1d-47ba-ba1a-92f763851f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:03.079914 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325ca23-4b1d-47ba-ba1a-92f763851f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:03.080233 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325ca23-4b1d-47ba-ba1a-92f763851f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:03.080469 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325ca23-4b1d-47ba-ba1a-92f763851f20 admin admin] PATH_INFO: `/v3/projects/9481b64b3a324c91b6c18273ec19b9d4/users/caf59e1acc3f4201961d5aee7685024a/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:03.098231 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325ca23-4b1d-47ba-ba1a-92f763851f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9481b64b3a324c91b6c18273ec19b9d4, user_id=caf59e1acc3f4201961d5aee7685024a, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:03.101994 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325ca23-4b1d-47ba-ba1a-92f763851f20 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:03.269047 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1453/2929] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:40:03 2022] PUT /identity/v3/projects/9481b64b3a324c91b6c18273ec19b9d4/users/caf59e1acc3f4201961d5aee7685024a/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:40:03.281230 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79183036-3d8b-488c-b66e-2ff46de48642 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:03.281618 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79183036-3d8b-488c-b66e-2ff46de48642 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:03.281933 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79183036-3d8b-488c-b66e-2ff46de48642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:03.316947 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-79183036-3d8b-488c-b66e-2ff46de48642 None None] MFA Rules not processed for user `caf59e1acc3f4201961d5aee7685024a`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:40:03.318195 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-79183036-3d8b-488c-b66e-2ff46de48642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:40:03.322402 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:40:03.392334 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1477/2930] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:40:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:40:03.404153 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325ca23-4b1d-47ba-ba1a-92f763851f20 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:03.406265 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-6325ca23-4b1d-47ba-ba1a-92f763851f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:40:03.487699 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325ca23-4b1d-47ba-ba1a-92f763851f20 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:03.493448 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6f3bb-b7e9-4bcf-8cd8-508b4f7499cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:03.494396 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6f3bb-b7e9-4bcf-8cd8-508b4f7499cf service cinder] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:03.494802 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6f3bb-b7e9-4bcf-8cd8-508b4f7499cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:03.495214 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6f3bb-b7e9-4bcf-8cd8-508b4f7499cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:03.510064 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6f3bb-b7e9-4bcf-8cd8-508b4f7499cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:03.511556 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6f3bb-b7e9-4bcf-8cd8-508b4f7499cf service cinder] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:03.522188 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1454/2931] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:40:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:40:04.014918 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79183036-3d8b-488c-b66e-2ff46de48642 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:04.016799 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-79183036-3d8b-488c-b66e-2ff46de48642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:40:04.112499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79183036-3d8b-488c-b66e-2ff46de48642 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:04.112499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84c9cd-d2d1-49af-97dd-524cba0626c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a486663ec144db0bbde6bf3deb35a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:04.112499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84c9cd-d2d1-49af-97dd-524cba0626c6 service placement] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:04.112499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84c9cd-d2d1-49af-97dd-524cba0626c6 service placement] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:04.113034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84c9cd-d2d1-49af-97dd-524cba0626c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:04.113034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-4a84c9cd-d2d1-49af-97dd-524cba0626c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:40:04.113034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84c9cd-d2d1-49af-97dd-524cba0626c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:04.113034 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84c9cd-d2d1-49af-97dd-524cba0626c6 service placement] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:04.123699 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1478/2932] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:40:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:40:08.180160 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6f3bb-b7e9-4bcf-8cd8-508b4f7499cf service cinder] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:08.238539 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:40:08.255426 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6f3bb-b7e9-4bcf-8cd8-508b4f7499cf service cinder] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:08.260159 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a077040-5f37-4967-93dc-307ccaad2b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:08.260830 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a077040-5f37-4967-93dc-307ccaad2b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:08.261071 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a077040-5f37-4967-93dc-307ccaad2b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:08.261342 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a077040-5f37-4967-93dc-307ccaad2b3b admin admin] PATH_INFO: `/v3/users/caf59e1acc3f4201961d5aee7685024a` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:08.262475 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a077040-5f37-4967-93dc-307ccaad2b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=caf59e1acc3f4201961d5aee7685024a)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:08.264474 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a077040-5f37-4967-93dc-307ccaad2b3b admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:08.566951 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-3a077040-5f37-4967-93dc-307ccaad2b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caf59e1acc3f4201961d5aee7685024a'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:08.677632 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-3a077040-5f37-4967-93dc-307ccaad2b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caf59e1acc3f4201961d5aee7685024a'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:08.678356 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-3a077040-5f37-4967-93dc-307ccaad2b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caf59e1acc3f4201961d5aee7685024a'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:08.678963 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-3a077040-5f37-4967-93dc-307ccaad2b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caf59e1acc3f4201961d5aee7685024a'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:08.687266 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-3a077040-5f37-4967-93dc-307ccaad2b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caf59e1acc3f4201961d5aee7685024a'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:08.712694 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1455/2933] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:40:08 2022] DELETE /identity/v3/users/caf59e1acc3f4201961d5aee7685024a => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:40:08.717989 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45196074-b4eb-4d43-a8ce-17a40362a5c6 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:08.718479 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45196074-b4eb-4d43-a8ce-17a40362a5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:08.718626 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45196074-b4eb-4d43-a8ce-17a40362a5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:08.738625 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-45196074-b4eb-4d43-a8ce-17a40362a5c6 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:40:08.739903 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-45196074-b4eb-4d43-a8ce-17a40362a5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:40:08.806279 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1479/2934] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:40:08.816866 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a077040-5f37-4967-93dc-307ccaad2b3b admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:08.825027 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-3a077040-5f37-4967-93dc-307ccaad2b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:40:08.883720 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a077040-5f37-4967-93dc-307ccaad2b3b admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:08.887489 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d1826-48a4-49ae-872a-aefefcd84a40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:08.888158 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d1826-48a4-49ae-872a-aefefcd84a40 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:08.888503 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d1826-48a4-49ae-872a-aefefcd84a40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:08.888823 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d1826-48a4-49ae-872a-aefefcd84a40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:08.901873 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d1826-48a4-49ae-872a-aefefcd84a40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:08.903383 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d1826-48a4-49ae-872a-aefefcd84a40 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:08.914407 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1456/2935] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:40:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:40:09.456446 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45196074-b4eb-4d43-a8ce-17a40362a5c6 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:09.457980 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-45196074-b4eb-4d43-a8ce-17a40362a5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:40:09.471136 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45196074-b4eb-4d43-a8ce-17a40362a5c6 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:09.477499 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc426a-a179-4ab6-80f6-ac44b440bed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:09.477642 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc426a-a179-4ab6-80f6-ac44b440bed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:09.477891 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc426a-a179-4ab6-80f6-ac44b440bed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:09.478284 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc426a-a179-4ab6-80f6-ac44b440bed6 admin admin] PATH_INFO: `/v3/projects/9481b64b3a324c91b6c18273ec19b9d4` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:09.479510 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc426a-a179-4ab6-80f6-ac44b440bed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9481b64b3a324c91b6c18273ec19b9d4)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:09.481449 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc426a-a179-4ab6-80f6-ac44b440bed6 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:09.650307 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:40:09.673448 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-acfc426a-a179-4ab6-80f6-ac44b440bed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9481b64b3a324c91b6c18273ec19b9d4', 'request_id': 'req-acfc426a-a179-4ab6-80f6-ac44b440bed6'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:09.681731 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-acfc426a-a179-4ab6-80f6-ac44b440bed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9481b64b3a324c91b6c18273ec19b9d4', 'request_id': 'req-acfc426a-a179-4ab6-80f6-ac44b440bed6'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:09.803332 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-acfc426a-a179-4ab6-80f6-ac44b440bed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9481b64b3a324c91b6c18273ec19b9d4', 'request_id': 'req-acfc426a-a179-4ab6-80f6-ac44b440bed6'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:09.816187 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-acfc426a-a179-4ab6-80f6-ac44b440bed6 admin admin] The token cache is being invalidate because project 9481b64b3a324c91b6c18273ec19b9d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:40:09.817853 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-acfc426a-a179-4ab6-80f6-ac44b440bed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:09.817853 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-acfc426a-a179-4ab6-80f6-ac44b440bed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:09.818986 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1480/2936] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:40:09 2022] DELETE /identity/v3/projects/9481b64b3a324c91b6c18273ec19b9d4 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:40:09.824181 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b3203-8f1f-4463-9eec-39a50b048a95 None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:09.824734 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b3203-8f1f-4463-9eec-39a50b048a95 None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:09.824734 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b3203-8f1f-4463-9eec-39a50b048a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:09.852357 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-3f1b3203-8f1f-4463-9eec-39a50b048a95 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:40:09.853622 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-3f1b3203-8f1f-4463-9eec-39a50b048a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:40:09.929633 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1457/2937] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:40:09.942073 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603aad5a-9d12-4821-ae6b-f892fd81ef01 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:09.942357 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603aad5a-9d12-4821-ae6b-f892fd81ef01 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:09.942630 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603aad5a-9d12-4821-ae6b-f892fd81ef01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:09.964889 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-603aad5a-9d12-4821-ae6b-f892fd81ef01 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:40:09.966149 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-603aad5a-9d12-4821-ae6b-f892fd81ef01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:40:09.974806 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1481/2938] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:40:09.979832 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b3203-8f1f-4463-9eec-39a50b048a95 None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:09.991170 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b3203-8f1f-4463-9eec-39a50b048a95 None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:09.996693 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082eb923-8dd1-4e4a-a7b2-fb734d1f18c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:09.997434 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082eb923-8dd1-4e4a-a7b2-fb734d1f18c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:09.997789 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082eb923-8dd1-4e4a-a7b2-fb734d1f18c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:09.998167 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082eb923-8dd1-4e4a-a7b2-fb734d1f18c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:09.998934 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082eb923-8dd1-4e4a-a7b2-fb734d1f18c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81847) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 20:40:09.999356 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082eb923-8dd1-4e4a-a7b2-fb734d1f18c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:10.001733 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082eb923-8dd1-4e4a-a7b2-fb734d1f18c3 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:10.004837 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:40:10.015608 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1458/2939] 10.222.0.77 () {58 vars in 1153 bytes} [Tue Sep 6 20:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 20:40:10.020971 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603aad5a-9d12-4821-ae6b-f892fd81ef01 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:10.031021 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603aad5a-9d12-4821-ae6b-f892fd81ef01 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:10.036022 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36ce1f-a3c3-4bfc-b75e-befb2dd3ae9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:10.036712 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36ce1f-a3c3-4bfc-b75e-befb2dd3ae9c admin admin] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:10.044375 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36ce1f-a3c3-4bfc-b75e-befb2dd3ae9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:10.044375 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36ce1f-a3c3-4bfc-b75e-befb2dd3ae9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:10.044375 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36ce1f-a3c3-4bfc-b75e-befb2dd3ae9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:10.044375 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36ce1f-a3c3-4bfc-b75e-befb2dd3ae9c admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:10.229888 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1482/2940] 10.222.0.77 () {60 vars in 1153 bytes} [Tue Sep 6 20:40:10 2022] POST /identity/v3/projects => generated 381 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 20:40:10.232078 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082eb923-8dd1-4e4a-a7b2-fb734d1f18c3 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:10.244654 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082eb923-8dd1-4e4a-a7b2-fb734d1f18c3 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:10.312450 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a0d87-15d7-4316-b98b-51416c3f420d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:10.313785 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a0d87-15d7-4316-b98b-51416c3f420d admin admin] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:10.314118 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a0d87-15d7-4316-b98b-51416c3f420d admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:10.314436 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a0d87-15d7-4316-b98b-51416c3f420d admin admin] PATH_INFO: `/v3/users` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:10.315136 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a0d87-15d7-4316-b98b-51416c3f420d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:10.317366 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a0d87-15d7-4316-b98b-51416c3f420d admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:10.439331 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1459/2941] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Sep 6 20:40:10 2022] POST /identity/v3/users => generated 291 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 20:40:10.443913 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36ce1f-a3c3-4bfc-b75e-befb2dd3ae9c admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:10.459017 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36ce1f-a3c3-4bfc-b75e-befb2dd3ae9c admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:10.467369 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e4537-89ff-4eed-affb-b3fe46918e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:10.468376 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e4537-89ff-4eed-affb-b3fe46918e85 admin admin] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:10.468657 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e4537-89ff-4eed-affb-b3fe46918e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:10.469529 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e4537-89ff-4eed-affb-b3fe46918e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:10.470273 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e4537-89ff-4eed-affb-b3fe46918e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:10.471855 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e4537-89ff-4eed-affb-b3fe46918e85 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:10.483828 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1483/2942] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:40:10.489121 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a0d87-15d7-4316-b98b-51416c3f420d admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:10.500418 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a0d87-15d7-4316-b98b-51416c3f420d admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:10.505193 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc53abf-e90b-499d-b584-a2573fbe1d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:10.505803 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc53abf-e90b-499d-b584-a2573fbe1d12 admin admin] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:10.506081 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc53abf-e90b-499d-b584-a2573fbe1d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:10.506350 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc53abf-e90b-499d-b584-a2573fbe1d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:10.506997 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc53abf-e90b-499d-b584-a2573fbe1d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:10.508628 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc53abf-e90b-499d-b584-a2573fbe1d12 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:10.520334 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1460/2943] 10.222.0.77 () {58 vars in 1122 bytes} [Tue Sep 6 20:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 20:40:10.525356 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e4537-89ff-4eed-affb-b3fe46918e85 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:10.537939 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e4537-89ff-4eed-affb-b3fe46918e85 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:10.543627 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f8ed4-8e53-4365-80ea-ad1e9fe9ed85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:10.544610 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f8ed4-8e53-4365-80ea-ad1e9fe9ed85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:10.544930 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f8ed4-8e53-4365-80ea-ad1e9fe9ed85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:10.545205 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f8ed4-8e53-4365-80ea-ad1e9fe9ed85 admin admin] PATH_INFO: `/v3/projects/f7054467ff244b6fbeafb0247d7f597b/users/f32471f361d2481ea2b455e36bad27c8/roles/d970607307684690803e8e97e2d39e8f` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:10.564246 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f8ed4-8e53-4365-80ea-ad1e9fe9ed85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7054467ff244b6fbeafb0247d7f597b, user_id=f32471f361d2481ea2b455e36bad27c8, role_id=d970607307684690803e8e97e2d39e8f)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:10.567779 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f8ed4-8e53-4365-80ea-ad1e9fe9ed85 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:10.845551 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1484/2944] 10.222.0.77 () {60 vars in 1483 bytes} [Tue Sep 6 20:40:10 2022] PUT /identity/v3/projects/f7054467ff244b6fbeafb0247d7f597b/users/f32471f361d2481ea2b455e36bad27c8/roles/d970607307684690803e8e97e2d39e8f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:40:10.857479 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264399fa-6e74-479c-b4bc-838fe684749c None None] REQUEST_METHOD: `POST` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:10.858068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264399fa-6e74-479c-b4bc-838fe684749c None None] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:10.858068 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264399fa-6e74-479c-b4bc-838fe684749c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:10.892126 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.auth.core [None req-264399fa-6e74-479c-b4bc-838fe684749c None None] MFA Rules not processed for user `f32471f361d2481ea2b455e36bad27c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81847) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:40:10.893928 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-264399fa-6e74-479c-b4bc-838fe684749c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:40:10.965160 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1461/2945] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:40:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 20:40:10.978461 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f8ed4-8e53-4365-80ea-ad1e9fe9ed85 admin admin] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:10.980718 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-ed5f8ed4-8e53-4365-80ea-ad1e9fe9ed85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:40:11.045769 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f8ed4-8e53-4365-80ea-ad1e9fe9ed85 admin admin] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:11.049379 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55961870-a3bc-463b-b774-540108cb82e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6d2bb1c23484010bcc9238f9a9203a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:11.049988 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55961870-a3bc-463b-b774-540108cb82e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:11.050262 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55961870-a3bc-463b-b774-540108cb82e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:11.050535 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55961870-a3bc-463b-b774-540108cb82e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:11.059020 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55961870-a3bc-463b-b774-540108cb82e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:11.060485 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55961870-a3bc-463b-b774-540108cb82e6 service cinder] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:11.069599 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1485/2946] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:40:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:40:14.496684 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264399fa-6e74-479c-b4bc-838fe684749c None None] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:14.566931 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264399fa-6e74-479c-b4bc-838fe684749c None None] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:14.572017 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda56f3-3337-4a3b-82d9-5725beff1336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:14.572683 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda56f3-3337-4a3b-82d9-5725beff1336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:14.572966 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda56f3-3337-4a3b-82d9-5725beff1336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:14.573354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda56f3-3337-4a3b-82d9-5725beff1336 admin admin] PATH_INFO: `/v3/users/f32471f361d2481ea2b455e36bad27c8` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:14.574498 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda56f3-3337-4a3b-82d9-5725beff1336 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f32471f361d2481ea2b455e36bad27c8)` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:14.576468 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda56f3-3337-4a3b-82d9-5725beff1336 admin admin] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:14.581737 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:40:14.848062 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-7cda56f3-3337-4a3b-82d9-5725beff1336 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f32471f361d2481ea2b455e36bad27c8'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:14.941110 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-7cda56f3-3337-4a3b-82d9-5725beff1336 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f32471f361d2481ea2b455e36bad27c8'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:14.941743 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-7cda56f3-3337-4a3b-82d9-5725beff1336 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f32471f361d2481ea2b455e36bad27c8'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:14.942354 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-7cda56f3-3337-4a3b-82d9-5725beff1336 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f32471f361d2481ea2b455e36bad27c8'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:14.950964 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.notifications [None req-7cda56f3-3337-4a3b-82d9-5725beff1336 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f32471f361d2481ea2b455e36bad27c8'} {{(pid=81847) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:14.971643 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1462/2947] 10.222.0.77 () {58 vars in 1224 bytes} [Tue Sep 6 20:40:14 2022] DELETE /identity/v3/users/f32471f361d2481ea2b455e36bad27c8 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:40:14.976496 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca11c3f-b015-4ba9-bb5e-de86438749d0 None None] REQUEST_METHOD: `POST` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:14.977325 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca11c3f-b015-4ba9-bb5e-de86438749d0 None None] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:14.977325 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca11c3f-b015-4ba9-bb5e-de86438749d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:15.004380 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.auth.core [None req-cca11c3f-b015-4ba9-bb5e-de86438749d0 None None] MFA Rules not processed for user `fb0b86a646b84622872ed6d032fae507`. Rule list: `[]` (Enabled: `True`). {{(pid=81846) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 20:40:15.005612 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-cca11c3f-b015-4ba9-bb5e-de86438749d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:40:15.064095 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:40:15.075946 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1486/2948] 10.222.0.77 () {58 vars in 958 bytes} [Tue Sep 6 20:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 20:40:15.087212 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda56f3-3337-4a3b-82d9-5725beff1336 admin admin] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:15.089202 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-7cda56f3-3337-4a3b-82d9-5725beff1336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:40:15.150995 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda56f3-3337-4a3b-82d9-5725beff1336 admin admin] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:15.154770 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a30c22-b2c3-4485-b9b1-9951db75a450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a876d70d9634bf59af5f138e856f75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:15.155396 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a30c22-b2c3-4485-b9b1-9951db75a450 service neutron] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:15.155700 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a30c22-b2c3-4485-b9b1-9951db75a450 service neutron] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:15.155971 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a30c22-b2c3-4485-b9b1-9951db75a450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:15.166695 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a30c22-b2c3-4485-b9b1-9951db75a450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:15.168185 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a30c22-b2c3-4485-b9b1-9951db75a450 service neutron] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:15.178579 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1463/2949] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:40:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:40:15.748449 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca11c3f-b015-4ba9-bb5e-de86438749d0 None None] Authenticating user token {{(pid=81846) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:40:15.750033 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.fernet_utils [None req-cca11c3f-b015-4ba9-bb5e-de86438749d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81846) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:40:15.767013 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca11c3f-b015-4ba9-bb5e-de86438749d0 None None] Validating token access rules against request {{(pid=81846) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:40:15.771979 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1803b-81ef-4314-b8b9-88a3de6599e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb0b86a646b84622872ed6d032fae507', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '003d1519e9c64c4283d31426f50dd5d3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81846) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:40:15.776202 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1803b-81ef-4314-b8b9-88a3de6599e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:40:15.776335 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1803b-81ef-4314-b8b9-88a3de6599e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:40:15.776624 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1803b-81ef-4314-b8b9-88a3de6599e2 admin admin] PATH_INFO: `/v3/projects/f7054467ff244b6fbeafb0247d7f597b` {{(pid=81846) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:40:15.778082 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1803b-81ef-4314-b8b9-88a3de6599e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7054467ff244b6fbeafb0247d7f597b)` {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:40:15.780370 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1803b-81ef-4314-b8b9-88a3de6599e2 admin admin] RBAC: Authorization granted {{(pid=81846) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:40:16.003090 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-7ce1803b-81ef-4314-b8b9-88a3de6599e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7054467ff244b6fbeafb0247d7f597b', 'request_id': 'req-7ce1803b-81ef-4314-b8b9-88a3de6599e2'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:16.009773 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-7ce1803b-81ef-4314-b8b9-88a3de6599e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7054467ff244b6fbeafb0247d7f597b', 'request_id': 'req-7ce1803b-81ef-4314-b8b9-88a3de6599e2'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:16.100410 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-7ce1803b-81ef-4314-b8b9-88a3de6599e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7054467ff244b6fbeafb0247d7f597b', 'request_id': 'req-7ce1803b-81ef-4314-b8b9-88a3de6599e2'} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:16.113066 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-7ce1803b-81ef-4314-b8b9-88a3de6599e2 admin admin] The token cache is being invalidate because project f7054467ff244b6fbeafb0247d7f597b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81846) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 20:40:16.113453 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-7ce1803b-81ef-4314-b8b9-88a3de6599e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:16.114167 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG keystone.notifications [None req-7ce1803b-81ef-4314-b8b9-88a3de6599e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81846) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 20:40:16.116065 dv-cinder-847732-4-smb devstack@keystone.service[81846]: [pid: 81846|app: 0|req: 1487/2950] 10.222.0.77 () {58 vars in 1233 bytes} [Tue Sep 6 20:40:15 2022] DELETE /identity/v3/projects/f7054467ff244b6fbeafb0247d7f597b => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 20:40:25.173890 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=50,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:40:26.108757 dv-cinder-847732-4-smb devstack@keystone.service[81846]: DEBUG dbcounter [-] [81846] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 20:45:10.023430 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a30c22-b2c3-4485-b9b1-9951db75a450 service neutron] Authenticating user token {{(pid=81847) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 20:45:10.025060 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-c8a30c22-b2c3-4485-b9b1-9951db75a450 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:45:10.169484 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a30c22-b2c3-4485-b9b1-9951db75a450 service neutron] Validating token access rules against request {{(pid=81847) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 20:45:10.231773 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fceafd-7e7f-46df-9c74-39a86ce1a68c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a486663ec144db0bbde6bf3deb35a8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b4323c35aef456b90ba9f1b7eb2b343', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81847) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 20:45:10.232394 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fceafd-7e7f-46df-9c74-39a86ce1a68c service placement] REQUEST_METHOD: `GET` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 20:45:10.232676 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fceafd-7e7f-46df-9c74-39a86ce1a68c service placement] SCRIPT_NAME: `/identity` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 20:45:10.232951 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fceafd-7e7f-46df-9c74-39a86ce1a68c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81847) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 20:45:10.234723 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.fernet_utils [None req-89fceafd-7e7f-46df-9c74-39a86ce1a68c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81847) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 20:45:10.248960 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fceafd-7e7f-46df-9c74-39a86ce1a68c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 20:45:10.250762 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fceafd-7e7f-46df-9c74-39a86ce1a68c service placement] RBAC: Authorization granted {{(pid=81847) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 20:45:10.262011 dv-cinder-847732-4-smb devstack@keystone.service[81847]: [pid: 81847|app: 0|req: 1464/2951] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Sep 6 20:45:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 20:45:20.256949 dv-cinder-847732-4-smb devstack@keystone.service[81847]: DEBUG dbcounter [-] [81847] Writing DB stats keystone:SELECT=89 {{(pid=81847) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}